-- Logs begin at Thu 2022-06-30 09:56:53 UTC, end at Thu 2022-06-30 11:11:27 UTC. -- Jun 30 10:26:07.059709 dv-cinder-822822-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 30 10:26:07.067476 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 30 10:26:07.069535 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 30 10:26:07 2022] *** Jun 30 10:26:07.069535 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 30 10:26:07.069535 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 30 10:26:07.069535 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: nodename: dv-cinder-822822-2-iscsi Jun 30 10:26:07.069535 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: machine: x86_64 Jun 30 10:26:07.069535 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: clock source: unix Jun 30 10:26:07.069535 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: pcre jit disabled Jun 30 10:26:07.069991 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: detected number of CPU cores: 4 Jun 30 10:26:07.069991 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: current working directory: / Jun 30 10:26:07.069991 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: detected binary path: /usr/bin/uwsgi-core Jun 30 10:26:07.069991 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: your processes number limit is 47680 Jun 30 10:26:07.069991 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: your memory page size is 4096 bytes Jun 30 10:26:07.069991 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: detected max file descriptor number: 2048 Jun 30 10:26:07.069991 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: lock engine: pthread robust mutexes Jun 30 10:26:07.069991 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: thunder lock: enabled Jun 30 10:26:07.069991 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 30 10:26:07.069991 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 30 10:26:07.114822 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: Python main interpreter initialized at 0x5578f6b9a9c0 Jun 30 10:26:07.114822 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: python threads support enabled Jun 30 10:26:07.114822 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: your server socket listen backlog is limited to 100 connections Jun 30 10:26:07.114822 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: your mercy for graceful operations on workers is 90 seconds Jun 30 10:26:07.115205 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: mapped 403077 bytes (393 KB) for 2 cores Jun 30 10:26:07.115281 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: *** Operational MODE: preforking *** Jun 30 10:26:07.115549 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: *** uWSGI is running in multiple interpreter mode *** Jun 30 10:26:07.115549 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: spawned uWSGI master process (pid: 80255) Jun 30 10:26:07.115747 dv-cinder-822822-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 30 10:26:07.120530 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: spawned uWSGI worker 1 (pid: 80263, cores: 1) Jun 30 10:26:07.120530 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: spawned uWSGI worker 2 (pid: 80264, cores: 1) Jun 30 10:26:07.120530 dv-cinder-822822-2-iscsi devstack@keystone.service[80255]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 30 10:26:12.551887 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 10:26:12.551887 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: from cryptography.utils import int_from_bytes Jun 30 10:26:12.552677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 10:26:12.552677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: from cryptography.utils import int_from_bytes Jun 30 10:26:12.552791 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 10:26:12.552791 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: from cryptography.utils import int_from_bytes Jun 30 10:26:12.553193 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 10:26:12.553193 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: from cryptography.utils import int_from_bytes Jun 30 10:26:12.601494 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 10:26:12.601683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 10:26:12.601766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 10:26:12.601876 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] command line args: [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 10:26:12.601963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 10:26:12.602135 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] command line args: [] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 10:26:12.602221 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 10:26:12.602302 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ================================================================================ {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 10:26:12.602433 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 10:26:12.602550 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] admin_token = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.602629 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ================================================================================ {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 10:26:12.602795 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] config_dir = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.602883 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] admin_token = **** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.602983 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.603152 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] config_dir = [] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.603237 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] config_source = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.603316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] debug = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.603397 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.603515 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.603762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] config_source = [] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.603762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] debug = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.603884 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.603955 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.604040 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.604197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.604306 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.604408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.604558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.604676 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.604775 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.604882 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.604978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] log_config_append = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.605071 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] list_limit = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.605176 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.605284 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] log_config_append = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.605380 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] log_dir = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.605479 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.605575 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] log_file = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.605675 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] log_dir = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.605786 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.605873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] log_file = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.605992 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.606067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.606189 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.606271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.606355 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.606479 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.606560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.606634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.606753 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.607339 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.607469 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.607554 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.607634 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.607758 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.607873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.607983 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.608108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.608220 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.608340 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.608455 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.608594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.608722 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.608842 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.608955 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.609091 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.609204 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.609364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.609447 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.609713 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.609851 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.610032 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] publish_errors = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.610200 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.610284 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.610383 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] publish_errors = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.610467 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.610616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.610690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.610845 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.610929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.611078 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.611188 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.611269 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.611342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] standard_threads = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.611492 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.611577 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.611728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] standard_threads = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.611855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.611936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.612007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.612083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] use_journal = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.612189 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.612268 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] use_json = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.612351 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.612430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] use_stderr = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.612601 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] use_journal = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.612709 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] use_syslog = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.612785 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] use_json = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.612873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.612952 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] use_stderr = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.613057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.613187 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] use_syslog = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.613274 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:26:12.613346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.613524 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.613604 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.613763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.613844 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.614011 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.614087 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.614248 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.614331 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.614494 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.614569 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.614729 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.614805 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.614976 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.615053 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.615212 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.615286 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.615458 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.615538 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.615691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.615775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.615938 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.616013 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.616171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.616246 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.616416 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.616493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.616675 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.616765 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.616915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.616997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.617148 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.617222 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.617391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.617468 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.617640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.617714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.617877 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.618051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.618125 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.618192 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.618349 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.618473 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.618602 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.618728 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.618964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.619040 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.619206 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.619283 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.619440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.619517 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.619672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.619748 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.619903 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.619979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.620137 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.620215 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.620373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.620449 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.620628 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.620714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.620860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.620953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.621106 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.621184 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.621337 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.621423 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.621575 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.621656 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.621821 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.621896 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.622049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.622132 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.622284 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.622366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.622570 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.623186 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.623325 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.623491 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.623565 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.623635 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.623774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.623856 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.624004 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.624088 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.624240 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.624316 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.624487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.624601 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.624745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.624832 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.624984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.625067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.625216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.625293 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.625453 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.625537 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.625686 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.625760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.626061 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.626187 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.626187 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.626379 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.626473 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.626566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.626657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.626748 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.626872 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.626980 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.627060 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.627175 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.627281 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.627358 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.627512 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.627600 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.627762 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.627840 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.627994 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.628072 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.628228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.628312 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.628462 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.628640 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.628711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.628951 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.629212 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.629452 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.629762 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.630010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.630246 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.630486 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.630685 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.630761 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.630934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.631024 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.631178 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.631258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.631445 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.631530 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.631687 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.631770 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.631921 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.631996 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.632156 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.632232 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.632389 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.632466 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.632655 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.632731 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.632895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.632969 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.633133 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.633211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.633373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.633449 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.633610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.633690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.633847 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.633931 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.634082 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.634164 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.634316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.634393 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.634550 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.634627 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.634784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.634865 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.635021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.635098 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.635264 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.635341 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.635499 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.635576 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.635740 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.635816 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.635961 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.636070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.636198 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.636334 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.636417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.636618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.636714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.636883 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.636971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.637126 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.637201 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.637361 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.637443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.637591 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.637675 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.637827 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.637903 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.638084 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.638165 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.638326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.638411 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.638561 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.638815 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.639072 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.639254 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.639339 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.639559 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.639637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.external = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.639798 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.639874 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.640044 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.640119 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.640305 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.640383 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.640551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.password = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.640628 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.640786 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.token = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.640895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.641023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.641102 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] auth.external = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.641258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.641336 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.641504 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.641581 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.641734 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.641820 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.641980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.642066 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] auth.password = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.642214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] auth.token = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.642290 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.642443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.642527 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.642677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.642754 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.642922 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.642999 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.643154 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.643238 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.643402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.643479 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.643637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.643714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.643870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.643953 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.644099 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.644217 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] credential.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.644346 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.644423 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.644621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.644714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.644857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.644934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.645100 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.645177 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.645346 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.645432 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.645581 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.645658 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.645849 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.645926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.646103 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.646189 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.646340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.646416 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.646580 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.646662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.646818 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.646904 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.647051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.647134 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.647298 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.647377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.647527 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.647613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.647772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.647850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.648008 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.648089 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] federation.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.648260 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.648347 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.648497 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.648616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.648769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.648847 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.649001 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.649087 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.649245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.649322 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.649478 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.649557 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.649724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.649810 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.649962 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.650038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.650194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.650276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.650429 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.650582 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.650676 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.650754 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.650906 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.650983 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.651143 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.651222 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.651390 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.651467 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.651628 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.651705 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.651857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.651934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.652089 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.652166 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.652319 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.652396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.652579 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.652660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.652831 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.652937 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.653081 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.653159 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.653310 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.653389 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.653545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.653623 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.654312 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.654400 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.654559 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.654695 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.654799 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.654876 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.655028 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.655106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.655264 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.655343 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.655493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.655571 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.655725 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.655802 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.655961 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.656041 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.656198 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.656275 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.656443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.656535 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.656698 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.656778 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.656930 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.657006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.657166 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.657243 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.657408 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.657486 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.657648 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.657725 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.657890 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.657966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.658119 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.658198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.658354 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.658431 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.658583 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.658666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.658817 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.658896 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.659051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.659128 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.659290 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.659367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.659524 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.659602 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.659764 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.659842 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.659995 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.660072 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.660234 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.660312 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.660464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.660564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.660718 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.660796 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.660956 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.661035 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.661195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.661272 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.661427 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.661505 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.661661 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.661740 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.661896 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.661974 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.662125 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.662201 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.662360 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.662438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.662609 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.662688 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.662836 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.662912 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.663070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.663148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.663311 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.663387 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.663554 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.663639 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.663786 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.663870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.664016 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.664095 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.664249 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.664335 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.664482 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.664614 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.664739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.664850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.664968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.665142 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.665221 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.665405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.665483 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.665641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.665718 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.665896 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.665976 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.666137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.666214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.666365 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.666443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.666612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.666691 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.666849 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.666926 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.667083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.667197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.667318 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.667470 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.667548 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.667740 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.667817 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.668013 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.668100 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.668246 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.668323 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.668497 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.668589 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.668747 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.668873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.668988 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.669066 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.669224 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.669438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.670076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.670248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.670329 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.670534 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.670611 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.670782 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.670858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.671013 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.671093 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.671249 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.671327 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.671486 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.671564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.671734 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.671814 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.671983 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.672061 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.672227 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.672305 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.672477 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.672610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.672749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.672861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.672986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.673140 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.673231 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.673410 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.673488 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.673654 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.673731 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.673900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] role.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.673984 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] resource.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.674147 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] role.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.674225 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.674376 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.674453 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.674624 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.674779 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.674853 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.674924 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.675103 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.675181 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.675349 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.675435 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.675593 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.675672 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.675839 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.675917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.676079 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.676163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.676316 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] role.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.676394 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.676572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.676654 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] role.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.676814 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.676906 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.677057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.677134 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.677303 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.677381 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.677549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.677629 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.677797 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.677943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.678046 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.678178 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.678294 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.678427 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.678541 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.678674 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.678795 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.678920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.679030 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.679165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.679279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.679399 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.679529 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.679653 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.679778 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.679904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.680026 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.680147 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.680377 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.680453 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.680631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.680712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.680863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.680941 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.681115 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.681192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.681369 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.681448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.681615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.681693 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.681850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.681993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.682077 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.682148 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.682298 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.682382 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.682531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] token.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.682617 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.682766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.682843 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.683012 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.683090 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.683245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.683330 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.683498 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.683576 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.683742 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.683819 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.683978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.684063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.684219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.684295 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.684456 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.684561 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.684727 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.684817 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.685229 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.685324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] token.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.685397 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.685475 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.685548 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.685627 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.685700 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.685770 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.685916 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.686017 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.686145 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.686291 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.686390 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.686534 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.686687 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.686816 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.686950 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.connection = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.687082 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.687170 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.687355 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.687435 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.687613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.687691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.687854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.687931 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.688086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.688155 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.688322 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.688389 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.688584 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.688667 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.688818 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.688898 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.689060 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.689138 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.689294 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.689392 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.689535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.689677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.connection = **** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.689765 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.689959 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.690038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.690223 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.690301 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.690462 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.690541 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.690691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.690769 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.690927 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.691004 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.691158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.691240 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.691311 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 10:26:12.691382 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.691619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.691865 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.692102 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.692347 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.692605 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.692856 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.693095 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.693341 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.693573 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.693817 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.694146 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:26:12.694462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 10:26:12.722070 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:12.722552 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:12.722775 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:12.724853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:12.725088 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:12.725311 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:12.731277 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:12.734494 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:12.759953 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:12.760175 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:12.761101 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:12.761359 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:12.902330 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:12.902535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:12.953139 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:12.953284 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:12.953385 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:12.953482 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.022913 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.023105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.023194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.023274 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.023372 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.023510 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.023674 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.023760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.023835 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.023954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.024051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.024189 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.049171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.049402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.049490 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.049628 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.049712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.049853 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.049936 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.050075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.050165 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.050292 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.050375 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.050507 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.050588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.050736 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.062261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.062667 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.075009 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.075239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.075461 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.075710 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.075928 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.076144 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.076357 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.085131 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.085360 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.085578 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.085796 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.086009 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.086222 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.086433 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:26:13.099927 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.100136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 30 10:26:13.100283 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.100470 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.100577 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 30 10:26:13.100700 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 30 10:26:13.100831 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.100968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.101049 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 30 10:26:13.101227 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.101317 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.101481 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.101562 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.101731 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.101810 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.101986 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.113137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.113399 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.113491 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.113658 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.113739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.113920 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.114003 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.114195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.122277 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.123204 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.126153 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.126431 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.126515 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.126703 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.126785 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.126975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.127065 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.127246 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.127328 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.127505 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.127586 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.127763 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.127845 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.128023 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.128105 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.128285 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.128365 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.128569 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.128654 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.128833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.128912 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.129089 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.155412 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.155505 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.157008 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.157094 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.157288 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.157382 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.162585 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.162668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.162859 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.162939 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.163244 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.163337 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.171055 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.171145 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.171329 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.171410 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.175799 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.175889 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.176076 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.176158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.176350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.176442 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.176643 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.176740 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.176917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.177039 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.177186 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.177299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.177445 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.177537 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.177705 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.177799 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.196920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.197057 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.197193 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.197326 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.202349 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.202574 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.205990 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.206283 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.206364 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.206566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.211420 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.211703 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.215048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.215321 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.218794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.219048 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.219137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.219339 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.219425 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.219626 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.219719 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.219903 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.219987 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.220172 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.220256 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.220451 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.240215 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.240522 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.240788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.241049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.241764 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.242046 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.242309 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.242565 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.249049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.250522 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.250767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.251042 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.252201 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.252469 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.254277 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.254558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.254836 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.255115 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.255395 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.255679 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.255954 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.256226 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.256515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.256793 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.269801 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.270088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.270375 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.270650 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.270927 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.272542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.272652 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.272828 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.272953 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.273112 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.273403 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.273684 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.275406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.275695 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.291468 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.294761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.294864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.298159 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.298249 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.299894 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.301531 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.301631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.301821 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.302097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.303257 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.304941 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.305225 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.305511 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.309500 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.311125 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.312871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.314373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.314512 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.314673 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.315068 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.315346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.317777 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.318074 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.318468 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.318763 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.324555 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.324844 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.325128 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.328456 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.328766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.329044 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.333609 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.333888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.334164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.334435 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.334703 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.335070 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.335356 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.335625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.335915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.336187 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.336464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.336750 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.336987 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:26:13.337090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.337263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.337402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.337559 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.337798 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.338067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.338443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.338726 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.339011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.339289 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.339558 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.339828 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.340094 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.340358 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.340652 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:26:13.376942 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5578f6b9a9c0 pid: 80264 (default app) Jun 30 10:26:13.380298 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799440f-adea-4e5d-b917-c2aa6f047222 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:13.380431 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5578f6b9a9c0 pid: 80263 (default app) Jun 30 10:26:13.380620 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799440f-adea-4e5d-b917-c2aa6f047222 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:13.380904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799440f-adea-4e5d-b917-c2aa6f047222 None None] PATH_INFO: `/v3` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:13.385092 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 791 bytes} [Thu Jun 30 10:26:13 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:20.986880 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedd89b-6c2c-4e69-85ca-24a28eae0c2a None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:20.987461 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedd89b-6c2c-4e69-85ca-24a28eae0c2a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:20.987461 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedd89b-6c2c-4e69-85ca-24a28eae0c2a None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:20.991801 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1/2] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:20.997041 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e30f5-44ea-4d95-bbfe-a8a785866843 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:20.998008 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e30f5-44ea-4d95-bbfe-a8a785866843 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:20.998123 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e30f5-44ea-4d95-bbfe-a8a785866843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:21.066802 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: INFO dbcounter [None req-fc0e30f5-44ea-4d95-bbfe-a8a785866843 None None] Registered counter for database keystone Jun 30 10:26:21.088085 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG oslo_db.sqlalchemy.engines [None req-fc0e30f5-44ea-4d95-bbfe-a8a785866843 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 10:26:21.094357 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writer thread running {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 10:26:21.268953 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG passlib.handlers.bcrypt [None req-fc0e30f5-44ea-4d95-bbfe-a8a785866843 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80264) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 30 10:26:21.269368 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG passlib.handlers.bcrypt [None req-fc0e30f5-44ea-4d95-bbfe-a8a785866843 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80264) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 30 10:26:21.323337 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-fc0e30f5-44ea-4d95-bbfe-a8a785866843 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:21.324962 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fc0e30f5-44ea-4d95-bbfe-a8a785866843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:21.444751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 2/3] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 30 10:26:21.615296 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedd89b-6c2c-4e69-85ca-24a28eae0c2a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:21.685830 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: INFO dbcounter [None req-0cedd89b-6c2c-4e69-85ca-24a28eae0c2a None None] Registered counter for database keystone Jun 30 10:26:21.705499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG oslo_db.sqlalchemy.engines [None req-0cedd89b-6c2c-4e69-85ca-24a28eae0c2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80263) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 10:26:21.711655 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writer thread running {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 10:26:21.827872 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedd89b-6c2c-4e69-85ca-24a28eae0c2a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:21.832100 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530bb7e-916a-4e6c-b9e5-712d774ad229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:21.832789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530bb7e-916a-4e6c-b9e5-712d774ad229 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:21.833076 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530bb7e-916a-4e6c-b9e5-712d774ad229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:21.833356 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530bb7e-916a-4e6c-b9e5-712d774ad229 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:21.842190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530bb7e-916a-4e6c-b9e5-712d774ad229 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:21.893784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e530bb7e-916a-4e6c-b9e5-712d774ad229 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 30 10:26:21.894122 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530bb7e-916a-4e6c-b9e5-712d774ad229 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:21.903535 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 2/4] 10.222.0.59 () {58 vars in 1324 bytes} [Thu Jun 30 10:26:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:26:21.910006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e30f5-44ea-4d95-bbfe-a8a785866843 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:21.924498 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e30f5-44ea-4d95-bbfe-a8a785866843 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:21.928887 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb27f24-78e8-4523-874d-9f8be88400d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:21.929989 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb27f24-78e8-4523-874d-9f8be88400d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:21.930277 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb27f24-78e8-4523-874d-9f8be88400d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:21.930558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb27f24-78e8-4523-874d-9f8be88400d5 admin admin] PATH_INFO: `/v3/projects/e1140dfc0b9a4b21aa549fc69cc6961b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:21.932051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb27f24-78e8-4523-874d-9f8be88400d5 admin admin] RBAC: Authorizing `identity:get_project(project_id=e1140dfc0b9a4b21aa549fc69cc6961b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:21.985698 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ffb27f24-78e8-4523-874d-9f8be88400d5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 30 10:26:21.986045 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb27f24-78e8-4523-874d-9f8be88400d5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:21.990594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 3/5] 10.222.0.59 () {56 vars in 1207 bytes} [Thu Jun 30 10:26:21 2022] GET /identity/v3/projects/e1140dfc0b9a4b21aa549fc69cc6961b => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:24.006302 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad5a65-8204-431c-889e-d4640091b60a None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:24.006810 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad5a65-8204-431c-889e-d4640091b60a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:24.006890 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad5a65-8204-431c-889e-d4640091b60a None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:24.010989 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 3/6] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:24.016904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01da53-4edc-49c7-834d-91888ff6d0c6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:24.017330 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01da53-4edc-49c7-834d-91888ff6d0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:24.017462 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01da53-4edc-49c7-834d-91888ff6d0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:24.035764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3b01da53-4edc-49c7-834d-91888ff6d0c6 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:24.037327 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3b01da53-4edc-49c7-834d-91888ff6d0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:24.045101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 4/7] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 30 10:26:24.067449 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad5a65-8204-431c-889e-d4640091b60a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:24.080561 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad5a65-8204-431c-889e-d4640091b60a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:24.084780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be280c97-b069-4514-bce1-19eb6ecff191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:24.085399 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be280c97-b069-4514-bce1-19eb6ecff191 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:24.085685 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be280c97-b069-4514-bce1-19eb6ecff191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:24.085963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be280c97-b069-4514-bce1-19eb6ecff191 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:24.093610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be280c97-b069-4514-bce1-19eb6ecff191 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:24.095430 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be280c97-b069-4514-bce1-19eb6ecff191 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:24.104931 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 4/8] 10.222.0.59 () {58 vars in 1324 bytes} [Thu Jun 30 10:26:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:26:24.109985 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01da53-4edc-49c7-834d-91888ff6d0c6 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:24.118761 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01da53-4edc-49c7-834d-91888ff6d0c6 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:24.123612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66cccb-3abf-4c32-a19f-752615f3a67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:24.124450 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66cccb-3abf-4c32-a19f-752615f3a67f admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:24.124762 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66cccb-3abf-4c32-a19f-752615f3a67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:24.125035 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66cccb-3abf-4c32-a19f-752615f3a67f admin admin] PATH_INFO: `/v3/users/224404a1bd69482b9e7c4f685daaf4a4` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:24.126389 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66cccb-3abf-4c32-a19f-752615f3a67f admin admin] RBAC: Authorizing `identity:get_user(user_id=224404a1bd69482b9e7c4f685daaf4a4)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:24.128215 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66cccb-3abf-4c32-a19f-752615f3a67f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:24.129821 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 5/9] 10.222.0.59 () {56 vars in 1198 bytes} [Thu Jun 30 10:26:24 2022] GET /identity/v3/users/224404a1bd69482b9e7c4f685daaf4a4 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:26.202603 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9371e-55b3-45cd-acfe-710912c32576 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:26.203133 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9371e-55b3-45cd-acfe-710912c32576 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:26.203133 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9371e-55b3-45cd-acfe-710912c32576 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:26.204515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 5/10] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:26:26.209592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094dbc0-bc6c-4e5f-90fd-50d5a4b6f89c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:26.210036 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094dbc0-bc6c-4e5f-90fd-50d5a4b6f89c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:26.210162 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094dbc0-bc6c-4e5f-90fd-50d5a4b6f89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:26.217885 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016563d1-9528-4cdf-a035-3ee3f5d9577f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:26.218177 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016563d1-9528-4cdf-a035-3ee3f5d9577f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:26.218461 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016563d1-9528-4cdf-a035-3ee3f5d9577f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:26.219774 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 6/11] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:26:26.225065 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49449283-de97-4052-a387-184890b9a302 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:26.225355 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49449283-de97-4052-a387-184890b9a302 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:26.225638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49449283-de97-4052-a387-184890b9a302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:26.226727 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4094dbc0-bc6c-4e5f-90fd-50d5a4b6f89c None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:26.227913 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4094dbc0-bc6c-4e5f-90fd-50d5a4b6f89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:26.267382 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG passlib.handlers.bcrypt [None req-49449283-de97-4052-a387-184890b9a302 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80263) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 30 10:26:26.267793 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG passlib.handlers.bcrypt [None req-49449283-de97-4052-a387-184890b9a302 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80263) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 30 10:26:26.308154 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 6/12] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:26:26.313204 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-49449283-de97-4052-a387-184890b9a302 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:26.314767 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-49449283-de97-4052-a387-184890b9a302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:26.331994 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094dbc0-bc6c-4e5f-90fd-50d5a4b6f89c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:26.355623 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:26.414844 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 7/13] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:26:26.437292 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49449283-de97-4052-a387-184890b9a302 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:26.439027 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094dbc0-bc6c-4e5f-90fd-50d5a4b6f89c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:26.472421 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e184f9d-e5b5-470b-a0b3-873a5246412f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:26.473436 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e184f9d-e5b5-470b-a0b3-873a5246412f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:26.473719 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e184f9d-e5b5-470b-a0b3-873a5246412f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:26.473997 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e184f9d-e5b5-470b-a0b3-873a5246412f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:26.484911 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e184f9d-e5b5-470b-a0b3-873a5246412f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:26:26.495956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-6e184f9d-e5b5-470b-a0b3-873a5246412f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:26:26.495956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:26:26.495956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:26:26.495956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:26:26.495956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:26:26.495956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:26:26.495956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:26:26.495956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:26:26.495956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:26:26.495956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:26:26.495956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:26:26.495956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:26:26.495956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:26:26.495956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:26:26.495956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:26:26.495956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:26:26.496888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:26:26.496888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:26:26.496888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:26:26.496888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:26:26.496888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:26:26.496888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:26:26.496888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:26:26.496888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:26:26.496888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:26:26.496888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:26:26.496888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:26:26.496888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:26:26.496888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:26:26.496888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:26:26.496888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:26:26.496888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:26:26.498239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:26:26.498239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:26:26.498239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:26:26.498239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:26:26.498239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:26:26.498239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:26:26.498239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:26:26.498239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:26:26.498239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:26:26.498239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:26:26.498239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:26:26.498239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:26:26.498239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 7/14] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:26:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:26:26.503483 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e184f9d-e5b5-470b-a0b3-873a5246412f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:26.537124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49449283-de97-4052-a387-184890b9a302 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:26.539373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:26.574346 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cb798-c683-406d-86b3-482db8086dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:26.575234 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cb798-c683-406d-86b3-482db8086dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:26.575549 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cb798-c683-406d-86b3-482db8086dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:26.575826 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cb798-c683-406d-86b3-482db8086dc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:26.584728 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:26.602574 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e184f9d-e5b5-470b-a0b3-873a5246412f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:26.636563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd99c8-6161-47a5-8d15-ef46f0c49837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:26.637215 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd99c8-6161-47a5-8d15-ef46f0c49837 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:26.637503 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd99c8-6161-47a5-8d15-ef46f0c49837 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:26.637777 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd99c8-6161-47a5-8d15-ef46f0c49837 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:26.639033 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd99c8-6161-47a5-8d15-ef46f0c49837 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:26.639340 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd99c8-6161-47a5-8d15-ef46f0c49837 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:26.640760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd99c8-6161-47a5-8d15-ef46f0c49837 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:26.642017 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cb798-c683-406d-86b3-482db8086dc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:26.643575 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cb798-c683-406d-86b3-482db8086dc0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:26.652319 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 8/15] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:26:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:26.659258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd99c8-6161-47a5-8d15-ef46f0c49837 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:26.744261 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 8/16] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:26:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 10:26:26.749759 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cb798-c683-406d-86b3-482db8086dc0 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:26.752447 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:26.765779 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd99c8-6161-47a5-8d15-ef46f0c49837 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:26.798892 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce492d-cc29-4df8-a6bb-a2770f461da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:26.799746 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce492d-cc29-4df8-a6bb-a2770f461da3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:26.800029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce492d-cc29-4df8-a6bb-a2770f461da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:26.800307 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce492d-cc29-4df8-a6bb-a2770f461da3 None admin] PATH_INFO: `/v3/users/224404a1bd69482b9e7c4f685daaf4a4` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:26.801528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce492d-cc29-4df8-a6bb-a2770f461da3 None admin] RBAC: Authorizing `identity:get_user(user_id=224404a1bd69482b9e7c4f685daaf4a4)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:26.802986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce492d-cc29-4df8-a6bb-a2770f461da3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:26.804606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 9/17] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:26:26 2022] GET /identity/v3/users/224404a1bd69482b9e7c4f685daaf4a4 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:26.810060 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce492d-cc29-4df8-a6bb-a2770f461da3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:26.824053 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:26.848975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cb798-c683-406d-86b3-482db8086dc0 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:26.881829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a9a7d-83ea-47f3-901b-946c62047467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:26.882615 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a9a7d-83ea-47f3-901b-946c62047467 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:26.882901 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a9a7d-83ea-47f3-901b-946c62047467 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:26.883181 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a9a7d-83ea-47f3-901b-946c62047467 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:26.903011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a9a7d-83ea-47f3-901b-946c62047467 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:26.905071 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a9a7d-83ea-47f3-901b-946c62047467 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:26.908452 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce492d-cc29-4df8-a6bb-a2770f461da3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:26.925147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-ef1a9a7d-83ea-47f3-901b-946c62047467 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:26:26.925147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:26:26.925147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:26:26.925147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:26:26.925147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:26:26.925147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:26:26.925147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:26:26.925147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:26:26.925147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:26:26.925147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:26:26.925147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:26:26.925147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:26:26.925147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:26:26.925147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:26:26.925147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:26:26.926151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:26:26.926151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:26:26.926151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:26:26.926151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:26:26.926151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:26:26.926151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:26:26.926151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:26:26.926151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:26:26.926151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:26:26.926151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:26:26.926151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:26:26.926151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:26:26.926151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:26:26.926151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:26:26.926151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:26:26.926151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:26:26.926151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:26:26.927161 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:26:26.927161 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:26:26.927161 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:26:26.927161 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:26:26.927161 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 9/18] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:26:26.932117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a9a7d-83ea-47f3-901b-946c62047467 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:26.944264 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af27177-9488-4eba-a269-6e7ee263be3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:26.945082 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af27177-9488-4eba-a269-6e7ee263be3d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:26.945375 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af27177-9488-4eba-a269-6e7ee263be3d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:26.945655 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af27177-9488-4eba-a269-6e7ee263be3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:26.946840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af27177-9488-4eba-a269-6e7ee263be3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:26.948296 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af27177-9488-4eba-a269-6e7ee263be3d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:26.949936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 10/19] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:26:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:26.956130 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af27177-9488-4eba-a269-6e7ee263be3d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:26.989917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:27.035114 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a9a7d-83ea-47f3-901b-946c62047467 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:27.036964 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:27.057487 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af27177-9488-4eba-a269-6e7ee263be3d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:27.076257 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d9bd7-81cd-449c-baa3-776972cb7347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:27.076952 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d9bd7-81cd-449c-baa3-776972cb7347 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:27.077235 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d9bd7-81cd-449c-baa3-776972cb7347 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:27.077509 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d9bd7-81cd-449c-baa3-776972cb7347 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:27.078228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d9bd7-81cd-449c-baa3-776972cb7347 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:27.078533 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d9bd7-81cd-449c-baa3-776972cb7347 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:27.079922 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d9bd7-81cd-449c-baa3-776972cb7347 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:27.091853 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b93e07-283b-4d2e-ade7-1e79592eee9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:27.092521 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b93e07-283b-4d2e-ade7-1e79592eee9f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:27.092814 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b93e07-283b-4d2e-ade7-1e79592eee9f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:27.093095 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b93e07-283b-4d2e-ade7-1e79592eee9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:27.093935 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b93e07-283b-4d2e-ade7-1e79592eee9f None admin] RBAC: Adding query filter params (role.id=ab64ea6d0475430195af26a049485569, scope.domain.id=default, user.id=224404a1bd69482b9e7c4f685daaf4a4) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:27.094251 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b93e07-283b-4d2e-ade7-1e79592eee9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:27.095681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b93e07-283b-4d2e-ade7-1e79592eee9f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:27.096972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 10/20] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:27.103168 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 11/21] 10.222.0.59 () {56 vars in 1322 bytes} [Thu Jun 30 10:26:26 2022] GET /identity/v3/role_assignments?user.id=224404a1bd69482b9e7c4f685daaf4a4&scope.domain.id=default&role.id=ab64ea6d0475430195af26a049485569 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:29.659587 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede17ab-e03d-4739-a2e9-ea31d4067c9b None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:29.660622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede17ab-e03d-4739-a2e9-ea31d4067c9b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:29.661125 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede17ab-e03d-4739-a2e9-ea31d4067c9b None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:29.662693 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 11/22] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:29.674170 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21c4cb-7c06-477b-8693-f2fd55fbcf23 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:29.674984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21c4cb-7c06-477b-8693-f2fd55fbcf23 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:29.675473 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21c4cb-7c06-477b-8693-f2fd55fbcf23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:29.696737 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7436e01-13bd-4631-a114-3a10c26707b2 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:29.697346 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7436e01-13bd-4631-a114-3a10c26707b2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:29.697816 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7436e01-13bd-4631-a114-3a10c26707b2 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:29.699359 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 12/23] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:26:29.704876 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bc94d-c86f-4d65-8a84-12d4752c1ae0 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:29.705366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bc94d-c86f-4d65-8a84-12d4752c1ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:29.705854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bc94d-c86f-4d65-8a84-12d4752c1ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:29.708384 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0d21c4cb-7c06-477b-8693-f2fd55fbcf23 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:29.710677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0d21c4cb-7c06-477b-8693-f2fd55fbcf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:29.737506 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-6a9bc94d-c86f-4d65-8a84-12d4752c1ae0 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:29.739011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6a9bc94d-c86f-4d65-8a84-12d4752c1ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:29.844868 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 12/24] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:26:29.866009 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 13/25] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:26:29.897004 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21c4cb-7c06-477b-8693-f2fd55fbcf23 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:29.898645 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bc94d-c86f-4d65-8a84-12d4752c1ae0 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:29.989462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:30.009928 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:30.040204 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21c4cb-7c06-477b-8693-f2fd55fbcf23 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:30.079967 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab9ee5-87e4-4cf6-b848-62f615071ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:30.082136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab9ee5-87e4-4cf6-b848-62f615071ea0 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:30.082808 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab9ee5-87e4-4cf6-b848-62f615071ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:30.083959 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab9ee5-87e4-4cf6-b848-62f615071ea0 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:30.085416 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab9ee5-87e4-4cf6-b848-62f615071ea0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:30.089610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab9ee5-87e4-4cf6-b848-62f615071ea0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:30.111857 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bc94d-c86f-4d65-8a84-12d4752c1ae0 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:30.149038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a151b7-4c93-44ad-9884-820a84693848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:30.150192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a151b7-4c93-44ad-9884-820a84693848 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:30.150706 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a151b7-4c93-44ad-9884-820a84693848 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:30.151193 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a151b7-4c93-44ad-9884-820a84693848 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:30.163694 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a151b7-4c93-44ad-9884-820a84693848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:26:30.173371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-45a151b7-4c93-44ad-9884-820a84693848 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:26:30.173371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:26:30.173371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:26:30.173371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:26:30.173371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:26:30.173371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:26:30.173371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:26:30.173371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:26:30.173371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:26:30.173371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:26:30.173371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:26:30.173371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:26:30.173371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:26:30.173371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:26:30.173371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:26:30.173371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:26:30.174218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:26:30.174218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:26:30.174218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:26:30.174218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:26:30.174218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:26:30.174218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:26:30.174218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:26:30.174218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:26:30.174218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:26:30.174218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:26:30.174218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:26:30.174218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:26:30.174218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:26:30.174218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:26:30.174218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:26:30.174218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:26:30.175022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:26:30.175022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:26:30.175022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:26:30.175022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:26:30.175022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:26:30.175022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:26:30.175022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:26:30.175022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:26:30.175022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:26:30.175022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:26:30.175022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:26:30.175022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:26:30.177474 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 14/26] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:26:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:26:30.179080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdefab8-6832-4490-a068-30fe6caba3c2 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:30.179587 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdefab8-6832-4490-a068-30fe6caba3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:30.180080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdefab8-6832-4490-a068-30fe6caba3c2 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:30.181640 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 15/27] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:30.182914 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf0d9b-41a5-4876-9499-c6e9b9a31792 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:30.183430 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf0d9b-41a5-4876-9499-c6e9b9a31792 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:30.183956 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf0d9b-41a5-4876-9499-c6e9b9a31792 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:30.185937 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 16/28] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:30.186877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf0d9b-41a5-4876-9499-c6e9b9a31792 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:30.236628 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 13/29] 10.222.0.59 () {60 vars in 1131 bytes} [Thu Jun 30 10:26:29 2022] POST /identity/v3/roles => generated 219 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:26:30.238361 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e0e84-6e2e-46f5-8aae-aa81e3cc0a18 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:30.238660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e0e84-6e2e-46f5-8aae-aa81e3cc0a18 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:30.238959 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e0e84-6e2e-46f5-8aae-aa81e3cc0a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:30.261798 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a96e0e84-6e2e-46f5-8aae-aa81e3cc0a18 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:30.263775 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a96e0e84-6e2e-46f5-8aae-aa81e3cc0a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:30.314040 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf0d9b-41a5-4876-9499-c6e9b9a31792 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:30.322637 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:30.339386 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 14/30] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:26:30.341863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86cab3-fb60-429a-95f5-eab5fa3b587f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:30.342393 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86cab3-fb60-429a-95f5-eab5fa3b587f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:30.342924 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86cab3-fb60-429a-95f5-eab5fa3b587f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:30.356684 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a56186-648d-4f89-b363-1eddb4b0bdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:30.357617 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a56186-648d-4f89-b363-1eddb4b0bdae None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:30.358076 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a56186-648d-4f89-b363-1eddb4b0bdae None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:30.358538 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a56186-648d-4f89-b363-1eddb4b0bdae None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:30.359482 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a56186-648d-4f89-b363-1eddb4b0bdae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:30.359969 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a56186-648d-4f89-b363-1eddb4b0bdae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:30.362295 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7f86cab3-fb60-429a-95f5-eab5fa3b587f None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:30.363885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7f86cab3-fb60-429a-95f5-eab5fa3b587f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:30.366567 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a56186-648d-4f89-b363-1eddb4b0bdae None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:30.391208 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 17/31] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:26:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:30.392073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a56186-648d-4f89-b363-1eddb4b0bdae None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:30.445933 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 15/32] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:26:30.447187 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86cab3-fb60-429a-95f5-eab5fa3b587f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:30.453091 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:30.572677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a56186-648d-4f89-b363-1eddb4b0bdae None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:30.600127 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86cab3-fb60-429a-95f5-eab5fa3b587f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:30.617815 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad592d5d-9e82-40fe-8259-f92edbc292aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:30.619008 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad592d5d-9e82-40fe-8259-f92edbc292aa None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:30.619739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad592d5d-9e82-40fe-8259-f92edbc292aa None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:30.620211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad592d5d-9e82-40fe-8259-f92edbc292aa None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:30.621178 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad592d5d-9e82-40fe-8259-f92edbc292aa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:30.623327 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad592d5d-9e82-40fe-8259-f92edbc292aa None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:30.647765 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52784112-803c-48d0-9a6f-e63cd4799095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:30.649949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52784112-803c-48d0-9a6f-e63cd4799095 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:30.650584 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52784112-803c-48d0-9a6f-e63cd4799095 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:30.651610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52784112-803c-48d0-9a6f-e63cd4799095 None admin] PATH_INFO: `/v3/users/224404a1bd69482b9e7c4f685daaf4a4` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:30.659469 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52784112-803c-48d0-9a6f-e63cd4799095 None admin] RBAC: Authorizing `identity:get_user(user_id=224404a1bd69482b9e7c4f685daaf4a4)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:30.661622 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52784112-803c-48d0-9a6f-e63cd4799095 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:30.663756 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 16/33] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:26:30 2022] GET /identity/v3/users/224404a1bd69482b9e7c4f685daaf4a4 => generated 247 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:30.664751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52784112-803c-48d0-9a6f-e63cd4799095 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:30.739134 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:30.780140 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52784112-803c-48d0-9a6f-e63cd4799095 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:30.788816 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 18/34] 10.222.0.59 () {60 vars in 1131 bytes} [Thu Jun 30 10:26:30 2022] POST /identity/v3/roles => generated 225 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:26:30.788816 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad592d5d-9e82-40fe-8259-f92edbc292aa None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:30.821775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:30.839227 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdb3aa-6434-4a6e-97d5-f0cd852ac5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:30.840866 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdb3aa-6434-4a6e-97d5-f0cd852ac5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:30.841189 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdb3aa-6434-4a6e-97d5-f0cd852ac5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:30.841476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdb3aa-6434-4a6e-97d5-f0cd852ac5b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:30.858394 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cdb3aa-6434-4a6e-97d5-f0cd852ac5b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:30.860216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cdb3aa-6434-4a6e-97d5-f0cd852ac5b2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:30.888535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-77cdb3aa-6434-4a6e-97d5-f0cd852ac5b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:26:30.888535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:26:30.888535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:26:30.888535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:26:30.888535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:26:30.888535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:26:30.888535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:26:30.888535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:26:30.888535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:26:30.888535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:26:30.888535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:26:30.888535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:26:30.888535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:26:30.888535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:26:30.888535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:26:30.889417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:26:30.889417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:26:30.889417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:26:30.889417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:26:30.889417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:26:30.889417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:26:30.889417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:26:30.889417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:26:30.889417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:26:30.889417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:26:30.889417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:26:30.889417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:26:30.889417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:26:30.889417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:26:30.889417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:26:30.889417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:26:30.889417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:26:30.890213 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:26:30.890213 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:26:30.890213 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:26:30.890213 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:26:30.890213 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 17/35] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:26:30.894683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bb0c3-8186-4948-a34c-e801827caa8d None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:30.894683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bb0c3-8186-4948-a34c-e801827caa8d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:30.894683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bb0c3-8186-4948-a34c-e801827caa8d None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:30.894683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 18/36] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:30.897459 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bb0c3-8186-4948-a34c-e801827caa8d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:30.924735 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad592d5d-9e82-40fe-8259-f92edbc292aa None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:30.976934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffe15a-263b-4f42-aba3-25df9ea58db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:30.977743 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffe15a-263b-4f42-aba3-25df9ea58db7 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:30.978028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffe15a-263b-4f42-aba3-25df9ea58db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:30.978475 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffe15a-263b-4f42-aba3-25df9ea58db7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:30.980595 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffe15a-263b-4f42-aba3-25df9ea58db7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:30.982685 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffe15a-263b-4f42-aba3-25df9ea58db7 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:30.985201 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 19/37] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:26:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:30.986481 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9780afd-524f-46fb-ba3f-35e5faa515bb None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:30.986771 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9780afd-524f-46fb-ba3f-35e5faa515bb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:30.987052 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9780afd-524f-46fb-ba3f-35e5faa515bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:31.010579 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f9780afd-524f-46fb-ba3f-35e5faa515bb None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:31.012102 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f9780afd-524f-46fb-ba3f-35e5faa515bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:31.024835 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bb0c3-8186-4948-a34c-e801827caa8d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:31.083975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 20/38] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:26:31.085576 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c7542-65d3-4c34-bf60-07279e2c09c5 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:31.085865 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c7542-65d3-4c34-bf60-07279e2c09c5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:31.086140 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c7542-65d3-4c34-bf60-07279e2c09c5 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:31.087484 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 21/39] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:31.088161 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c7542-65d3-4c34-bf60-07279e2c09c5 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:31.117929 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:31.146496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:31.166581 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0067ba-dabe-4a7c-8e6f-6a21719b7828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:31.167234 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0067ba-dabe-4a7c-8e6f-6a21719b7828 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:31.167520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0067ba-dabe-4a7c-8e6f-6a21719b7828 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:31.167796 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0067ba-dabe-4a7c-8e6f-6a21719b7828 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:31.168525 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0067ba-dabe-4a7c-8e6f-6a21719b7828 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:31.168849 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0067ba-dabe-4a7c-8e6f-6a21719b7828 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:31.170724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0067ba-dabe-4a7c-8e6f-6a21719b7828 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:31.187994 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 19/40] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:31.189397 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ea2e9-47f2-42ea-9ae8-f1087ed8713c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:31.189692 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ea2e9-47f2-42ea-9ae8-f1087ed8713c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:31.189978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ea2e9-47f2-42ea-9ae8-f1087ed8713c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:31.194377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c7542-65d3-4c34-bf60-07279e2c09c5 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:31.206051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9d7ea2e9-47f2-42ea-9ae8-f1087ed8713c None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:31.207242 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9d7ea2e9-47f2-42ea-9ae8-f1087ed8713c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:31.228393 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718ac45-eb37-45a4-bf74-df163758d463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:31.229295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718ac45-eb37-45a4-bf74-df163758d463 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:31.229579 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718ac45-eb37-45a4-bf74-df163758d463 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:31.229859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718ac45-eb37-45a4-bf74-df163758d463 None admin] PATH_INFO: `/v3/domains/default/users/224404a1bd69482b9e7c4f685daaf4a4/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:31.232598 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718ac45-eb37-45a4-bf74-df163758d463 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=224404a1bd69482b9e7c4f685daaf4a4, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:31.234051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718ac45-eb37-45a4-bf74-df163758d463 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:31.262720 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 22/41] 10.222.0.59 () {58 vars in 1361 bytes} [Thu Jun 30 10:26:31 2022] PUT /identity/v3/domains/default/users/224404a1bd69482b9e7c4f685daaf4a4/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:26:31.262720 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718ac45-eb37-45a4-bf74-df163758d463 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:31.290955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 20/42] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:26:31.292095 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ea2e9-47f2-42ea-9ae8-f1087ed8713c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:31.367291 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:31.389546 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718ac45-eb37-45a4-bf74-df163758d463 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:31.416170 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ea2e9-47f2-42ea-9ae8-f1087ed8713c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:31.418612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:31.430157 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b800f-d5eb-4e0f-9d0b-e6eb8e339114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:31.430835 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b800f-d5eb-4e0f-9d0b-e6eb8e339114 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:31.431123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b800f-d5eb-4e0f-9d0b-e6eb8e339114 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:31.431412 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b800f-d5eb-4e0f-9d0b-e6eb8e339114 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:31.432161 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b800f-d5eb-4e0f-9d0b-e6eb8e339114 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:31.433651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b800f-d5eb-4e0f-9d0b-e6eb8e339114 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:31.450220 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 23/43] 10.222.0.59 () {60 vars in 1131 bytes} [Thu Jun 30 10:26:31 2022] POST /identity/v3/roles => generated 223 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:26:31.451097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b800f-d5eb-4e0f-9d0b-e6eb8e339114 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:31.456325 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e19b57-d424-48f6-b498-4379e9d81a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:31.457208 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e19b57-d424-48f6-b498-4379e9d81a6d None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:31.457562 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e19b57-d424-48f6-b498-4379e9d81a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:31.457912 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e19b57-d424-48f6-b498-4379e9d81a6d None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:31.458738 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e19b57-d424-48f6-b498-4379e9d81a6d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:31.460419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e19b57-d424-48f6-b498-4379e9d81a6d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:31.502044 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 21/44] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 30 10:26:31 2022] POST /identity/v3/projects => generated 301 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:26:31.591910 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b800f-d5eb-4e0f-9d0b-e6eb8e339114 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:31.633116 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef840e8f-c6e5-43fa-99b0-a651ead8e041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:31.633928 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef840e8f-c6e5-43fa-99b0-a651ead8e041 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:31.634213 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef840e8f-c6e5-43fa-99b0-a651ead8e041 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:31.634493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef840e8f-c6e5-43fa-99b0-a651ead8e041 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:31.635728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef840e8f-c6e5-43fa-99b0-a651ead8e041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:31.637244 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef840e8f-c6e5-43fa-99b0-a651ead8e041 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:31.638959 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 24/45] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:26:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:31.645195 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e19b57-d424-48f6-b498-4379e9d81a6d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:31.756648 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e19b57-d424-48f6-b498-4379e9d81a6d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:31.791439 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9487b-9831-452d-a22a-eb9b1f7034f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:31.792099 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9487b-9831-452d-a22a-eb9b1f7034f1 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:31.792389 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9487b-9831-452d-a22a-eb9b1f7034f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:31.792707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9487b-9831-452d-a22a-eb9b1f7034f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:31.793428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9487b-9831-452d-a22a-eb9b1f7034f1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:31.794923 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9487b-9831-452d-a22a-eb9b1f7034f1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:31.818512 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 22/46] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 30 10:26:31 2022] POST /identity/v3/projects => generated 312 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:26:33.303278 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910770c-e976-4e88-932a-41cd5396cacb None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:33.303817 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910770c-e976-4e88-932a-41cd5396cacb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:33.303817 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910770c-e976-4e88-932a-41cd5396cacb None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:33.305233 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 25/47] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:33.310861 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbac9b3-477a-44e9-94fa-1b74f27a52ce None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:33.311288 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbac9b3-477a-44e9-94fa-1b74f27a52ce None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:33.311434 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbac9b3-477a-44e9-94fa-1b74f27a52ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:33.327857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-acbac9b3-477a-44e9-94fa-1b74f27a52ce None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:33.329071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-acbac9b3-477a-44e9-94fa-1b74f27a52ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:33.331100 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:33.397443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 23/48] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:26:33.420896 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910770c-e976-4e88-932a-41cd5396cacb None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:33.437405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:33.521094 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910770c-e976-4e88-932a-41cd5396cacb None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:33.553246 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23201863-1bb3-4f46-8a9b-c94a3731e609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:33.554028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23201863-1bb3-4f46-8a9b-c94a3731e609 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:33.554309 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23201863-1bb3-4f46-8a9b-c94a3731e609 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:33.554582 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23201863-1bb3-4f46-8a9b-c94a3731e609 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:33.565022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23201863-1bb3-4f46-8a9b-c94a3731e609 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:26:33.572441 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-23201863-1bb3-4f46-8a9b-c94a3731e609 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:26:33.572441 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:26:33.572441 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:26:33.572441 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:26:33.572441 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:26:33.572441 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:26:33.572441 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:26:33.572441 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:26:33.572441 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:26:33.572441 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:26:33.572441 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:26:33.572441 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:26:33.572441 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:26:33.572441 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:26:33.572441 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:26:33.572441 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:26:33.573391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:26:33.573391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:26:33.573391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:26:33.573391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:26:33.573391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:26:33.573391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:26:33.573391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:26:33.573391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:26:33.573391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:26:33.573391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:26:33.573391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:26:33.573391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:26:33.573391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:26:33.573391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:26:33.573391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:26:33.573391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:26:33.574350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:26:33.574350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:26:33.574350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:26:33.574350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:26:33.574350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:26:33.574350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:26:33.574350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:26:33.574350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:26:33.574350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:26:33.574350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:26:33.574350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:26:33.574350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:26:33.574350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 26/49] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:26:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:26:33.579464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbac9b3-477a-44e9-94fa-1b74f27a52ce None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:33.676953 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbac9b3-477a-44e9-94fa-1b74f27a52ce None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:33.710551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255325f4-a92c-4ef1-985e-50718779ee54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:33.711217 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255325f4-a92c-4ef1-985e-50718779ee54 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:33.711508 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255325f4-a92c-4ef1-985e-50718779ee54 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:33.711791 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255325f4-a92c-4ef1-985e-50718779ee54 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:33.712572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255325f4-a92c-4ef1-985e-50718779ee54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:33.712888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255325f4-a92c-4ef1-985e-50718779ee54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:33.714299 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255325f4-a92c-4ef1-985e-50718779ee54 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:33.719962 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:33.728313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 24/50] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:26:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:33.729667 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23201863-1bb3-4f46-8a9b-c94a3731e609 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:33.802335 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:33.821024 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6731b4-0a2f-4069-9555-5bb825d83c3c None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:33.821413 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6731b4-0a2f-4069-9555-5bb825d83c3c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:33.821703 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6731b4-0a2f-4069-9555-5bb825d83c3c None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:33.823086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 25/51] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:26:33.826761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23201863-1bb3-4f46-8a9b-c94a3731e609 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:33.828141 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3a1ce-00bb-4c0f-9252-af0818c00e00 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:33.828440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3a1ce-00bb-4c0f-9252-af0818c00e00 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:33.828756 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3a1ce-00bb-4c0f-9252-af0818c00e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:33.845515 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3eb3a1ce-00bb-4c0f-9252-af0818c00e00 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:33.846707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3eb3a1ce-00bb-4c0f-9252-af0818c00e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:33.861208 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5416d6-a8f5-4634-946f-8886d5b7b6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:33.862080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5416d6-a8f5-4634-946f-8886d5b7b6de None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:33.862363 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5416d6-a8f5-4634-946f-8886d5b7b6de None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:33.862641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5416d6-a8f5-4634-946f-8886d5b7b6de None admin] PATH_INFO: `/v3/users/224404a1bd69482b9e7c4f685daaf4a4` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:33.863811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5416d6-a8f5-4634-946f-8886d5b7b6de None admin] RBAC: Authorizing `identity:get_user(user_id=224404a1bd69482b9e7c4f685daaf4a4)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:33.865281 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5416d6-a8f5-4634-946f-8886d5b7b6de None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:33.866914 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 27/52] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:26:33 2022] GET /identity/v3/users/224404a1bd69482b9e7c4f685daaf4a4 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:33.872129 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5416d6-a8f5-4634-946f-8886d5b7b6de None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:33.912824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 26/53] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:26:33.936032 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3a1ce-00bb-4c0f-9252-af0818c00e00 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:33.967196 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5416d6-a8f5-4634-946f-8886d5b7b6de None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:34.004866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748df3ad-9c0e-49f0-83af-4b73b38d5b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:34.005735 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748df3ad-9c0e-49f0-83af-4b73b38d5b49 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:34.006018 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748df3ad-9c0e-49f0-83af-4b73b38d5b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:34.006293 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748df3ad-9c0e-49f0-83af-4b73b38d5b49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:34.007537 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748df3ad-9c0e-49f0-83af-4b73b38d5b49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:34.009022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748df3ad-9c0e-49f0-83af-4b73b38d5b49 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:34.010671 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 28/54] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:26:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:34.016900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748df3ad-9c0e-49f0-83af-4b73b38d5b49 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:34.028903 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:34.040831 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3a1ce-00bb-4c0f-9252-af0818c00e00 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:34.071347 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:34.077978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d9fb9-a846-4601-8573-508a9db32d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:34.078793 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d9fb9-a846-4601-8573-508a9db32d5f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:34.079087 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d9fb9-a846-4601-8573-508a9db32d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:34.079367 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d9fb9-a846-4601-8573-508a9db32d5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:34.080681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d9fb9-a846-4601-8573-508a9db32d5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:34.082199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d9fb9-a846-4601-8573-508a9db32d5f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:34.083903 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 27/55] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:26:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:34.089816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d9fb9-a846-4601-8573-508a9db32d5f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:34.194087 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d9fb9-a846-4601-8573-508a9db32d5f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:34.220921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748df3ad-9c0e-49f0-83af-4b73b38d5b49 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:34.226665 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cc8d8-0f2a-485a-a10d-32ac1ff308da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:34.227320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cc8d8-0f2a-485a-a10d-32ac1ff308da None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:34.227609 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cc8d8-0f2a-485a-a10d-32ac1ff308da None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:34.227895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cc8d8-0f2a-485a-a10d-32ac1ff308da None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:34.228635 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29cc8d8-0f2a-485a-a10d-32ac1ff308da None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:34.230109 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29cc8d8-0f2a-485a-a10d-32ac1ff308da None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:34.255596 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860f8ec-bb00-4ac7-87de-3e34548ce843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:34.255772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 28/56] 10.222.0.59 () {60 vars in 1140 bytes} [Thu Jun 30 10:26:34 2022] POST /identity/v3/projects => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:26:34.256116 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860f8ec-bb00-4ac7-87de-3e34548ce843 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:34.256389 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860f8ec-bb00-4ac7-87de-3e34548ce843 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:34.256699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860f8ec-bb00-4ac7-87de-3e34548ce843 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:34.257615 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860f8ec-bb00-4ac7-87de-3e34548ce843 None admin] RBAC: Adding query filter params (role.id=ab64ea6d0475430195af26a049485569, scope.domain.id=default, user.id=224404a1bd69482b9e7c4f685daaf4a4) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:34.257834 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860f8ec-bb00-4ac7-87de-3e34548ce843 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:34.259303 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860f8ec-bb00-4ac7-87de-3e34548ce843 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:34.269489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 29/57] 10.222.0.59 () {56 vars in 1322 bytes} [Thu Jun 30 10:26:34 2022] GET /identity/v3/role_assignments?user.id=224404a1bd69482b9e7c4f685daaf4a4&scope.domain.id=default&role.id=ab64ea6d0475430195af26a049485569 => generated 530 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:36.287949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35a7b7-a244-4341-9fb4-f8271db6345c None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:36.288369 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35a7b7-a244-4341-9fb4-f8271db6345c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:36.288533 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35a7b7-a244-4341-9fb4-f8271db6345c None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:36.289944 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 29/58] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:36.295639 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02882fe-1eb8-4bc1-b2c9-cf02ee2b8aed None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:36.296024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02882fe-1eb8-4bc1-b2c9-cf02ee2b8aed None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:36.296193 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02882fe-1eb8-4bc1-b2c9-cf02ee2b8aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:36.313046 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e02882fe-1eb8-4bc1-b2c9-cf02ee2b8aed None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:36.314224 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e02882fe-1eb8-4bc1-b2c9-cf02ee2b8aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:36.377441 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 30/59] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:26:36.401200 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35a7b7-a244-4341-9fb4-f8271db6345c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:36.451379 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:36.502140 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35a7b7-a244-4341-9fb4-f8271db6345c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:36.533822 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ffdaf-4429-4753-93a6-ec0be09f4a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:36.534534 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ffdaf-4429-4753-93a6-ec0be09f4a48 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:36.534817 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ffdaf-4429-4753-93a6-ec0be09f4a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:36.535091 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ffdaf-4429-4753-93a6-ec0be09f4a48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:36.536275 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ffdaf-4429-4753-93a6-ec0be09f4a48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:36.537763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ffdaf-4429-4753-93a6-ec0be09f4a48 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:36.539345 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 30/60] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:26:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:36.545207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02882fe-1eb8-4bc1-b2c9-cf02ee2b8aed None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:36.548220 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:36.640214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02882fe-1eb8-4bc1-b2c9-cf02ee2b8aed None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:36.673555 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff1130-afd2-4a0d-b1b6-385457b10ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:36.674212 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff1130-afd2-4a0d-b1b6-385457b10ae6 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:36.674500 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff1130-afd2-4a0d-b1b6-385457b10ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:36.674783 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff1130-afd2-4a0d-b1b6-385457b10ae6 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:36.675495 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff1130-afd2-4a0d-b1b6-385457b10ae6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:36.676972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff1130-afd2-4a0d-b1b6-385457b10ae6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:36.702021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 31/61] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 30 10:26:36 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:26:39.668349 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc605a-2b1e-4a20-a78b-3fd577a6a1d4 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:39.668891 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc605a-2b1e-4a20-a78b-3fd577a6a1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:39.669042 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc605a-2b1e-4a20-a78b-3fd577a6a1d4 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:39.670913 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 31/62] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:39.676182 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaec2f3-3c79-4c19-8062-dfcf4de89251 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:39.676601 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaec2f3-3c79-4c19-8062-dfcf4de89251 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:39.676762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaec2f3-3c79-4c19-8062-dfcf4de89251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:39.706491 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ddaec2f3-3c79-4c19-8062-dfcf4de89251 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:39.707887 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ddaec2f3-3c79-4c19-8062-dfcf4de89251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:39.783218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:39.796825 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 32/63] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:26:39.818368 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc605a-2b1e-4a20-a78b-3fd577a6a1d4 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:39.906444 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d5622-23ce-4cca-8023-1b10e0155d31 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:39.907079 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d5622-23ce-4cca-8023-1b10e0155d31 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:39.907601 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d5622-23ce-4cca-8023-1b10e0155d31 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:39.909244 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 33/64] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:26:39.914473 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa19a68-3c39-4769-9c97-9a14c964a7de None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:39.915057 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa19a68-3c39-4769-9c97-9a14c964a7de None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:39.915545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa19a68-3c39-4769-9c97-9a14c964a7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:39.925452 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc605a-2b1e-4a20-a78b-3fd577a6a1d4 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:39.952900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:39.962852 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4b87d-753d-4830-97bd-a98749ea47ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:39.963888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4b87d-753d-4830-97bd-a98749ea47ba None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:39.964238 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4b87d-753d-4830-97bd-a98749ea47ba None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:39.964613 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4b87d-753d-4830-97bd-a98749ea47ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:39.971442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-1fa19a68-3c39-4769-9c97-9a14c964a7de None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:39.973164 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1fa19a68-3c39-4769-9c97-9a14c964a7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:39.976483 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4b87d-753d-4830-97bd-a98749ea47ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:26:39.984402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-4fb4b87d-753d-4830-97bd-a98749ea47ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:26:39.984402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:26:39.984402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:26:39.984402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:26:39.984402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:26:39.984402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:26:39.984402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:26:39.984402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:26:39.984402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:26:39.984402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:26:39.984402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:26:39.984402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:26:39.984402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:26:39.984402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:26:39.984402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:26:39.984402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:26:39.985302 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:26:39.985302 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:26:39.985302 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:26:39.985302 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:26:39.985302 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:26:39.985302 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:26:39.985302 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:26:39.985302 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:26:39.985302 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:26:39.985302 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:26:39.985302 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:26:39.985302 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:26:39.985302 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:26:39.985302 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:26:39.985302 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:26:39.985302 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:26:39.986036 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:26:39.986036 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:26:39.986036 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:26:39.986036 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:26:39.986036 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:26:39.986036 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:26:39.986036 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:26:39.986036 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:26:39.986036 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:26:39.986036 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:26:39.986036 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:26:39.986036 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:26:39.988482 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 32/65] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:26:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:26:40.002677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4b87d-753d-4830-97bd-a98749ea47ba None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:40.117083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 34/66] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:26:40.165850 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4b87d-753d-4830-97bd-a98749ea47ba None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:40.176098 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa19a68-3c39-4769-9c97-9a14c964a7de None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:40.217066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2f0f6-bf10-4e16-ac3f-1269b524285c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:40.217746 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2f0f6-bf10-4e16-ac3f-1269b524285c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:40.218034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2f0f6-bf10-4e16-ac3f-1269b524285c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:40.218315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2f0f6-bf10-4e16-ac3f-1269b524285c None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:40.219075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2f0f6-bf10-4e16-ac3f-1269b524285c None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:40.219390 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2f0f6-bf10-4e16-ac3f-1269b524285c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:40.220831 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2f0f6-bf10-4e16-ac3f-1269b524285c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:40.230106 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 33/67] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:26:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:40.236173 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2f0f6-bf10-4e16-ac3f-1269b524285c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:40.316346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:40.332467 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa19a68-3c39-4769-9c97-9a14c964a7de None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:40.367250 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:40.370462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dea98d-83a7-490f-9c6f-810181b1dc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:40.371372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dea98d-83a7-490f-9c6f-810181b1dc50 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:40.371598 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dea98d-83a7-490f-9c6f-810181b1dc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:40.371806 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dea98d-83a7-490f-9c6f-810181b1dc50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:40.384144 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dea98d-83a7-490f-9c6f-810181b1dc50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:26:40.391840 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-35dea98d-83a7-490f-9c6f-810181b1dc50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:26:40.391840 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:26:40.391840 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:26:40.391840 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:26:40.391840 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:26:40.391840 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:26:40.391840 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:26:40.391840 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:26:40.391840 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:26:40.391840 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:26:40.391840 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:26:40.391840 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:26:40.391840 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:26:40.391840 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:26:40.391840 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:26:40.391840 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:26:40.392728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:26:40.392728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:26:40.392728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:26:40.392728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:26:40.392728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:26:40.392728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:26:40.392728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:26:40.392728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:26:40.392728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:26:40.392728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:26:40.392728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:26:40.392728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:26:40.392728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:26:40.392728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:26:40.392728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:26:40.392728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:26:40.393463 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:26:40.393463 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:26:40.393463 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:26:40.393463 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:26:40.393463 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:26:40.393463 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:26:40.393463 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:26:40.393463 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:26:40.393463 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:26:40.393463 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:26:40.393463 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:26:40.393463 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:26:40.393463 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 35/68] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:26:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:26:40.400063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6395072-f36a-4446-8196-474bda79341a None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:40.400063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6395072-f36a-4446-8196-474bda79341a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:40.400063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6395072-f36a-4446-8196-474bda79341a None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:40.400063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 36/69] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:40.401817 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6395072-f36a-4446-8196-474bda79341a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:40.404287 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2f0f6-bf10-4e16-ac3f-1269b524285c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:40.443277 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da7c3d-8d13-4adb-925b-86506e3b8c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:40.444074 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da7c3d-8d13-4adb-925b-86506e3b8c57 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:40.444363 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da7c3d-8d13-4adb-925b-86506e3b8c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:40.444677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da7c3d-8d13-4adb-925b-86506e3b8c57 None admin] PATH_INFO: `/v3/users/47353d62c11845f29684fe955de36601` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:40.459475 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da7c3d-8d13-4adb-925b-86506e3b8c57 None admin] RBAC: Authorizing `identity:get_user(user_id=47353d62c11845f29684fe955de36601)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:40.461026 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da7c3d-8d13-4adb-925b-86506e3b8c57 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:40.462784 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 34/70] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:26:40 2022] GET /identity/v3/users/47353d62c11845f29684fe955de36601 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:40.464178 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5c744-e904-491c-b53e-2a469beadd8f None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:40.464478 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5c744-e904-491c-b53e-2a469beadd8f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:40.464789 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5c744-e904-491c-b53e-2a469beadd8f None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:40.466581 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 35/71] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:40.467773 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4a651-7bcb-4493-b6ad-d519c70fee76 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:40.468140 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4a651-7bcb-4493-b6ad-d519c70fee76 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:40.468432 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4a651-7bcb-4493-b6ad-d519c70fee76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:40.489941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b3c4a651-7bcb-4493-b6ad-d519c70fee76 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:40.491171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b3c4a651-7bcb-4493-b6ad-d519c70fee76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:40.518428 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6395072-f36a-4446-8196-474bda79341a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:40.554427 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471be45-bf3b-4fdb-8ab5-396603e0afd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:40.555095 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471be45-bf3b-4fdb-8ab5-396603e0afd2 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:40.555375 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471be45-bf3b-4fdb-8ab5-396603e0afd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:40.555653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471be45-bf3b-4fdb-8ab5-396603e0afd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:40.556682 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471be45-bf3b-4fdb-8ab5-396603e0afd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:40.556789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471be45-bf3b-4fdb-8ab5-396603e0afd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:40.558115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471be45-bf3b-4fdb-8ab5-396603e0afd2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:40.564688 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 36/72] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:26:40.566021 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a4a3f-3122-48ab-8d3c-a540eece2358 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:40.566316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a4a3f-3122-48ab-8d3c-a540eece2358 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:40.566601 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a4a3f-3122-48ab-8d3c-a540eece2358 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:40.576698 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 37/73] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:26:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:40.576885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 37/74] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:40.576978 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471be45-bf3b-4fdb-8ab5-396603e0afd2 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:40.577058 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d56fb-c681-4767-a437-4bcc7c0f929b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:40.577058 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d56fb-c681-4767-a437-4bcc7c0f929b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:40.577058 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d56fb-c681-4767-a437-4bcc7c0f929b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:40.594333 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-fc6d56fb-c681-4767-a437-4bcc7c0f929b None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:40.595506 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fc6d56fb-c681-4767-a437-4bcc7c0f929b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:40.617356 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:40.619681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:40.663849 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 38/75] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:26:40.664907 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d56fb-c681-4767-a437-4bcc7c0f929b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:40.680992 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471be45-bf3b-4fdb-8ab5-396603e0afd2 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:40.716553 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec27fd-8060-40d2-bf59-38daa3ab6ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:40.717159 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec27fd-8060-40d2-bf59-38daa3ab6ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:40.717440 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec27fd-8060-40d2-bf59-38daa3ab6ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:40.717713 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec27fd-8060-40d2-bf59-38daa3ab6ee6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:40.765348 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d56fb-c681-4767-a437-4bcc7c0f929b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:40.785481 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec27fd-8060-40d2-bf59-38daa3ab6ee6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:40.786969 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec27fd-8060-40d2-bf59-38daa3ab6ee6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:40.799125 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8756ed-2cc5-45b2-9e61-8cb910ef101d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:40.799988 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8756ed-2cc5-45b2-9e61-8cb910ef101d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:40.800274 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8756ed-2cc5-45b2-9e61-8cb910ef101d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:40.800580 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8756ed-2cc5-45b2-9e61-8cb910ef101d None admin] PATH_INFO: `/v3/users/224404a1bd69482b9e7c4f685daaf4a4` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:40.801755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8756ed-2cc5-45b2-9e61-8cb910ef101d None admin] RBAC: Authorizing `identity:get_user(user_id=224404a1bd69482b9e7c4f685daaf4a4)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:40.803199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8756ed-2cc5-45b2-9e61-8cb910ef101d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:40.804954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 39/76] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:26:40 2022] GET /identity/v3/users/224404a1bd69482b9e7c4f685daaf4a4 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:40.806098 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ac185-da66-4669-b36b-fff5341f0a0b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:40.806380 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ac185-da66-4669-b36b-fff5341f0a0b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:40.806666 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ac185-da66-4669-b36b-fff5341f0a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:40.822325 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1e4ac185-da66-4669-b36b-fff5341f0a0b None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:40.823521 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1e4ac185-da66-4669-b36b-fff5341f0a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:40.828147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:40.845222 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:40.889068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 38/77] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:26:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:26:40.889919 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec27fd-8060-40d2-bf59-38daa3ab6ee6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:40.892896 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 40/78] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:26:40.893721 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ac185-da66-4669-b36b-fff5341f0a0b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:40.990188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec27fd-8060-40d2-bf59-38daa3ab6ee6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:40.991727 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ac185-da66-4669-b36b-fff5341f0a0b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:41.023324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd308297-7930-43bb-a7cf-0704441bb706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:41.024165 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd308297-7930-43bb-a7cf-0704441bb706 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:41.024489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd308297-7930-43bb-a7cf-0704441bb706 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:41.024799 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd308297-7930-43bb-a7cf-0704441bb706 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:41.025767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15148b-d5da-404c-a91b-125b5d5d7a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:41.026551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15148b-d5da-404c-a91b-125b5d5d7a1c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:41.026837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15148b-d5da-404c-a91b-125b5d5d7a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:41.027118 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15148b-d5da-404c-a91b-125b5d5d7a1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:41.028276 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15148b-d5da-404c-a91b-125b5d5d7a1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:41.029773 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15148b-d5da-404c-a91b-125b5d5d7a1c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:41.031387 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 41/79] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:26:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:41.032145 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15148b-d5da-404c-a91b-125b5d5d7a1c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:41.036760 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd308297-7930-43bb-a7cf-0704441bb706 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:26:41.046271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-bd308297-7930-43bb-a7cf-0704441bb706 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:26:41.046271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:26:41.046271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:26:41.046271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:26:41.046271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:26:41.046271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:26:41.046271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:26:41.046271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:26:41.046271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:26:41.046271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:26:41.046271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:26:41.046271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:26:41.046271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:26:41.046271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:26:41.046271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:26:41.046271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:26:41.047106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:26:41.047106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:26:41.047106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:26:41.047106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:26:41.047106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:26:41.047106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:26:41.047106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:26:41.047106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:26:41.047106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:26:41.047106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:26:41.047106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:26:41.047106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:26:41.047106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:26:41.047106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:26:41.047106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:26:41.047106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:26:41.047866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:26:41.047866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:26:41.047866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:26:41.047866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:26:41.047866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:26:41.047866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:26:41.047866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:26:41.047866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:26:41.047866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:26:41.047866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:26:41.047866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:26:41.047866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:26:41.047866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 39/80] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 30 10:26:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:26:41.048588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd308297-7930-43bb-a7cf-0704441bb706 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:41.051287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:41.060404 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:41.134126 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15148b-d5da-404c-a91b-125b5d5d7a1c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:41.148846 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd308297-7930-43bb-a7cf-0704441bb706 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:41.167707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e19d37-9ebf-4ae8-9c50-0a6e1abf36fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:41.168418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e19d37-9ebf-4ae8-9c50-0a6e1abf36fe None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:41.168737 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e19d37-9ebf-4ae8-9c50-0a6e1abf36fe None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:41.169072 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e19d37-9ebf-4ae8-9c50-0a6e1abf36fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:41.181934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fb9e8-f827-438a-8b7b-fdcfc4f63dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:41.182780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fb9e8-f827-438a-8b7b-fdcfc4f63dba None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:41.183066 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fb9e8-f827-438a-8b7b-fdcfc4f63dba None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:41.183345 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fb9e8-f827-438a-8b7b-fdcfc4f63dba None admin] PATH_INFO: `/v3/projects/0796b54c77a1493db97cdbe3488fc82b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:41.184536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fb9e8-f827-438a-8b7b-fdcfc4f63dba None admin] RBAC: Authorizing `identity:get_project(project_id=0796b54c77a1493db97cdbe3488fc82b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:41.186040 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fb9e8-f827-438a-8b7b-fdcfc4f63dba None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:41.187911 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 40/81] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:26:41 2022] GET /identity/v3/projects/0796b54c77a1493db97cdbe3488fc82b => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:41.188568 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fb9e8-f827-438a-8b7b-fdcfc4f63dba None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:41.237254 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e19d37-9ebf-4ae8-9c50-0a6e1abf36fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:41.238737 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e19d37-9ebf-4ae8-9c50-0a6e1abf36fe None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:41.257873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:41.263653 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:41.289612 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fb9e8-f827-438a-8b7b-fdcfc4f63dba None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:41.322844 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c59ba2-322b-43f2-ab85-1d301e96f218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:41.323632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c59ba2-322b-43f2-ab85-1d301e96f218 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:41.323915 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c59ba2-322b-43f2-ab85-1d301e96f218 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:41.324190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c59ba2-322b-43f2-ab85-1d301e96f218 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:41.333969 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c59ba2-322b-43f2-ab85-1d301e96f218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:26:41.342000 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-d5c59ba2-322b-43f2-ab85-1d301e96f218 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:26:41.342000 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:26:41.342000 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:26:41.342000 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:26:41.342000 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:26:41.342000 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:26:41.342000 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:26:41.342000 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:26:41.342000 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:26:41.342000 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:26:41.342000 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:26:41.342000 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:26:41.342000 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:26:41.342000 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:26:41.342000 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:26:41.342000 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:26:41.342853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:26:41.342853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:26:41.342853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:26:41.342853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:26:41.342853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:26:41.342853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:26:41.342853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:26:41.342853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:26:41.342853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:26:41.342853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:26:41.342853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:26:41.342853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:26:41.342853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:26:41.342853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:26:41.342853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:26:41.342853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:26:41.348971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:26:41.348971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:26:41.348971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:26:41.348971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:26:41.348971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:26:41.348971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:26:41.348971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:26:41.348971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:26:41.348971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:26:41.348971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:26:41.348971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:26:41.348971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:26:41.348971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 41/82] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:26:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:26:41.348971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c59ba2-322b-43f2-ab85-1d301e96f218 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:41.349661 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 42/83] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:26:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:26:41.349661 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e19d37-9ebf-4ae8-9c50-0a6e1abf36fe None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:41.444560 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c59ba2-322b-43f2-ab85-1d301e96f218 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:41.445856 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e19d37-9ebf-4ae8-9c50-0a6e1abf36fe None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:41.472450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:41.473257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:41.479120 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b791a-dc7b-4ed6-bed0-e62841673904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:41.479786 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b791a-dc7b-4ed6-bed0-e62841673904 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:41.480319 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b791a-dc7b-4ed6-bed0-e62841673904 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:41.480319 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b791a-dc7b-4ed6-bed0-e62841673904 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:41.481071 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b791a-dc7b-4ed6-bed0-e62841673904 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:41.482603 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b791a-dc7b-4ed6-bed0-e62841673904 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:41.484594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35de56d-677a-496d-b2ad-990d6e93254f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:41.485252 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35de56d-677a-496d-b2ad-990d6e93254f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:41.485537 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35de56d-677a-496d-b2ad-990d6e93254f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:41.485815 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35de56d-677a-496d-b2ad-990d6e93254f None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:41.486552 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35de56d-677a-496d-b2ad-990d6e93254f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:41.486860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35de56d-677a-496d-b2ad-990d6e93254f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:41.488286 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35de56d-677a-496d-b2ad-990d6e93254f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:41.496152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 43/84] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:26:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:41.496970 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35de56d-677a-496d-b2ad-990d6e93254f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:41.506255 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 42/85] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 30 10:26:41 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:26:41.507064 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b791a-dc7b-4ed6-bed0-e62841673904 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:41.617191 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35de56d-677a-496d-b2ad-990d6e93254f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:41.623034 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b791a-dc7b-4ed6-bed0-e62841673904 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:41.659717 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf13b7a-168e-4544-9778-e2d104d4e1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:41.659932 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf649707-688e-473e-99d9-03515138c77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:41.660437 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf13b7a-168e-4544-9778-e2d104d4e1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:41.660587 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf649707-688e-473e-99d9-03515138c77e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:41.660779 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf13b7a-168e-4544-9778-e2d104d4e1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:41.660873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf649707-688e-473e-99d9-03515138c77e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:41.661027 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf13b7a-168e-4544-9778-e2d104d4e1e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:41.661115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf649707-688e-473e-99d9-03515138c77e None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:41.661841 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf649707-688e-473e-99d9-03515138c77e None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:41.661948 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf13b7a-168e-4544-9778-e2d104d4e1e5 None admin] RBAC: Adding query filter params (role.id=c68f9f9f32ac40dba0d180dd3f5582bb, scope.project.id=0796b54c77a1493db97cdbe3488fc82b, user.id=47353d62c11845f29684fe955de36601) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:41.662149 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf649707-688e-473e-99d9-03515138c77e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:41.662244 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf13b7a-168e-4544-9778-e2d104d4e1e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:41.663534 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf649707-688e-473e-99d9-03515138c77e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:41.663634 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf13b7a-168e-4544-9778-e2d104d4e1e5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:41.670360 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 44/86] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:26:41 2022] GET /identity/v3/role_assignments?user.id=47353d62c11845f29684fe955de36601&scope.project.id=0796b54c77a1493db97cdbe3488fc82b&role.id=c68f9f9f32ac40dba0d180dd3f5582bb => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:41.671238 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf13b7a-168e-4544-9778-e2d104d4e1e5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:41.679677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 43/87] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:26:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:41.680779 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf649707-688e-473e-99d9-03515138c77e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:41.739898 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:41.748206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:41.813539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf13b7a-168e-4544-9778-e2d104d4e1e5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:41.825474 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf649707-688e-473e-99d9-03515138c77e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:41.863565 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079612bd-09b3-4cc8-983e-fb9bf878989a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:41.864692 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079612bd-09b3-4cc8-983e-fb9bf878989a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:41.865288 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079612bd-09b3-4cc8-983e-fb9bf878989a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:41.865579 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079612bd-09b3-4cc8-983e-fb9bf878989a None admin] PATH_INFO: `/v3/projects/0796b54c77a1493db97cdbe3488fc82b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:41.867294 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079612bd-09b3-4cc8-983e-fb9bf878989a None admin] RBAC: Authorizing `identity:get_project(project_id=0796b54c77a1493db97cdbe3488fc82b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:41.869246 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079612bd-09b3-4cc8-983e-fb9bf878989a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:41.869795 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70807ff6-9603-473e-b511-e61dd42b6881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:41.870669 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70807ff6-9603-473e-b511-e61dd42b6881 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:41.870950 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70807ff6-9603-473e-b511-e61dd42b6881 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:41.871349 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70807ff6-9603-473e-b511-e61dd42b6881 None admin] PATH_INFO: `/v3/users/47353d62c11845f29684fe955de36601` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:41.871460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 45/88] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:26:41 2022] GET /identity/v3/projects/0796b54c77a1493db97cdbe3488fc82b => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:41.872992 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079612bd-09b3-4cc8-983e-fb9bf878989a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:41.873498 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70807ff6-9603-473e-b511-e61dd42b6881 None admin] RBAC: Authorizing `identity:get_user(user_id=47353d62c11845f29684fe955de36601)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:41.875192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70807ff6-9603-473e-b511-e61dd42b6881 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:41.877389 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 44/89] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:26:41 2022] GET /identity/v3/users/47353d62c11845f29684fe955de36601 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:41.877738 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70807ff6-9603-473e-b511-e61dd42b6881 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:41.998539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079612bd-09b3-4cc8-983e-fb9bf878989a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:42.002769 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70807ff6-9603-473e-b511-e61dd42b6881 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:42.018091 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:42.020655 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:42.048058 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac1200-ad5f-4567-8992-8bcd4d9a2c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:42.048755 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac1200-ad5f-4567-8992-8bcd4d9a2c06 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:42.049041 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac1200-ad5f-4567-8992-8bcd4d9a2c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:42.049322 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac1200-ad5f-4567-8992-8bcd4d9a2c06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:42.050166 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac1200-ad5f-4567-8992-8bcd4d9a2c06 None admin] RBAC: Adding query filter params (role.id=ab64ea6d0475430195af26a049485569, scope.project.id=0796b54c77a1493db97cdbe3488fc82b, user.id=224404a1bd69482b9e7c4f685daaf4a4) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:42.050484 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac1200-ad5f-4567-8992-8bcd4d9a2c06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:42.051945 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac1200-ad5f-4567-8992-8bcd4d9a2c06 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:42.057687 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6eb02-7f02-4c31-b4e5-3e00d1e105b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:42.058568 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6eb02-7f02-4c31-b4e5-3e00d1e105b2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:42.058911 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6eb02-7f02-4c31-b4e5-3e00d1e105b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:42.059195 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6eb02-7f02-4c31-b4e5-3e00d1e105b2 None admin] PATH_INFO: `/v3/users/47353d62c11845f29684fe955de36601` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:42.060602 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6eb02-7f02-4c31-b4e5-3e00d1e105b2 None admin] RBAC: Authorizing `identity:get_user(user_id=47353d62c11845f29684fe955de36601)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:42.062065 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6eb02-7f02-4c31-b4e5-3e00d1e105b2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:42.064661 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 46/90] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:26:41 2022] GET /identity/v3/users/47353d62c11845f29684fe955de36601 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:42.065687 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6eb02-7f02-4c31-b4e5-3e00d1e105b2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:42.072881 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 45/91] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:26:41 2022] GET /identity/v3/role_assignments?user.id=224404a1bd69482b9e7c4f685daaf4a4&scope.project.id=0796b54c77a1493db97cdbe3488fc82b&role.id=ab64ea6d0475430195af26a049485569 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:42.074305 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac1200-ad5f-4567-8992-8bcd4d9a2c06 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:42.186389 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac1200-ad5f-4567-8992-8bcd4d9a2c06 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:42.223336 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffeac42-860f-4973-a2af-8f6e97b31a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:42.224092 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffeac42-860f-4973-a2af-8f6e97b31a72 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:42.224287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffeac42-860f-4973-a2af-8f6e97b31a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:42.224596 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffeac42-860f-4973-a2af-8f6e97b31a72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:42.246374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6eb02-7f02-4c31-b4e5-3e00d1e105b2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:42.280203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:42.302919 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffeac42-860f-4973-a2af-8f6e97b31a72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:42.304414 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffeac42-860f-4973-a2af-8f6e97b31a72 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:42.315055 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cdf22-362a-4460-a9dc-8370b341c9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:42.315725 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cdf22-362a-4460-a9dc-8370b341c9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:42.316014 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cdf22-362a-4460-a9dc-8370b341c9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:42.316399 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cdf22-362a-4460-a9dc-8370b341c9e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:42.409588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 46/92] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:26:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 10:26:42.415181 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffeac42-860f-4973-a2af-8f6e97b31a72 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:42.415733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:42.449610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cdf22-362a-4460-a9dc-8370b341c9e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:42.451523 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cdf22-362a-4460-a9dc-8370b341c9e7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:42.525180 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:42.559242 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffeac42-860f-4973-a2af-8f6e97b31a72 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:42.609819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 47/93] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:26:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:26:42.615377 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cdf22-362a-4460-a9dc-8370b341c9e7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:42.633955 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e935b7-9f25-43a8-9516-2aa4ff81f8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:42.634843 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e935b7-9f25-43a8-9516-2aa4ff81f8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:42.635128 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e935b7-9f25-43a8-9516-2aa4ff81f8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:42.635411 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e935b7-9f25-43a8-9516-2aa4ff81f8b9 None admin] PATH_INFO: `/v3/projects/7bf34d43937d4e2082bb791f9db6233b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:42.636656 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e935b7-9f25-43a8-9516-2aa4ff81f8b9 None admin] RBAC: Authorizing `identity:get_project(project_id=7bf34d43937d4e2082bb791f9db6233b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:42.638668 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e935b7-9f25-43a8-9516-2aa4ff81f8b9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:42.640386 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 47/94] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:26:42 2022] GET /identity/v3/projects/7bf34d43937d4e2082bb791f9db6233b => generated 312 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:42.649694 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e935b7-9f25-43a8-9516-2aa4ff81f8b9 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:42.811673 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e935b7-9f25-43a8-9516-2aa4ff81f8b9 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:42.838297 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cdf22-362a-4460-a9dc-8370b341c9e7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:42.840875 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:42.849908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac9be5-b737-44c3-9677-808516bf867e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:42.850583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac9be5-b737-44c3-9677-808516bf867e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:42.850871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac9be5-b737-44c3-9677-808516bf867e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:42.851153 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac9be5-b737-44c3-9677-808516bf867e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:42.851992 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac9be5-b737-44c3-9677-808516bf867e None admin] RBAC: Adding query filter params (role.id=c68f9f9f32ac40dba0d180dd3f5582bb, scope.project.id=7bf34d43937d4e2082bb791f9db6233b, user.id=47353d62c11845f29684fe955de36601) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:42.852311 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac9be5-b737-44c3-9677-808516bf867e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:42.853796 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac9be5-b737-44c3-9677-808516bf867e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:42.859625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 48/95] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:26:42 2022] GET /identity/v3/role_assignments?user.id=47353d62c11845f29684fe955de36601&scope.project.id=7bf34d43937d4e2082bb791f9db6233b&role.id=c68f9f9f32ac40dba0d180dd3f5582bb => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:42.904245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef87806-1cd4-4cad-811c-ace984045086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:42.905182 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef87806-1cd4-4cad-811c-ace984045086 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:42.905471 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef87806-1cd4-4cad-811c-ace984045086 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:42.905748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef87806-1cd4-4cad-811c-ace984045086 None admin] PATH_INFO: `/v3/projects/0796b54c77a1493db97cdbe3488fc82b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:42.907008 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef87806-1cd4-4cad-811c-ace984045086 None admin] RBAC: Authorizing `identity:get_project(project_id=0796b54c77a1493db97cdbe3488fc82b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:42.908531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef87806-1cd4-4cad-811c-ace984045086 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:42.910360 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 48/96] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:26:42 2022] GET /identity/v3/projects/0796b54c77a1493db97cdbe3488fc82b => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:42.916439 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac9be5-b737-44c3-9677-808516bf867e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:42.938791 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:43.056994 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac9be5-b737-44c3-9677-808516bf867e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:43.095757 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf6761-57db-48db-b483-976f72a394ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:43.096347 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf6761-57db-48db-b483-976f72a394ea None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:43.096670 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf6761-57db-48db-b483-976f72a394ea None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:43.096954 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf6761-57db-48db-b483-976f72a394ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:43.098054 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf6761-57db-48db-b483-976f72a394ea None admin] RBAC: Adding query filter params (role.id=2d85fe2aee9740f984e944e0d5c80ec5, scope.project.id=0796b54c77a1493db97cdbe3488fc82b, user.id=47353d62c11845f29684fe955de36601) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:43.098376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf6761-57db-48db-b483-976f72a394ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:43.099840 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf6761-57db-48db-b483-976f72a394ea None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:43.107311 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 49/97] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:26:42 2022] GET /identity/v3/role_assignments?user.id=47353d62c11845f29684fe955de36601&scope.project.id=0796b54c77a1493db97cdbe3488fc82b&role.id=2d85fe2aee9740f984e944e0d5c80ec5 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:44.267628 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bbe8e-fb49-479b-874c-ebbbe67ffde1 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:44.268103 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bbe8e-fb49-479b-874c-ebbbe67ffde1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:44.268180 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bbe8e-fb49-479b-874c-ebbbe67ffde1 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:44.269731 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 49/98] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:44.280236 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d1b4a-794d-471b-b27a-fb80527a7080 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:44.280685 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d1b4a-794d-471b-b27a-fb80527a7080 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:44.280887 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d1b4a-794d-471b-b27a-fb80527a7080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:44.309952 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-fd6d1b4a-794d-471b-b27a-fb80527a7080 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:44.311150 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-fd6d1b4a-794d-471b-b27a-fb80527a7080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:44.404634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 50/99] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:26:44.462214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bbe8e-fb49-479b-874c-ebbbe67ffde1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:44.582272 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bbe8e-fb49-479b-874c-ebbbe67ffde1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:44.624061 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f00c4-f113-4494-9bca-a80821f3638c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:44.624928 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f00c4-f113-4494-9bca-a80821f3638c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:44.625216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f00c4-f113-4494-9bca-a80821f3638c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:44.625508 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f00c4-f113-4494-9bca-a80821f3638c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:44.636245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f00c4-f113-4494-9bca-a80821f3638c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:26:44.644415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-778f00c4-f113-4494-9bca-a80821f3638c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:26:44.644415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:26:44.644415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:26:44.644415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:26:44.644415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:26:44.644415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:26:44.644415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:26:44.644415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:26:44.644415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:26:44.644415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:26:44.644415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:26:44.644415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:26:44.644415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:26:44.644415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:26:44.644415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:26:44.644415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:26:44.645278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:26:44.645278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:26:44.645278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:26:44.645278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:26:44.645278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:26:44.645278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:26:44.645278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:26:44.645278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:26:44.645278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:26:44.645278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:26:44.645278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:26:44.645278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:26:44.645278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:26:44.645278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:26:44.645278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:26:44.645278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:26:44.646083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:26:44.646083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:26:44.646083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:26:44.646083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:26:44.646083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:26:44.646083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:26:44.646083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:26:44.646083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:26:44.646083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:26:44.646083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:26:44.646083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:26:44.646083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:26:44.646083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 50/100] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:26:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:26:44.651569 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d1b4a-794d-471b-b27a-fb80527a7080 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:44.685024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:44.794136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d1b4a-794d-471b-b27a-fb80527a7080 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:44.832897 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e3ac0-f4de-4c64-bea6-5bd3784b070c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:44.833906 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e3ac0-f4de-4c64-bea6-5bd3784b070c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:44.834483 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e3ac0-f4de-4c64-bea6-5bd3784b070c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:44.834967 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e3ac0-f4de-4c64-bea6-5bd3784b070c None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:44.835907 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e3ac0-f4de-4c64-bea6-5bd3784b070c None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:44.836419 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e3ac0-f4de-4c64-bea6-5bd3784b070c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:44.838024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e3ac0-f4de-4c64-bea6-5bd3784b070c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:44.852473 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 51/101] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:26:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:44.857737 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f00c4-f113-4494-9bca-a80821f3638c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:44.881781 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:44.944172 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adace20-c240-43da-b041-63c1969c6da7 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:44.944818 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adace20-c240-43da-b041-63c1969c6da7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:44.945300 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adace20-c240-43da-b041-63c1969c6da7 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:44.946919 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 52/102] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:26:44.966460 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac1dc1-3d01-41fa-bac1-deea4e7484bd None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:44.967166 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac1dc1-3d01-41fa-bac1-deea4e7484bd None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:44.967667 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac1dc1-3d01-41fa-bac1-deea4e7484bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:44.973944 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f00c4-f113-4494-9bca-a80821f3638c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:45.006084 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-14ac1dc1-3d01-41fa-bac1-deea4e7484bd None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:45.007631 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-14ac1dc1-3d01-41fa-bac1-deea4e7484bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:45.016310 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188bd61-1daa-49bc-942f-8d414e50ed92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:45.017217 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188bd61-1daa-49bc-942f-8d414e50ed92 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:45.017506 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188bd61-1daa-49bc-942f-8d414e50ed92 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:45.017786 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188bd61-1daa-49bc-942f-8d414e50ed92 None admin] PATH_INFO: `/v3/users/47353d62c11845f29684fe955de36601` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:45.018989 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188bd61-1daa-49bc-942f-8d414e50ed92 None admin] RBAC: Authorizing `identity:get_user(user_id=47353d62c11845f29684fe955de36601)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:45.020481 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188bd61-1daa-49bc-942f-8d414e50ed92 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:45.024538 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 51/103] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:26:44 2022] GET /identity/v3/users/47353d62c11845f29684fe955de36601 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:45.028250 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188bd61-1daa-49bc-942f-8d414e50ed92 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:45.132885 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:45.135749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:45.141637 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 53/104] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:26:45.143440 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475dba90-6e09-49c3-8076-7d224f7401ce None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:45.143940 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475dba90-6e09-49c3-8076-7d224f7401ce None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:45.144446 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475dba90-6e09-49c3-8076-7d224f7401ce None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:45.146095 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 54/105] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:45.153324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89eb0e-a771-40ce-9555-2961b2419d05 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:45.154216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89eb0e-a771-40ce-9555-2961b2419d05 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:45.154701 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89eb0e-a771-40ce-9555-2961b2419d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:45.173202 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8a89eb0e-a771-40ce-9555-2961b2419d05 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:45.175105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8a89eb0e-a771-40ce-9555-2961b2419d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:45.216983 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188bd61-1daa-49bc-942f-8d414e50ed92 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:45.253139 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 55/106] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:26:45.254310 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89eb0e-a771-40ce-9555-2961b2419d05 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:45.317897 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72024e89-628d-4942-8e1a-a92fd87b863b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:45.318788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72024e89-628d-4942-8e1a-a92fd87b863b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:45.319074 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72024e89-628d-4942-8e1a-a92fd87b863b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:45.319356 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72024e89-628d-4942-8e1a-a92fd87b863b None admin] PATH_INFO: `/v3/projects/0796b54c77a1493db97cdbe3488fc82b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:45.320585 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72024e89-628d-4942-8e1a-a92fd87b863b None admin] RBAC: Authorizing `identity:get_project(project_id=0796b54c77a1493db97cdbe3488fc82b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:45.322056 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72024e89-628d-4942-8e1a-a92fd87b863b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:45.323772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 52/107] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:26:45 2022] GET /identity/v3/projects/0796b54c77a1493db97cdbe3488fc82b => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:45.329402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72024e89-628d-4942-8e1a-a92fd87b863b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:45.388862 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89eb0e-a771-40ce-9555-2961b2419d05 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:45.420909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:45.425439 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72799c2f-3db4-4eaf-bf10-a927bd98195f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:45.426632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72799c2f-3db4-4eaf-bf10-a927bd98195f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:45.427061 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72799c2f-3db4-4eaf-bf10-a927bd98195f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:45.427464 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72799c2f-3db4-4eaf-bf10-a927bd98195f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:45.440263 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72799c2f-3db4-4eaf-bf10-a927bd98195f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:26:45.448858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-72799c2f-3db4-4eaf-bf10-a927bd98195f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:26:45.448858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:26:45.448858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:26:45.448858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:26:45.448858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:26:45.448858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:26:45.448858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:26:45.448858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:26:45.448858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:26:45.448858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:26:45.448858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:26:45.448858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:26:45.448858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:26:45.448858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:26:45.448858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:26:45.448858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:26:45.449873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:26:45.449873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:26:45.449873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:26:45.449873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:26:45.449873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:26:45.449873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:26:45.449873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:26:45.449873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:26:45.449873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:26:45.449873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:26:45.449873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:26:45.449873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:26:45.449873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:26:45.449873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:26:45.449873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:26:45.449873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:26:45.450663 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:26:45.450663 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:26:45.450663 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:26:45.450663 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:26:45.450663 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:26:45.450663 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:26:45.450663 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:26:45.450663 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:26:45.450663 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:26:45.450663 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:26:45.450663 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:26:45.450663 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:26:45.452724 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 56/108] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:26:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:26:45.453524 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72799c2f-3db4-4eaf-bf10-a927bd98195f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:45.466335 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72024e89-628d-4942-8e1a-a92fd87b863b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:45.503426 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e3f19-d92f-4966-acc1-b30bf8616bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:45.504636 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e3f19-d92f-4966-acc1-b30bf8616bba None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:45.505115 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e3f19-d92f-4966-acc1-b30bf8616bba None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:45.505642 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e3f19-d92f-4966-acc1-b30bf8616bba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:45.517214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e3f19-d92f-4966-acc1-b30bf8616bba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:26:45.525097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-207e3f19-d92f-4966-acc1-b30bf8616bba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:26:45.525097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:26:45.525097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:26:45.525097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:26:45.525097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:26:45.525097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:26:45.525097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:26:45.525097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:26:45.525097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:26:45.525097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:26:45.525097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:26:45.525097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:26:45.525097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:26:45.525097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:26:45.525097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:26:45.525097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:26:45.525929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:26:45.525929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:26:45.525929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:26:45.525929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:26:45.525929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:26:45.525929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:26:45.525929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:26:45.525929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:26:45.525929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:26:45.525929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:26:45.525929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:26:45.525929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:26:45.525929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:26:45.525929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:26:45.525929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:26:45.525929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:26:45.526704 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:26:45.526704 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:26:45.526704 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:26:45.526704 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:26:45.526704 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:26:45.526704 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:26:45.526704 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:26:45.526704 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:26:45.526704 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:26:45.526704 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:26:45.526704 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:26:45.526704 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:26:45.529951 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 53/109] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:26:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:26:45.536145 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecd2d1-bf6f-475e-bb59-67fc7bb78bce None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:45.536692 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecd2d1-bf6f-475e-bb59-67fc7bb78bce None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:45.537168 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecd2d1-bf6f-475e-bb59-67fc7bb78bce None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:45.538688 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 54/110] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:45.539629 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecd2d1-bf6f-475e-bb59-67fc7bb78bce None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:45.553350 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:45.561892 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72799c2f-3db4-4eaf-bf10-a927bd98195f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:45.597767 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab913bd-7d6a-4377-babf-aabc0d841e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:45.599197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab913bd-7d6a-4377-babf-aabc0d841e9e None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:45.599490 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab913bd-7d6a-4377-babf-aabc0d841e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:45.599763 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab913bd-7d6a-4377-babf-aabc0d841e9e None admin] PATH_INFO: `/v3/projects/0796b54c77a1493db97cdbe3488fc82b/users/47353d62c11845f29684fe955de36601/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:45.602553 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab913bd-7d6a-4377-babf-aabc0d841e9e None admin] RBAC: Authorizing `identity:create_grant(project_id=0796b54c77a1493db97cdbe3488fc82b, user_id=47353d62c11845f29684fe955de36601, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:45.604791 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab913bd-7d6a-4377-babf-aabc0d841e9e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:45.619419 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 57/111] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 30 10:26:45 2022] PUT /identity/v3/projects/0796b54c77a1493db97cdbe3488fc82b/users/47353d62c11845f29684fe955de36601/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:26:45.628812 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab913bd-7d6a-4377-babf-aabc0d841e9e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:45.651061 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecd2d1-bf6f-475e-bb59-67fc7bb78bce None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:45.691732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1add6-5b3d-42f5-a01c-ae70c949123e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:45.692574 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1add6-5b3d-42f5-a01c-ae70c949123e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:45.692926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1add6-5b3d-42f5-a01c-ae70c949123e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:45.693468 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1add6-5b3d-42f5-a01c-ae70c949123e None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:45.694763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1add6-5b3d-42f5-a01c-ae70c949123e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:45.695146 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1add6-5b3d-42f5-a01c-ae70c949123e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:45.697207 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1add6-5b3d-42f5-a01c-ae70c949123e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:45.709526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:45.709710 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 55/112] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:26:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:45.713984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531e693-bc16-434c-8c05-d4e800e4de9a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:45.714273 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531e693-bc16-434c-8c05-d4e800e4de9a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:45.714613 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531e693-bc16-434c-8c05-d4e800e4de9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:45.739764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0531e693-bc16-434c-8c05-d4e800e4de9a None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:45.741017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0531e693-bc16-434c-8c05-d4e800e4de9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:45.770905 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab913bd-7d6a-4377-babf-aabc0d841e9e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:45.813446 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4115e-cc83-4dc2-8174-c112099e7eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:45.814128 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4115e-cc83-4dc2-8174-c112099e7eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:45.814412 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4115e-cc83-4dc2-8174-c112099e7eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:45.814686 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4115e-cc83-4dc2-8174-c112099e7eb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:45.815448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4115e-cc83-4dc2-8174-c112099e7eb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:45.815757 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4115e-cc83-4dc2-8174-c112099e7eb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:45.817179 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4115e-cc83-4dc2-8174-c112099e7eb5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:45.824671 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 56/113] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:26:45.826272 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03e129-20fa-4fc6-8724-401869f64430 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:45.826568 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03e129-20fa-4fc6-8724-401869f64430 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:45.826786 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 58/114] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:26:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:45.826884 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03e129-20fa-4fc6-8724-401869f64430 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:45.827678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4115e-cc83-4dc2-8174-c112099e7eb5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:45.828369 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 57/115] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:45.833027 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03e129-20fa-4fc6-8724-401869f64430 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:45.836162 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:45.936240 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4115e-cc83-4dc2-8174-c112099e7eb5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:45.946805 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:45.948699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03e129-20fa-4fc6-8724-401869f64430 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:45.971805 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b678b-131b-4ed6-b96b-71f4701014c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:45.973099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b678b-131b-4ed6-b96b-71f4701014c4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:45.973381 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b678b-131b-4ed6-b96b-71f4701014c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:45.973659 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b678b-131b-4ed6-b96b-71f4701014c4 None admin] PATH_INFO: `/v3/users/024c27237ea947b3ae990b600a8568fd` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:45.989133 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1aacf-fe06-4b9b-bc40-66114c974689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:45.990001 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1aacf-fe06-4b9b-bc40-66114c974689 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:45.990285 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1aacf-fe06-4b9b-bc40-66114c974689 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:45.990559 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1aacf-fe06-4b9b-bc40-66114c974689 None admin] PATH_INFO: `/v3/users/224404a1bd69482b9e7c4f685daaf4a4` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:45.991751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1aacf-fe06-4b9b-bc40-66114c974689 None admin] RBAC: Authorizing `identity:get_user(user_id=224404a1bd69482b9e7c4f685daaf4a4)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:45.996532 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1aacf-fe06-4b9b-bc40-66114c974689 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:45.996653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b678b-131b-4ed6-b96b-71f4701014c4 None admin] RBAC: Authorizing `identity:get_user(user_id=024c27237ea947b3ae990b600a8568fd)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:45.996732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 58/116] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:26:45 2022] GET /identity/v3/users/224404a1bd69482b9e7c4f685daaf4a4 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:45.996797 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b678b-131b-4ed6-b96b-71f4701014c4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:45.996861 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6b239-da4f-4611-9a81-af64c89c7100 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:45.996861 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6b239-da4f-4611-9a81-af64c89c7100 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:45.998719 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 59/117] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:26:45 2022] GET /identity/v3/users/024c27237ea947b3ae990b600a8568fd => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:45.999715 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b678b-131b-4ed6-b96b-71f4701014c4 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:46.001954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6b239-da4f-4611-9a81-af64c89c7100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:46.020021 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f5f6b239-da4f-4611-9a81-af64c89c7100 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:46.021329 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f5f6b239-da4f-4611-9a81-af64c89c7100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:46.089881 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:46.096691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 59/118] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:26:46.097689 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6b239-da4f-4611-9a81-af64c89c7100 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:46.118543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b678b-131b-4ed6-b96b-71f4701014c4 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:46.166060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8775011-16c8-4f11-8c2a-b318fa23eae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:46.167111 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8775011-16c8-4f11-8c2a-b318fa23eae4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:46.167394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8775011-16c8-4f11-8c2a-b318fa23eae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:46.167766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8775011-16c8-4f11-8c2a-b318fa23eae4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:46.169650 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8775011-16c8-4f11-8c2a-b318fa23eae4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:46.171452 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8775011-16c8-4f11-8c2a-b318fa23eae4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:46.173872 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 60/119] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:26:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:46.174753 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8775011-16c8-4f11-8c2a-b318fa23eae4 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:46.210039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:46.210661 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6b239-da4f-4611-9a81-af64c89c7100 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:46.245752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2461e-b251-4e9f-8659-22ef04d48bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:46.246695 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2461e-b251-4e9f-8659-22ef04d48bfd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:46.247010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2461e-b251-4e9f-8659-22ef04d48bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:46.247817 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2461e-b251-4e9f-8659-22ef04d48bfd None admin] PATH_INFO: `/v3/projects/0796b54c77a1493db97cdbe3488fc82b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:46.249586 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2461e-b251-4e9f-8659-22ef04d48bfd None admin] RBAC: Authorizing `identity:get_project(project_id=0796b54c77a1493db97cdbe3488fc82b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:46.250490 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2461e-b251-4e9f-8659-22ef04d48bfd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:46.256788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 60/120] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:26:46 2022] GET /identity/v3/projects/0796b54c77a1493db97cdbe3488fc82b => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:46.256788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2461e-b251-4e9f-8659-22ef04d48bfd None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:46.286656 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8775011-16c8-4f11-8c2a-b318fa23eae4 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:46.322051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db62c54-032b-4feb-9102-80b3cce1ac07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:46.322865 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db62c54-032b-4feb-9102-80b3cce1ac07 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:46.323154 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db62c54-032b-4feb-9102-80b3cce1ac07 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:46.323435 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db62c54-032b-4feb-9102-80b3cce1ac07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:46.328391 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:46.365152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2461e-b251-4e9f-8659-22ef04d48bfd None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:46.399295 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4c490-bdf0-4d78-9b7a-fc541660f1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:46.400103 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4c490-bdf0-4d78-9b7a-fc541660f1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:46.400388 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4c490-bdf0-4d78-9b7a-fc541660f1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:46.400696 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4c490-bdf0-4d78-9b7a-fc541660f1a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:46.403908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db62c54-032b-4feb-9102-80b3cce1ac07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:46.406239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db62c54-032b-4feb-9102-80b3cce1ac07 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:46.411451 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4c490-bdf0-4d78-9b7a-fc541660f1a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:26:46.419945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-46c4c490-bdf0-4d78-9b7a-fc541660f1a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:26:46.419945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:26:46.419945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:26:46.419945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:26:46.419945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:26:46.419945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:26:46.419945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:26:46.419945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:26:46.419945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:26:46.419945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:26:46.419945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:26:46.419945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:26:46.419945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:26:46.419945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:26:46.419945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:26:46.419945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:26:46.421023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:26:46.421023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:26:46.421023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:26:46.421023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:26:46.421023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:26:46.421023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:26:46.421023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:26:46.421023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:26:46.421023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:26:46.421023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:26:46.421023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:26:46.421023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:26:46.421023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:26:46.421023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:26:46.421023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:26:46.421023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:26:46.421773 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:26:46.421773 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:26:46.421773 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:26:46.421773 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:26:46.421773 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:26:46.421773 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:26:46.421773 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:26:46.421773 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:26:46.421773 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:26:46.421773 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:26:46.421773 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:26:46.421773 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:26:46.421773 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 61/121] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 30 10:26:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:26:46.426110 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4c490-bdf0-4d78-9b7a-fc541660f1a5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:46.447599 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:46.514659 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 61/122] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:26:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:26:46.516217 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b50127-d062-4553-86ff-3b6f3433967f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:46.516528 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b50127-d062-4553-86ff-3b6f3433967f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:46.516812 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b50127-d062-4553-86ff-3b6f3433967f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:46.518214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 62/123] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:46.518771 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b50127-d062-4553-86ff-3b6f3433967f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:46.542654 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4c490-bdf0-4d78-9b7a-fc541660f1a5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:46.571365 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:46.579882 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b99afc-b0b6-4b69-8678-a5e12e3fd585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:46.580618 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b99afc-b0b6-4b69-8678-a5e12e3fd585 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:46.581035 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b99afc-b0b6-4b69-8678-a5e12e3fd585 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:46.581289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b99afc-b0b6-4b69-8678-a5e12e3fd585 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:46.582108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b99afc-b0b6-4b69-8678-a5e12e3fd585 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:46.583562 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b99afc-b0b6-4b69-8678-a5e12e3fd585 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:46.619844 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 62/124] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 30 10:26:46 2022] POST /identity/v3/projects => generated 302 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:26:46.619844 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b99afc-b0b6-4b69-8678-a5e12e3fd585 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:46.642677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b50127-d062-4553-86ff-3b6f3433967f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:46.684642 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244df74-2e7b-4480-acdd-a9acaf97b7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:46.685662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244df74-2e7b-4480-acdd-a9acaf97b7b6 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:46.686012 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244df74-2e7b-4480-acdd-a9acaf97b7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:46.686362 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244df74-2e7b-4480-acdd-a9acaf97b7b6 None admin] PATH_INFO: `/v3/projects/0796b54c77a1493db97cdbe3488fc82b/users/224404a1bd69482b9e7c4f685daaf4a4/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:46.688818 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244df74-2e7b-4480-acdd-a9acaf97b7b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0796b54c77a1493db97cdbe3488fc82b, user_id=224404a1bd69482b9e7c4f685daaf4a4, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:46.690445 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244df74-2e7b-4480-acdd-a9acaf97b7b6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:46.694379 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:46.707528 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 63/125] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 30 10:26:46 2022] PUT /identity/v3/projects/0796b54c77a1493db97cdbe3488fc82b/users/224404a1bd69482b9e7c4f685daaf4a4/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:26:46.713963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244df74-2e7b-4480-acdd-a9acaf97b7b6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:46.732600 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b99afc-b0b6-4b69-8678-a5e12e3fd585 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:46.772443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7aec8-e6ee-45d7-aa62-edc2a3dc92a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:46.773140 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7aec8-e6ee-45d7-aa62-edc2a3dc92a2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:46.773427 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7aec8-e6ee-45d7-aa62-edc2a3dc92a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:46.773708 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7aec8-e6ee-45d7-aa62-edc2a3dc92a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:46.774607 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a7aec8-e6ee-45d7-aa62-edc2a3dc92a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:46.774923 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a7aec8-e6ee-45d7-aa62-edc2a3dc92a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:46.776412 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a7aec8-e6ee-45d7-aa62-edc2a3dc92a2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:46.787142 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 63/126] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:26:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:46.788486 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3f254-8734-462b-9d19-ef216e269240 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:46.788911 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3f254-8734-462b-9d19-ef216e269240 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:46.789197 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3f254-8734-462b-9d19-ef216e269240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:46.808259 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-2ea3f254-8734-462b-9d19-ef216e269240 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:46.809529 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2ea3f254-8734-462b-9d19-ef216e269240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:46.851958 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:46.886414 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244df74-2e7b-4480-acdd-a9acaf97b7b6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:46.889636 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 64/127] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:26:46.891453 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3f254-8734-462b-9d19-ef216e269240 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:46.927887 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4637243-4631-4b87-a4df-99d88b41c8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:46.929359 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4637243-4631-4b87-a4df-99d88b41c8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:46.929860 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4637243-4631-4b87-a4df-99d88b41c8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:46.930339 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4637243-4631-4b87-a4df-99d88b41c8f5 None admin] PATH_INFO: `/v3/projects/0796b54c77a1493db97cdbe3488fc82b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:46.931968 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4637243-4631-4b87-a4df-99d88b41c8f5 None admin] RBAC: Authorizing `identity:get_project(project_id=0796b54c77a1493db97cdbe3488fc82b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:46.933789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4637243-4631-4b87-a4df-99d88b41c8f5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:46.936063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 64/128] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:26:46 2022] GET /identity/v3/projects/0796b54c77a1493db97cdbe3488fc82b => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:46.937222 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4637243-4631-4b87-a4df-99d88b41c8f5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:47.026727 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3f254-8734-462b-9d19-ef216e269240 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:47.032631 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:47.101230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba586dd4-e24b-4148-aca7-7861701c8eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:47.102006 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4637243-4631-4b87-a4df-99d88b41c8f5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:47.102117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba586dd4-e24b-4148-aca7-7861701c8eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:47.102406 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba586dd4-e24b-4148-aca7-7861701c8eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:47.102689 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba586dd4-e24b-4148-aca7-7861701c8eb2 None admin] PATH_INFO: `/v3/users/47353d62c11845f29684fe955de36601` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:47.103957 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba586dd4-e24b-4148-aca7-7861701c8eb2 None admin] RBAC: Authorizing `identity:get_user(user_id=47353d62c11845f29684fe955de36601)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:47.105473 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba586dd4-e24b-4148-aca7-7861701c8eb2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:47.107174 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 65/129] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:26:46 2022] GET /identity/v3/users/47353d62c11845f29684fe955de36601 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:47.107939 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba586dd4-e24b-4148-aca7-7861701c8eb2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:47.140595 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d4c34-78c5-4253-aa47-0d43e23a9ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:47.141690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d4c34-78c5-4253-aa47-0d43e23a9ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:47.142217 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d4c34-78c5-4253-aa47-0d43e23a9ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:47.142673 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d4c34-78c5-4253-aa47-0d43e23a9ec4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:47.158136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d4c34-78c5-4253-aa47-0d43e23a9ec4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:26:47.167132 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-5c1d4c34-78c5-4253-aa47-0d43e23a9ec4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:26:47.167132 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:26:47.167132 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:26:47.167132 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:26:47.167132 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:26:47.167132 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:26:47.167132 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:26:47.167132 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:26:47.167132 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:26:47.167132 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:26:47.167132 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:26:47.167132 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:26:47.167132 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:26:47.167132 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:26:47.167132 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:26:47.167132 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:26:47.168001 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:26:47.168001 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:26:47.168001 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:26:47.168001 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:26:47.168001 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:26:47.168001 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:26:47.168001 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:26:47.168001 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:26:47.168001 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:26:47.168001 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:26:47.168001 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:26:47.168001 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:26:47.168001 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:26:47.168001 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:26:47.168001 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:26:47.168001 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:26:47.168899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:26:47.168899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:26:47.168899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:26:47.168899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:26:47.168899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:26:47.168899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:26:47.168899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:26:47.168899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:26:47.168899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:26:47.168899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:26:47.168899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:26:47.168899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:26:47.171693 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 65/130] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:26:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:26:47.173688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d4c34-78c5-4253-aa47-0d43e23a9ec4 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:47.214338 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:47.282719 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba586dd4-e24b-4148-aca7-7861701c8eb2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:47.329321 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252eb75-befb-4302-9c5c-d31061677a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:47.329994 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252eb75-befb-4302-9c5c-d31061677a0a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:47.330273 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252eb75-befb-4302-9c5c-d31061677a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:47.330551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252eb75-befb-4302-9c5c-d31061677a0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:47.331568 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252eb75-befb-4302-9c5c-d31061677a0a None admin] RBAC: Adding query filter params (role.id=b3bea9d8f5294a5b8aaecb6c9bfeee6a, scope.project.id=0796b54c77a1493db97cdbe3488fc82b, user.id=024c27237ea947b3ae990b600a8568fd) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:47.331883 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252eb75-befb-4302-9c5c-d31061677a0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:47.333360 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252eb75-befb-4302-9c5c-d31061677a0a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:47.349779 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 66/131] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:26:47 2022] GET /identity/v3/role_assignments?user.id=024c27237ea947b3ae990b600a8568fd&scope.project.id=0796b54c77a1493db97cdbe3488fc82b&role.id=b3bea9d8f5294a5b8aaecb6c9bfeee6a => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:47.356535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252eb75-befb-4302-9c5c-d31061677a0a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:47.384786 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d4c34-78c5-4253-aa47-0d43e23a9ec4 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:47.432945 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:47.454618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a88e3-c487-4e2e-9bcf-ad234cd19054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:47.455506 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a88e3-c487-4e2e-9bcf-ad234cd19054 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:47.455795 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a88e3-c487-4e2e-9bcf-ad234cd19054 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:47.460990 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a88e3-c487-4e2e-9bcf-ad234cd19054 None admin] PATH_INFO: `/v3/projects/0796b54c77a1493db97cdbe3488fc82b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:47.462490 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a88e3-c487-4e2e-9bcf-ad234cd19054 None admin] RBAC: Authorizing `identity:get_project(project_id=0796b54c77a1493db97cdbe3488fc82b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:47.463993 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a88e3-c487-4e2e-9bcf-ad234cd19054 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:47.466279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 66/132] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:26:47 2022] GET /identity/v3/projects/0796b54c77a1493db97cdbe3488fc82b => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:47.485588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a88e3-c487-4e2e-9bcf-ad234cd19054 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:47.563469 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252eb75-befb-4302-9c5c-d31061677a0a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:47.565978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:47.612045 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84461ffd-82c3-4728-bf44-ec961b286053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:47.612755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84461ffd-82c3-4728-bf44-ec961b286053 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:47.613047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84461ffd-82c3-4728-bf44-ec961b286053 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:47.613329 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84461ffd-82c3-4728-bf44-ec961b286053 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:47.614095 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84461ffd-82c3-4728-bf44-ec961b286053 None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:47.614412 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84461ffd-82c3-4728-bf44-ec961b286053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:47.617843 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84461ffd-82c3-4728-bf44-ec961b286053 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:47.637646 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 67/133] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:26:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:47.643252 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84461ffd-82c3-4728-bf44-ec961b286053 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:47.738268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a88e3-c487-4e2e-9bcf-ad234cd19054 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:47.814352 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d921f-91c3-442d-aecd-3e9fa1318a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:47.815187 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d921f-91c3-442d-aecd-3e9fa1318a38 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:47.815479 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d921f-91c3-442d-aecd-3e9fa1318a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:47.815763 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d921f-91c3-442d-aecd-3e9fa1318a38 None admin] PATH_INFO: `/v3/projects/0796b54c77a1493db97cdbe3488fc82b/users/47353d62c11845f29684fe955de36601/roles/2d85fe2aee9740f984e944e0d5c80ec5` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:47.820883 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d921f-91c3-442d-aecd-3e9fa1318a38 None admin] RBAC: Authorizing `identity:create_grant(project_id=0796b54c77a1493db97cdbe3488fc82b, user_id=47353d62c11845f29684fe955de36601, role_id=2d85fe2aee9740f984e944e0d5c80ec5)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:47.822352 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d921f-91c3-442d-aecd-3e9fa1318a38 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:47.843523 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 67/134] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 30 10:26:47 2022] PUT /identity/v3/projects/0796b54c77a1493db97cdbe3488fc82b/users/47353d62c11845f29684fe955de36601/roles/2d85fe2aee9740f984e944e0d5c80ec5 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:26:47.867201 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84461ffd-82c3-4728-bf44-ec961b286053 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:47.911625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb3f17-717a-4d67-a30d-91370a120138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:47.912625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb3f17-717a-4d67-a30d-91370a120138 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:47.912920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb3f17-717a-4d67-a30d-91370a120138 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:47.913205 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb3f17-717a-4d67-a30d-91370a120138 None admin] PATH_INFO: `/v3/users/47353d62c11845f29684fe955de36601` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:47.916767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb3f17-717a-4d67-a30d-91370a120138 None admin] RBAC: Authorizing `identity:get_user(user_id=47353d62c11845f29684fe955de36601)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:47.918270 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb3f17-717a-4d67-a30d-91370a120138 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:47.920991 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 68/135] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:26:47 2022] GET /identity/v3/users/47353d62c11845f29684fe955de36601 => generated 275 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:47.926711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d921f-91c3-442d-aecd-3e9fa1318a38 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:47.998999 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:48.051483 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d921f-91c3-442d-aecd-3e9fa1318a38 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:48.086683 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b0c28-a067-4bb2-9ed6-3d4497e99ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:48.087489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b0c28-a067-4bb2-9ed6-3d4497e99ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:48.087774 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b0c28-a067-4bb2-9ed6-3d4497e99ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:48.088056 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b0c28-a067-4bb2-9ed6-3d4497e99ee4 None admin] PATH_INFO: `/v3/projects/7bf34d43937d4e2082bb791f9db6233b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:48.089326 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b0c28-a067-4bb2-9ed6-3d4497e99ee4 None admin] RBAC: Authorizing `identity:get_project(project_id=7bf34d43937d4e2082bb791f9db6233b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:48.091335 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b0c28-a067-4bb2-9ed6-3d4497e99ee4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:48.093404 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 68/136] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:26:47 2022] GET /identity/v3/projects/7bf34d43937d4e2082bb791f9db6233b => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:48.099202 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb3f17-717a-4d67-a30d-91370a120138 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:48.145654 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afd0ce-763f-443f-ba8d-49e5e766160e None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:48.145973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afd0ce-763f-443f-ba8d-49e5e766160e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:48.146232 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afd0ce-763f-443f-ba8d-49e5e766160e None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:48.147875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 69/137] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:48.152595 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5fb86-44e2-4f30-9e80-608d979a0961 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:48.152891 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5fb86-44e2-4f30-9e80-608d979a0961 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:48.153176 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5fb86-44e2-4f30-9e80-608d979a0961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:48.155112 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:48.176948 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-eec5fb86-44e2-4f30-9e80-608d979a0961 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:48.178153 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-eec5fb86-44e2-4f30-9e80-608d979a0961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:48.231229 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb3f17-717a-4d67-a30d-91370a120138 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:48.270128 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 70/138] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:26:48.283851 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a17da-4063-4fb3-9f4d-49c8c2efd16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:48.284839 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a17da-4063-4fb3-9f4d-49c8c2efd16e None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:48.285128 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a17da-4063-4fb3-9f4d-49c8c2efd16e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:48.285411 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a17da-4063-4fb3-9f4d-49c8c2efd16e None admin] PATH_INFO: `/v3/projects/7bf34d43937d4e2082bb791f9db6233b/users/47353d62c11845f29684fe955de36601/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:48.287468 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a17da-4063-4fb3-9f4d-49c8c2efd16e None admin] RBAC: Authorizing `identity:create_grant(project_id=7bf34d43937d4e2082bb791f9db6233b, user_id=47353d62c11845f29684fe955de36601, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:48.289105 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a17da-4063-4fb3-9f4d-49c8c2efd16e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:48.303032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5fb86-44e2-4f30-9e80-608d979a0961 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:48.327194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 69/139] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 30 10:26:48 2022] PUT /identity/v3/projects/7bf34d43937d4e2082bb791f9db6233b/users/47353d62c11845f29684fe955de36601/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:26:48.377021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:48.426261 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5fb86-44e2-4f30-9e80-608d979a0961 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:48.463582 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5eceb3-3a43-4aff-83d6-dc9997e810e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:48.464389 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5eceb3-3a43-4aff-83d6-dc9997e810e1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:48.464741 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5eceb3-3a43-4aff-83d6-dc9997e810e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:48.465067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5eceb3-3a43-4aff-83d6-dc9997e810e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:48.476918 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5eceb3-3a43-4aff-83d6-dc9997e810e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:26:48.485551 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-7c5eceb3-3a43-4aff-83d6-dc9997e810e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:26:48.485551 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:26:48.485551 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:26:48.485551 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:26:48.485551 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:26:48.485551 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:26:48.485551 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:26:48.485551 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:26:48.485551 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:26:48.485551 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:26:48.485551 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:26:48.485551 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:26:48.485551 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:26:48.485551 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:26:48.485551 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:26:48.485551 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:26:48.487566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:26:48.487566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:26:48.487566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:26:48.487566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:26:48.487566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:26:48.487566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:26:48.487566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:26:48.487566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:26:48.487566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:26:48.487566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:26:48.487566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:26:48.487566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:26:48.487566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:26:48.487566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:26:48.487566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:26:48.487566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:26:48.489405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:26:48.489405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:26:48.489405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:26:48.489405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:26:48.489405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:26:48.489405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:26:48.489405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:26:48.489405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:26:48.489405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:26:48.489405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:26:48.489405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:26:48.489405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:26:48.489405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 71/140] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:26:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:26:48.492902 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a17da-4063-4fb3-9f4d-49c8c2efd16e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:48.617870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:48.628203 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a17da-4063-4fb3-9f4d-49c8c2efd16e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:48.671739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b4c7b-1ffd-4148-bf86-ad3f048742f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:48.672412 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b4c7b-1ffd-4148-bf86-ad3f048742f8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:48.672746 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b4c7b-1ffd-4148-bf86-ad3f048742f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:48.673027 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b4c7b-1ffd-4148-bf86-ad3f048742f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:48.673777 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b4c7b-1ffd-4148-bf86-ad3f048742f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:48.674089 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b4c7b-1ffd-4148-bf86-ad3f048742f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:48.675483 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b4c7b-1ffd-4148-bf86-ad3f048742f8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:48.690028 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 70/141] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:26:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:48.695158 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5eceb3-3a43-4aff-83d6-dc9997e810e1 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:48.800101 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5eceb3-3a43-4aff-83d6-dc9997e810e1 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:48.813515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:48.835176 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577feda5-0b49-409a-85bc-c0ed496d39c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:48.836111 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577feda5-0b49-409a-85bc-c0ed496d39c6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:48.836403 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577feda5-0b49-409a-85bc-c0ed496d39c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:48.836712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577feda5-0b49-409a-85bc-c0ed496d39c6 None admin] PATH_INFO: `/v3/users/47353d62c11845f29684fe955de36601` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:48.837917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577feda5-0b49-409a-85bc-c0ed496d39c6 None admin] RBAC: Authorizing `identity:get_user(user_id=47353d62c11845f29684fe955de36601)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:48.839457 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577feda5-0b49-409a-85bc-c0ed496d39c6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:48.844678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 72/142] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:26:48 2022] GET /identity/v3/users/47353d62c11845f29684fe955de36601 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:48.847394 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b4c7b-1ffd-4148-bf86-ad3f048742f8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:48.974182 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b4c7b-1ffd-4148-bf86-ad3f048742f8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:49.019910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7d5fb-77df-42d7-8d8e-69a74f230d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:49.020990 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7d5fb-77df-42d7-8d8e-69a74f230d96 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:49.021495 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7d5fb-77df-42d7-8d8e-69a74f230d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:49.021969 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7d5fb-77df-42d7-8d8e-69a74f230d96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:49.054909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:49.113119 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7d5fb-77df-42d7-8d8e-69a74f230d96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:49.114941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7d5fb-77df-42d7-8d8e-69a74f230d96 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:49.222745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 71/143] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:26:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:26:49.228905 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577feda5-0b49-409a-85bc-c0ed496d39c6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:49.403312 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577feda5-0b49-409a-85bc-c0ed496d39c6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:49.449346 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078843c-9403-4ce0-a46d-354b8bd23894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:49.450775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078843c-9403-4ce0-a46d-354b8bd23894 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:49.451083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078843c-9403-4ce0-a46d-354b8bd23894 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:49.451366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078843c-9403-4ce0-a46d-354b8bd23894 None admin] PATH_INFO: `/v3/projects/0796b54c77a1493db97cdbe3488fc82b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:49.457239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078843c-9403-4ce0-a46d-354b8bd23894 None admin] RBAC: Authorizing `identity:get_project(project_id=0796b54c77a1493db97cdbe3488fc82b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:49.458715 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078843c-9403-4ce0-a46d-354b8bd23894 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:49.460879 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 73/144] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:26:49 2022] GET /identity/v3/projects/0796b54c77a1493db97cdbe3488fc82b => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:49.466238 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7d5fb-77df-42d7-8d8e-69a74f230d96 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:49.551533 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:49.567466 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10a6c9-5db4-41d7-abd2-79def2607447 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:49.567980 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10a6c9-5db4-41d7-abd2-79def2607447 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:49.568062 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10a6c9-5db4-41d7-abd2-79def2607447 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:49.569425 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 74/145] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:26:49.574868 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ecac9-e47a-48ba-8f36-7e1639f3d8fd None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:49.576067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ecac9-e47a-48ba-8f36-7e1639f3d8fd None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:49.576353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ecac9-e47a-48ba-8f36-7e1639f3d8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:49.608408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-fe3ecac9-e47a-48ba-8f36-7e1639f3d8fd None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:49.609626 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-fe3ecac9-e47a-48ba-8f36-7e1639f3d8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:49.613551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7d5fb-77df-42d7-8d8e-69a74f230d96 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:49.680900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:49.681088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d009795-2993-4950-b884-0f416fcba546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:49.681638 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d009795-2993-4950-b884-0f416fcba546 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:49.681926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d009795-2993-4950-b884-0f416fcba546 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:49.682205 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d009795-2993-4950-b884-0f416fcba546 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:49.683043 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d009795-2993-4950-b884-0f416fcba546 None admin] RBAC: Adding query filter params (role.id=c68f9f9f32ac40dba0d180dd3f5582bb, scope.project.id=0796b54c77a1493db97cdbe3488fc82b, user.id=47353d62c11845f29684fe955de36601) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:49.683358 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d009795-2993-4950-b884-0f416fcba546 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:49.685385 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d009795-2993-4950-b884-0f416fcba546 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:49.696016 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 72/146] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:26:49 2022] GET /identity/v3/role_assignments?user.id=47353d62c11845f29684fe955de36601&scope.project.id=0796b54c77a1493db97cdbe3488fc82b&role.id=c68f9f9f32ac40dba0d180dd3f5582bb => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:49.697145 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79fbe1-a54e-43e5-a43c-95e9bcb90525 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:49.697437 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79fbe1-a54e-43e5-a43c-95e9bcb90525 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:49.697721 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79fbe1-a54e-43e5-a43c-95e9bcb90525 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:49.699096 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 73/147] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:49.707132 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5ddd8-bf0f-40db-a60c-53b9bea018ae None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:49.707477 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5ddd8-bf0f-40db-a60c-53b9bea018ae None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:49.707699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5ddd8-bf0f-40db-a60c-53b9bea018ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:49.717867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 75/148] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:26:49.726914 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-5fc5ddd8-bf0f-40db-a60c-53b9bea018ae None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:49.728117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5fc5ddd8-bf0f-40db-a60c-53b9bea018ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:49.762178 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ecac9-e47a-48ba-8f36-7e1639f3d8fd None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:49.845559 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 74/149] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:26:49.921601 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5ddd8-bf0f-40db-a60c-53b9bea018ae None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:49.933522 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ecac9-e47a-48ba-8f36-7e1639f3d8fd None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:49.978299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152beac-10c6-4d72-8fdc-ca19c0d0bf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:49.979435 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152beac-10c6-4d72-8fdc-ca19c0d0bf3c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:49.980129 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152beac-10c6-4d72-8fdc-ca19c0d0bf3c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:49.982315 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152beac-10c6-4d72-8fdc-ca19c0d0bf3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:49.997727 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152beac-10c6-4d72-8fdc-ca19c0d0bf3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:26:50.007462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-5152beac-10c6-4d72-8fdc-ca19c0d0bf3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:26:50.007462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:26:50.007462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:26:50.007462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:26:50.007462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:26:50.007462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:26:50.007462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:26:50.007462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:26:50.007462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:26:50.007462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:26:50.007462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:26:50.007462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:26:50.007462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:26:50.007462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:26:50.007462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:26:50.007462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:26:50.008385 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:26:50.008385 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:26:50.008385 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:26:50.008385 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:26:50.008385 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:26:50.008385 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:26:50.008385 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:26:50.008385 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:26:50.008385 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:26:50.008385 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:26:50.008385 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:26:50.008385 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:26:50.008385 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:26:50.008385 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:26:50.008385 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:26:50.008385 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:26:50.009222 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:26:50.009222 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:26:50.009222 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:26:50.009222 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:26:50.009222 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:26:50.009222 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:26:50.009222 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:26:50.009222 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:26:50.009222 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:26:50.009222 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:26:50.009222 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:26:50.009222 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:26:50.011708 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 76/150] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:26:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:26:50.017566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152beac-10c6-4d72-8fdc-ca19c0d0bf3c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:50.022600 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:50.076899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:50.131547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152beac-10c6-4d72-8fdc-ca19c0d0bf3c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:50.139063 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5ddd8-bf0f-40db-a60c-53b9bea018ae None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:50.171208 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9eecec-ec25-4ec3-b397-af1318cdf9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:50.172426 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9eecec-ec25-4ec3-b397-af1318cdf9be None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:50.173028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9eecec-ec25-4ec3-b397-af1318cdf9be None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:50.173630 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9eecec-ec25-4ec3-b397-af1318cdf9be None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:50.174578 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9eecec-ec25-4ec3-b397-af1318cdf9be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:50.175098 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9eecec-ec25-4ec3-b397-af1318cdf9be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:50.176725 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9eecec-ec25-4ec3-b397-af1318cdf9be None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:50.186103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 77/151] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:26:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:50.192908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9eecec-ec25-4ec3-b397-af1318cdf9be None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:50.231210 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97decba0-9cd5-4489-be9a-167edc6a2cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:50.233692 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97decba0-9cd5-4489-be9a-167edc6a2cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:50.234223 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97decba0-9cd5-4489-be9a-167edc6a2cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:50.235399 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97decba0-9cd5-4489-be9a-167edc6a2cd9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:50.237818 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97decba0-9cd5-4489-be9a-167edc6a2cd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:50.240419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97decba0-9cd5-4489-be9a-167edc6a2cd9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:50.245020 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 75/152] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:26:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:50.252178 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97decba0-9cd5-4489-be9a-167edc6a2cd9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:50.326023 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:50.328979 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9eecec-ec25-4ec3-b397-af1318cdf9be None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:50.366433 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debc04c-5c92-4652-8cf7-84ec4d23dfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:50.367318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debc04c-5c92-4652-8cf7-84ec4d23dfe5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:50.367630 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debc04c-5c92-4652-8cf7-84ec4d23dfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:50.367890 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debc04c-5c92-4652-8cf7-84ec4d23dfe5 None admin] PATH_INFO: `/v3/users/224404a1bd69482b9e7c4f685daaf4a4` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:50.369221 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debc04c-5c92-4652-8cf7-84ec4d23dfe5 None admin] RBAC: Authorizing `identity:get_user(user_id=224404a1bd69482b9e7c4f685daaf4a4)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:50.371001 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debc04c-5c92-4652-8cf7-84ec4d23dfe5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:50.372796 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 78/153] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:26:50 2022] GET /identity/v3/users/224404a1bd69482b9e7c4f685daaf4a4 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:50.378561 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debc04c-5c92-4652-8cf7-84ec4d23dfe5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:50.478988 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debc04c-5c92-4652-8cf7-84ec4d23dfe5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:50.492837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97decba0-9cd5-4489-be9a-167edc6a2cd9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:50.513410 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:50.513643 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fa745-2bd6-43c1-a954-55b7e8667205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:50.514798 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fa745-2bd6-43c1-a954-55b7e8667205 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:50.515228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fa745-2bd6-43c1-a954-55b7e8667205 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:50.515687 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fa745-2bd6-43c1-a954-55b7e8667205 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:50.540967 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050ef4b-ba7e-4b0e-a3a4-8e72c45c3ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:50.542106 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050ef4b-ba7e-4b0e-a3a4-8e72c45c3ba8 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:50.542559 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050ef4b-ba7e-4b0e-a3a4-8e72c45c3ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:50.543348 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050ef4b-ba7e-4b0e-a3a4-8e72c45c3ba8 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:50.545112 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050ef4b-ba7e-4b0e-a3a4-8e72c45c3ba8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:50.547196 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050ef4b-ba7e-4b0e-a3a4-8e72c45c3ba8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:50.552872 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:50.581647 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 76/154] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 30 10:26:50 2022] POST /identity/v3/users => generated 283 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:26:50.583768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eeee4c-24d9-4455-a0fb-5f0309854e83 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:50.584278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eeee4c-24d9-4455-a0fb-5f0309854e83 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:50.584784 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eeee4c-24d9-4455-a0fb-5f0309854e83 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:50.586488 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 77/155] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:50.600559 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780afef-477b-4be1-bba3-9787f539e854 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:50.601267 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780afef-477b-4be1-bba3-9787f539e854 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:50.601747 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780afef-477b-4be1-bba3-9787f539e854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:50.618950 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fa745-2bd6-43c1-a954-55b7e8667205 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:50.620454 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fa745-2bd6-43c1-a954-55b7e8667205 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:50.624253 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c780afef-477b-4be1-bba3-9787f539e854 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:50.625831 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c780afef-477b-4be1-bba3-9787f539e854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:50.726797 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 78/156] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:26:50.774859 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780afef-477b-4be1-bba3-9787f539e854 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:50.796060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 79/157] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:26:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:26:50.804723 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fa745-2bd6-43c1-a954-55b7e8667205 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:50.872614 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:50.900489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780afef-477b-4be1-bba3-9787f539e854 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:50.908935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fa745-2bd6-43c1-a954-55b7e8667205 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:50.911943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:50.942127 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f1296-0f64-411c-b72e-abb8b243d4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:50.943078 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f1296-0f64-411c-b72e-abb8b243d4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:50.943464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f1296-0f64-411c-b72e-abb8b243d4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:50.943839 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f1296-0f64-411c-b72e-abb8b243d4b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:50.948373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e0eb8-e9fc-49ee-a5aa-9b94818cc21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:50.949561 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e0eb8-e9fc-49ee-a5aa-9b94818cc21f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:50.949847 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e0eb8-e9fc-49ee-a5aa-9b94818cc21f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:50.950157 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e0eb8-e9fc-49ee-a5aa-9b94818cc21f None admin] PATH_INFO: `/v3/projects/0796b54c77a1493db97cdbe3488fc82b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:50.951404 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e0eb8-e9fc-49ee-a5aa-9b94818cc21f None admin] RBAC: Authorizing `identity:get_project(project_id=0796b54c77a1493db97cdbe3488fc82b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:50.952890 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e0eb8-e9fc-49ee-a5aa-9b94818cc21f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:50.954812 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 80/158] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:26:50 2022] GET /identity/v3/projects/0796b54c77a1493db97cdbe3488fc82b => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:50.959889 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f1296-0f64-411c-b72e-abb8b243d4b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:26:50.960639 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e0eb8-e9fc-49ee-a5aa-9b94818cc21f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:50.974348 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-e36f1296-0f64-411c-b72e-abb8b243d4b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:26:50.974348 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:26:50.974348 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:26:50.974348 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:26:50.974348 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:26:50.974348 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:26:50.974348 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:26:50.974348 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:26:50.974348 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:26:50.974348 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:26:50.974348 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:26:50.974348 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:26:50.974348 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:26:50.974348 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:26:50.974348 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:26:50.974348 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:26:50.975828 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:26:50.975828 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:26:50.975828 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:26:50.975828 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:26:50.975828 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:26:50.975828 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:26:50.975828 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:26:50.975828 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:26:50.975828 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:26:50.975828 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:26:50.975828 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:26:50.975828 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:26:50.975828 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:26:50.975828 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:26:50.975828 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:26:50.975828 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:26:50.977167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:26:50.977167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:26:50.977167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:26:50.977167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:26:50.977167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:26:50.977167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:26:50.977167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:26:50.977167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:26:50.977167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:26:50.977167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:26:50.977167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:26:50.977167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:26:50.977167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 79/159] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:26:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:26:50.987324 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f1296-0f64-411c-b72e-abb8b243d4b7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:51.076054 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e0eb8-e9fc-49ee-a5aa-9b94818cc21f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:51.111054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f1296-0f64-411c-b72e-abb8b243d4b7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:51.112445 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ab71f-4c12-4565-bbe0-7e9394389aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:51.113135 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ab71f-4c12-4565-bbe0-7e9394389aac None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:51.113416 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ab71f-4c12-4565-bbe0-7e9394389aac None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:51.113692 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ab71f-4c12-4565-bbe0-7e9394389aac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:51.114516 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ab71f-4c12-4565-bbe0-7e9394389aac None admin] RBAC: Adding query filter params (role.id=ab64ea6d0475430195af26a049485569, scope.project.id=0796b54c77a1493db97cdbe3488fc82b, user.id=224404a1bd69482b9e7c4f685daaf4a4) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:51.114826 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ab71f-4c12-4565-bbe0-7e9394389aac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:51.116273 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ab71f-4c12-4565-bbe0-7e9394389aac None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:51.118189 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:51.123858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 81/160] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:26:50 2022] GET /identity/v3/role_assignments?user.id=224404a1bd69482b9e7c4f685daaf4a4&scope.project.id=0796b54c77a1493db97cdbe3488fc82b&role.id=ab64ea6d0475430195af26a049485569 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:51.154340 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f808f94-716e-4ba2-b2b6-eff49a546095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:51.155315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f808f94-716e-4ba2-b2b6-eff49a546095 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:51.155746 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f808f94-716e-4ba2-b2b6-eff49a546095 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:51.156174 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f808f94-716e-4ba2-b2b6-eff49a546095 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:51.157214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f808f94-716e-4ba2-b2b6-eff49a546095 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:51.157744 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f808f94-716e-4ba2-b2b6-eff49a546095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:51.159424 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f808f94-716e-4ba2-b2b6-eff49a546095 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:51.170414 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 80/161] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:26:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:51.176581 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ab71f-4c12-4565-bbe0-7e9394389aac None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:51.301299 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7017ea7-460c-4a60-ba11-98d080d18f72 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:51.301868 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7017ea7-460c-4a60-ba11-98d080d18f72 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:51.302313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7017ea7-460c-4a60-ba11-98d080d18f72 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:51.303906 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 81/162] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:51.309823 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a779ea-f8b3-4925-b13d-8120a3dd8223 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:51.310393 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a779ea-f8b3-4925-b13d-8120a3dd8223 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:51.310869 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a779ea-f8b3-4925-b13d-8120a3dd8223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:51.333914 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f5a779ea-f8b3-4925-b13d-8120a3dd8223 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:51.335349 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f5a779ea-f8b3-4925-b13d-8120a3dd8223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:51.339391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ab71f-4c12-4565-bbe0-7e9394389aac None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:51.372448 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:51.392015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debacab-0107-438f-a8e3-069d1538cfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:51.392945 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debacab-0107-438f-a8e3-069d1538cfcc None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:51.393228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debacab-0107-438f-a8e3-069d1538cfcc None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:51.393507 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debacab-0107-438f-a8e3-069d1538cfcc None admin] PATH_INFO: `/v3/users/024c27237ea947b3ae990b600a8568fd` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:51.395929 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debacab-0107-438f-a8e3-069d1538cfcc None admin] RBAC: Authorizing `identity:get_user(user_id=024c27237ea947b3ae990b600a8568fd)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:51.397434 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debacab-0107-438f-a8e3-069d1538cfcc None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:51.399411 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 82/163] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:26:51 2022] GET /identity/v3/users/024c27237ea947b3ae990b600a8568fd => generated 289 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:51.405681 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b184ca-f26c-43e6-bf76-3ceb31f771f3 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:51.405681 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b184ca-f26c-43e6-bf76-3ceb31f771f3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:51.405906 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b184ca-f26c-43e6-bf76-3ceb31f771f3 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:51.407302 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 83/164] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:51.410563 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b184ca-f26c-43e6-bf76-3ceb31f771f3 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:51.439138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 82/165] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:26:51.441114 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d7bc8-af1f-45be-870b-82bfea7c8433 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:51.441701 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d7bc8-af1f-45be-870b-82bfea7c8433 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:51.442190 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d7bc8-af1f-45be-870b-82bfea7c8433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:51.460829 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d12d7bc8-af1f-45be-870b-82bfea7c8433 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:51.462342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d12d7bc8-af1f-45be-870b-82bfea7c8433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:51.503703 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:51.540258 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b184ca-f26c-43e6-bf76-3ceb31f771f3 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:51.557258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 83/166] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:26:51.558575 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d7bc8-af1f-45be-870b-82bfea7c8433 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:51.581909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2accd5-3a8e-4c85-86fa-fc20a5b79d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:51.582838 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2accd5-3a8e-4c85-86fa-fc20a5b79d8a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:51.583042 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2accd5-3a8e-4c85-86fa-fc20a5b79d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:51.583319 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2accd5-3a8e-4c85-86fa-fc20a5b79d8a None admin] PATH_INFO: `/v3/projects/0796b54c77a1493db97cdbe3488fc82b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:51.584707 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2accd5-3a8e-4c85-86fa-fc20a5b79d8a None admin] RBAC: Authorizing `identity:get_project(project_id=0796b54c77a1493db97cdbe3488fc82b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:51.586035 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2accd5-3a8e-4c85-86fa-fc20a5b79d8a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:51.588032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 84/167] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:26:51 2022] GET /identity/v3/projects/0796b54c77a1493db97cdbe3488fc82b => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:51.589063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2accd5-3a8e-4c85-86fa-fc20a5b79d8a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:51.683499 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:51.702705 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d7bc8-af1f-45be-870b-82bfea7c8433 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:51.703198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2accd5-3a8e-4c85-86fa-fc20a5b79d8a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:51.743141 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a07e97-d5f4-46f2-8aa7-fe47721d0be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:51.743711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a07e97-d5f4-46f2-8aa7-fe47721d0be0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:51.745266 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a07e97-d5f4-46f2-8aa7-fe47721d0be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:51.745266 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a07e97-d5f4-46f2-8aa7-fe47721d0be0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:51.747014 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6accf5-ad00-4793-895c-b5dbad69bc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:51.747999 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6accf5-ad00-4793-895c-b5dbad69bc03 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:51.748428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6accf5-ad00-4793-895c-b5dbad69bc03 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:51.748943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6accf5-ad00-4793-895c-b5dbad69bc03 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:51.753135 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:51.758063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a07e97-d5f4-46f2-8aa7-fe47721d0be0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:26:51.763734 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6accf5-ad00-4793-895c-b5dbad69bc03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:26:51.774144 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-ed6accf5-ad00-4793-895c-b5dbad69bc03 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:26:51.774144 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:26:51.774144 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:26:51.774144 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:26:51.774144 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:26:51.774144 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:26:51.774144 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:26:51.774144 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:26:51.774144 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:26:51.774144 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:26:51.774144 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:26:51.774144 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:26:51.774144 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:26:51.774144 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:26:51.774144 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:26:51.774144 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:26:51.775216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:26:51.775216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:26:51.775216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:26:51.775216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:26:51.775216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:26:51.775216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:26:51.775216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:26:51.775216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:26:51.775216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:26:51.775216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:26:51.775216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:26:51.775216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:26:51.775216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:26:51.775216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:26:51.775216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:26:51.775216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:26:51.775991 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:26:51.775991 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:26:51.775991 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:26:51.775991 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:26:51.775991 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:26:51.775991 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:26:51.775991 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:26:51.775991 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:26:51.775991 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:26:51.775991 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:26:51.775991 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:26:51.775991 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:26:51.780891 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-e8a07e97-d5f4-46f2-8aa7-fe47721d0be0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:26:51.780891 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:26:51.780891 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:26:51.780891 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:26:51.780891 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:26:51.780891 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:26:51.780891 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:26:51.780891 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:26:51.780891 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:26:51.780891 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:26:51.780891 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:26:51.780891 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:26:51.780891 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:26:51.780891 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:26:51.780891 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:26:51.780891 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:26:51.782005 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:26:51.782005 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:26:51.782005 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:26:51.782005 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:26:51.782005 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:26:51.782005 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:26:51.782005 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:26:51.782005 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:26:51.782005 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:26:51.782005 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:26:51.782005 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:26:51.782005 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:26:51.782005 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:26:51.782005 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:26:51.782005 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:26:51.782005 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:26:51.782807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:26:51.782807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:26:51.782807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:26:51.782807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:26:51.782807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:26:51.782807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:26:51.782807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:26:51.782807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:26:51.782807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:26:51.782807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:26:51.782807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:26:51.782807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:26:51.783403 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 84/168] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 30 10:26:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:26:51.783471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 85/169] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:26:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:26:51.783548 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6accf5-ad00-4793-895c-b5dbad69bc03 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:51.785509 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a07e97-d5f4-46f2-8aa7-fe47721d0be0 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:51.893974 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a07e97-d5f4-46f2-8aa7-fe47721d0be0 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:51.929153 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21957c-2f83-489e-9018-d7657f791896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:51.929824 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21957c-2f83-489e-9018-d7657f791896 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:51.930112 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21957c-2f83-489e-9018-d7657f791896 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:51.930388 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21957c-2f83-489e-9018-d7657f791896 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:51.931137 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21957c-2f83-489e-9018-d7657f791896 None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:51.931438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21957c-2f83-489e-9018-d7657f791896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:51.932843 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21957c-2f83-489e-9018-d7657f791896 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:51.942259 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 86/170] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:26:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:51.943218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21957c-2f83-489e-9018-d7657f791896 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:52.002292 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:52.050480 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21957c-2f83-489e-9018-d7657f791896 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:52.086808 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832baf6-c82b-4229-9926-f86907a9d579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:52.087825 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832baf6-c82b-4229-9926-f86907a9d579 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:52.088333 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832baf6-c82b-4229-9926-f86907a9d579 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:52.088920 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832baf6-c82b-4229-9926-f86907a9d579 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:52.089855 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832baf6-c82b-4229-9926-f86907a9d579 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:52.090360 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832baf6-c82b-4229-9926-f86907a9d579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:52.092044 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832baf6-c82b-4229-9926-f86907a9d579 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:52.101526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 87/171] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:26:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:52.102669 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832baf6-c82b-4229-9926-f86907a9d579 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:52.159318 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6accf5-ad00-4793-895c-b5dbad69bc03 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:52.197535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd638c7-e5a5-4641-9d85-59412287ff09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:52.198771 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd638c7-e5a5-4641-9d85-59412287ff09 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:52.199357 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd638c7-e5a5-4641-9d85-59412287ff09 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:52.199861 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd638c7-e5a5-4641-9d85-59412287ff09 None admin] PATH_INFO: `/v3/projects/0796b54c77a1493db97cdbe3488fc82b/users/024c27237ea947b3ae990b600a8568fd/roles/b3bea9d8f5294a5b8aaecb6c9bfeee6a` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:52.203994 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd638c7-e5a5-4641-9d85-59412287ff09 None admin] RBAC: Authorizing `identity:create_grant(project_id=0796b54c77a1493db97cdbe3488fc82b, user_id=024c27237ea947b3ae990b600a8568fd, role_id=b3bea9d8f5294a5b8aaecb6c9bfeee6a)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:52.206364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd638c7-e5a5-4641-9d85-59412287ff09 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:52.245714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 85/172] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 30 10:26:51 2022] PUT /identity/v3/projects/0796b54c77a1493db97cdbe3488fc82b/users/024c27237ea947b3ae990b600a8568fd/roles/b3bea9d8f5294a5b8aaecb6c9bfeee6a => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:26:52.246543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd638c7-e5a5-4641-9d85-59412287ff09 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:52.282392 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:52.398556 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832baf6-c82b-4229-9926-f86907a9d579 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:52.452612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd638c7-e5a5-4641-9d85-59412287ff09 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:52.453944 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:52.495277 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88510f09-29e9-4a34-b06c-e7f129715f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:52.495519 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da064da3-a69f-4c00-bc39-a621fbb01c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:52.496340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da064da3-a69f-4c00-bc39-a621fbb01c8b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:52.496648 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da064da3-a69f-4c00-bc39-a621fbb01c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:52.496958 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da064da3-a69f-4c00-bc39-a621fbb01c8b None admin] PATH_INFO: `/v3/users/47353d62c11845f29684fe955de36601` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:52.497172 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88510f09-29e9-4a34-b06c-e7f129715f19 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:52.497601 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88510f09-29e9-4a34-b06c-e7f129715f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:52.498022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88510f09-29e9-4a34-b06c-e7f129715f19 None admin] PATH_INFO: `/v3/users/47353d62c11845f29684fe955de36601` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:52.498129 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da064da3-a69f-4c00-bc39-a621fbb01c8b None admin] RBAC: Authorizing `identity:get_user(user_id=47353d62c11845f29684fe955de36601)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:52.500360 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da064da3-a69f-4c00-bc39-a621fbb01c8b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:52.501009 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88510f09-29e9-4a34-b06c-e7f129715f19 None admin] RBAC: Authorizing `identity:get_user(user_id=47353d62c11845f29684fe955de36601)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:52.502286 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 88/173] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:26:52 2022] GET /identity/v3/users/47353d62c11845f29684fe955de36601 => generated 275 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:52.503250 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88510f09-29e9-4a34-b06c-e7f129715f19 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:52.505534 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 86/174] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:26:52 2022] GET /identity/v3/users/47353d62c11845f29684fe955de36601 => generated 275 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:52.507809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da064da3-a69f-4c00-bc39-a621fbb01c8b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:52.511111 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88510f09-29e9-4a34-b06c-e7f129715f19 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:52.591774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:52.620724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88510f09-29e9-4a34-b06c-e7f129715f19 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:52.657049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43aae68-cd83-4a3d-a64b-551568237174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:52.658016 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43aae68-cd83-4a3d-a64b-551568237174 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:52.658484 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43aae68-cd83-4a3d-a64b-551568237174 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:52.659026 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43aae68-cd83-4a3d-a64b-551568237174 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:52.686458 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da064da3-a69f-4c00-bc39-a621fbb01c8b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:52.732351 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43aae68-cd83-4a3d-a64b-551568237174 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:52.734427 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43aae68-cd83-4a3d-a64b-551568237174 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:52.749933 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2ecb8-6701-4449-a647-a8f1e69fc8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:52.750605 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2ecb8-6701-4449-a647-a8f1e69fc8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:52.750888 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2ecb8-6701-4449-a647-a8f1e69fc8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:52.751487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2ecb8-6701-4449-a647-a8f1e69fc8a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:52.818302 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:52.847841 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 87/175] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:26:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:26:52.849794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:52.855855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43aae68-cd83-4a3d-a64b-551568237174 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:52.875347 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2ecb8-6701-4449-a647-a8f1e69fc8a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:52.876991 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2ecb8-6701-4449-a647-a8f1e69fc8a3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:53.003519 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43aae68-cd83-4a3d-a64b-551568237174 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:53.040314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218acf4d-1bfb-47d1-bef4-c6b12d9af432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:53.041205 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218acf4d-1bfb-47d1-bef4-c6b12d9af432 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:53.041492 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218acf4d-1bfb-47d1-bef4-c6b12d9af432 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:53.041772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218acf4d-1bfb-47d1-bef4-c6b12d9af432 None admin] PATH_INFO: `/v3/projects/0796b54c77a1493db97cdbe3488fc82b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:53.042949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218acf4d-1bfb-47d1-bef4-c6b12d9af432 None admin] RBAC: Authorizing `identity:get_project(project_id=0796b54c77a1493db97cdbe3488fc82b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:53.044465 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218acf4d-1bfb-47d1-bef4-c6b12d9af432 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:53.046179 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 88/176] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:26:52 2022] GET /identity/v3/projects/0796b54c77a1493db97cdbe3488fc82b => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:53.056015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 89/177] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:26:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:26:53.058030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218acf4d-1bfb-47d1-bef4-c6b12d9af432 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:53.062479 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2ecb8-6701-4449-a647-a8f1e69fc8a3 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:53.137447 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:53.196360 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:53.215344 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2ecb8-6701-4449-a647-a8f1e69fc8a3 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:53.251315 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9c0dc-07a3-4e88-8642-5ea0cef7c8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:53.252557 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9c0dc-07a3-4e88-8642-5ea0cef7c8af None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:53.253059 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9c0dc-07a3-4e88-8642-5ea0cef7c8af None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:53.253600 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9c0dc-07a3-4e88-8642-5ea0cef7c8af None admin] PATH_INFO: `/v3/projects/7bf34d43937d4e2082bb791f9db6233b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:53.255043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9c0dc-07a3-4e88-8642-5ea0cef7c8af None admin] RBAC: Authorizing `identity:get_project(project_id=7bf34d43937d4e2082bb791f9db6233b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:53.256873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9c0dc-07a3-4e88-8642-5ea0cef7c8af None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:53.259379 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 90/178] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:26:53 2022] GET /identity/v3/projects/7bf34d43937d4e2082bb791f9db6233b => generated 312 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:53.270781 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9c0dc-07a3-4e88-8642-5ea0cef7c8af None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:53.305511 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218acf4d-1bfb-47d1-bef4-c6b12d9af432 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:53.429252 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4ecc9-d9e4-48b7-b1fb-70289fdae62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:53.429924 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4ecc9-d9e4-48b7-b1fb-70289fdae62e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:53.430213 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4ecc9-d9e4-48b7-b1fb-70289fdae62e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:53.430497 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4ecc9-d9e4-48b7-b1fb-70289fdae62e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:53.431346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4ecc9-d9e4-48b7-b1fb-70289fdae62e None admin] RBAC: Adding query filter params (role.id=2d85fe2aee9740f984e944e0d5c80ec5, scope.project.id=0796b54c77a1493db97cdbe3488fc82b, user.id=47353d62c11845f29684fe955de36601) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:53.431665 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4ecc9-d9e4-48b7-b1fb-70289fdae62e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:53.433175 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4ecc9-d9e4-48b7-b1fb-70289fdae62e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:53.446878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 89/179] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:26:53 2022] GET /identity/v3/role_assignments?user.id=47353d62c11845f29684fe955de36601&scope.project.id=0796b54c77a1493db97cdbe3488fc82b&role.id=2d85fe2aee9740f984e944e0d5c80ec5 => generated 608 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:53.448538 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9c0dc-07a3-4e88-8642-5ea0cef7c8af None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:53.508474 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea5842-a912-4266-ace4-22d341f90650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:53.509086 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea5842-a912-4266-ace4-22d341f90650 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:53.509372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea5842-a912-4266-ace4-22d341f90650 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:53.509647 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea5842-a912-4266-ace4-22d341f90650 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:53.510485 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea5842-a912-4266-ace4-22d341f90650 None admin] RBAC: Adding query filter params (role.id=c68f9f9f32ac40dba0d180dd3f5582bb, scope.project.id=7bf34d43937d4e2082bb791f9db6233b, user.id=47353d62c11845f29684fe955de36601) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:53.510795 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea5842-a912-4266-ace4-22d341f90650 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:53.512231 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea5842-a912-4266-ace4-22d341f90650 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:53.523914 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 91/180] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:26:53 2022] GET /identity/v3/role_assignments?user.id=47353d62c11845f29684fe955de36601&scope.project.id=7bf34d43937d4e2082bb791f9db6233b&role.id=c68f9f9f32ac40dba0d180dd3f5582bb => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:54.012872 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bc7f5-0352-4fe6-801b-91ad5e34ae4d None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:54.013372 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bc7f5-0352-4fe6-801b-91ad5e34ae4d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:54.013447 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bc7f5-0352-4fe6-801b-91ad5e34ae4d None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:54.014958 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 90/181] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:54.022002 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730bed9-90b9-41b1-be83-e8f556927646 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:54.022485 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730bed9-90b9-41b1-be83-e8f556927646 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:54.022569 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730bed9-90b9-41b1-be83-e8f556927646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:54.026640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239330e-3991-4960-8cca-7b12330fb6c7 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:54.026932 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239330e-3991-4960-8cca-7b12330fb6c7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:54.027214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239330e-3991-4960-8cca-7b12330fb6c7 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:54.029267 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 91/182] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:54.034601 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68326c67-8fbf-43bc-9858-624a477cd648 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:54.034885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68326c67-8fbf-43bc-9858-624a477cd648 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:54.035160 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68326c67-8fbf-43bc-9858-624a477cd648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:54.053862 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-4730bed9-90b9-41b1-be83-e8f556927646 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:54.055052 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4730bed9-90b9-41b1-be83-e8f556927646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:54.063934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-68326c67-8fbf-43bc-9858-624a477cd648 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:54.065134 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-68326c67-8fbf-43bc-9858-624a477cd648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:54.073687 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:54.161163 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 92/183] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:26:54.164820 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 92/184] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:26:54.185865 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68326c67-8fbf-43bc-9858-624a477cd648 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:54.187000 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730bed9-90b9-41b1-be83-e8f556927646 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:54.234884 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:54.297090 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730bed9-90b9-41b1-be83-e8f556927646 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:54.327493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68326c67-8fbf-43bc-9858-624a477cd648 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:54.334682 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755c2c3-45b6-4e04-a80f-55fab3447122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:54.335721 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755c2c3-45b6-4e04-a80f-55fab3447122 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:54.336192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755c2c3-45b6-4e04-a80f-55fab3447122 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:54.336715 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755c2c3-45b6-4e04-a80f-55fab3447122 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:54.349083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0755c2c3-45b6-4e04-a80f-55fab3447122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:26:54.357314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-0755c2c3-45b6-4e04-a80f-55fab3447122 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:26:54.357314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:26:54.357314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:26:54.357314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:26:54.357314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:26:54.357314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:26:54.357314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:26:54.357314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:26:54.357314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:26:54.357314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:26:54.357314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:26:54.357314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:26:54.357314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:26:54.357314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:26:54.357314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:26:54.357314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:26:54.358151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:26:54.358151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:26:54.358151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:26:54.358151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:26:54.358151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:26:54.358151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:26:54.358151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:26:54.358151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:26:54.358151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:26:54.358151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:26:54.358151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:26:54.358151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:26:54.358151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:26:54.358151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:26:54.358151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:26:54.358151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:26:54.358924 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:26:54.358924 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:26:54.358924 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:26:54.358924 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:26:54.358924 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:26:54.358924 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:26:54.358924 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:26:54.358924 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:26:54.358924 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:26:54.358924 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:26:54.358924 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:26:54.358924 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:26:54.361535 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 93/185] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:26:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:26:54.367260 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755c2c3-45b6-4e04-a80f-55fab3447122 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:54.371351 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cea432-5fe0-425d-8899-4afe31888288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:54.373075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cea432-5fe0-425d-8899-4afe31888288 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:54.373360 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cea432-5fe0-425d-8899-4afe31888288 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:54.373630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cea432-5fe0-425d-8899-4afe31888288 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:54.381660 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:54.392637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cea432-5fe0-425d-8899-4afe31888288 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:26:54.404867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-95cea432-5fe0-425d-8899-4afe31888288 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:26:54.404867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:26:54.404867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:26:54.404867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:26:54.404867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:26:54.404867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:26:54.404867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:26:54.404867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:26:54.404867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:26:54.404867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:26:54.404867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:26:54.404867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:26:54.404867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:26:54.404867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:26:54.404867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:26:54.404867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:26:54.405739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:26:54.405739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:26:54.405739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:26:54.405739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:26:54.405739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:26:54.405739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:26:54.405739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:26:54.405739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:26:54.405739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:26:54.405739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:26:54.405739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:26:54.405739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:26:54.405739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:26:54.405739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:26:54.405739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:26:54.405739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:26:54.406525 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:26:54.406525 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:26:54.406525 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:26:54.406525 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:26:54.406525 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:26:54.406525 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:26:54.406525 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:26:54.406525 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:26:54.406525 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:26:54.406525 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:26:54.406525 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:26:54.406525 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:26:54.408837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 93/186] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 30 10:26:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:26:54.414711 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cea432-5fe0-425d-8899-4afe31888288 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:54.488219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755c2c3-45b6-4e04-a80f-55fab3447122 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:54.510925 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:54.517609 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cea432-5fe0-425d-8899-4afe31888288 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:54.527298 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111fa54-cb05-4f44-9f13-67718e022e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:54.528943 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111fa54-cb05-4f44-9f13-67718e022e93 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:54.529408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111fa54-cb05-4f44-9f13-67718e022e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:54.529887 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111fa54-cb05-4f44-9f13-67718e022e93 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:54.530914 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111fa54-cb05-4f44-9f13-67718e022e93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:54.531528 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111fa54-cb05-4f44-9f13-67718e022e93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:54.532945 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111fa54-cb05-4f44-9f13-67718e022e93 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:54.546435 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 94/187] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:26:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:54.546435 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211e79d-1445-43f3-b08e-9e434d91bc5a None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:54.546435 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211e79d-1445-43f3-b08e-9e434d91bc5a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:54.546435 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211e79d-1445-43f3-b08e-9e434d91bc5a None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:54.546435 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 95/188] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:54.549408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211e79d-1445-43f3-b08e-9e434d91bc5a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:54.557336 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73316fac-7e14-409e-a868-e398badff67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:54.558008 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73316fac-7e14-409e-a868-e398badff67f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:54.558716 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73316fac-7e14-409e-a868-e398badff67f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:54.559003 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73316fac-7e14-409e-a868-e398badff67f None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:54.559795 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73316fac-7e14-409e-a868-e398badff67f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:54.560483 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73316fac-7e14-409e-a868-e398badff67f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:54.562227 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73316fac-7e14-409e-a868-e398badff67f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:54.574925 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 94/189] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:26:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:54.574925 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f785c-f5ba-4a4f-8465-d54c173309eb None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:54.574925 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f785c-f5ba-4a4f-8465-d54c173309eb None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:54.574925 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f785c-f5ba-4a4f-8465-d54c173309eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:54.588575 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-891f785c-f5ba-4a4f-8465-d54c173309eb None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:54.589758 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-891f785c-f5ba-4a4f-8465-d54c173309eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:54.628405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:54.661743 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211e79d-1445-43f3-b08e-9e434d91bc5a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:54.663077 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 95/190] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:26:54.663744 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f785c-f5ba-4a4f-8465-d54c173309eb None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:54.705204 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c47d2-d28e-486e-99c7-b1f07615d263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:54.706090 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c47d2-d28e-486e-99c7-b1f07615d263 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:54.706369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c47d2-d28e-486e-99c7-b1f07615d263 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:54.706646 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c47d2-d28e-486e-99c7-b1f07615d263 None admin] PATH_INFO: `/v3/users/87dd676434324d01be989308e6cc05d3` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:54.720803 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c47d2-d28e-486e-99c7-b1f07615d263 None admin] RBAC: Authorizing `identity:get_user(user_id=87dd676434324d01be989308e6cc05d3)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:54.722319 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c47d2-d28e-486e-99c7-b1f07615d263 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:54.728576 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 96/191] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:26:54 2022] GET /identity/v3/users/87dd676434324d01be989308e6cc05d3 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:54.728576 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c47d2-d28e-486e-99c7-b1f07615d263 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:54.765889 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:54.778835 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f785c-f5ba-4a4f-8465-d54c173309eb None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:54.814197 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a3286-2313-48af-8cba-5185d9f85b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:54.814979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a3286-2313-48af-8cba-5185d9f85b17 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:54.815354 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a3286-2313-48af-8cba-5185d9f85b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:54.815626 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a3286-2313-48af-8cba-5185d9f85b17 None admin] PATH_INFO: `/v3/users/87dd676434324d01be989308e6cc05d3` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:54.816832 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a3286-2313-48af-8cba-5185d9f85b17 None admin] RBAC: Authorizing `identity:get_user(user_id=87dd676434324d01be989308e6cc05d3)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:54.818290 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a3286-2313-48af-8cba-5185d9f85b17 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:54.820217 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 96/192] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:26:54 2022] GET /identity/v3/users/87dd676434324d01be989308e6cc05d3 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:54.821060 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a3286-2313-48af-8cba-5185d9f85b17 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:54.836080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c47d2-d28e-486e-99c7-b1f07615d263 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:54.864019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:54.874537 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97935b13-2443-45fd-bd37-1011f5a64394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:54.875335 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97935b13-2443-45fd-bd37-1011f5a64394 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:54.875620 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97935b13-2443-45fd-bd37-1011f5a64394 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:54.875899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97935b13-2443-45fd-bd37-1011f5a64394 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:54.877162 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97935b13-2443-45fd-bd37-1011f5a64394 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:54.878634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97935b13-2443-45fd-bd37-1011f5a64394 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:54.880970 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 97/193] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:26:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:54.881583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97935b13-2443-45fd-bd37-1011f5a64394 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:54.933449 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a3286-2313-48af-8cba-5185d9f85b17 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:54.974066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ab9ed-3945-4b50-bc43-03183974d39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:54.974708 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ab9ed-3945-4b50-bc43-03183974d39d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:54.974988 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ab9ed-3945-4b50-bc43-03183974d39d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:54.975257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ab9ed-3945-4b50-bc43-03183974d39d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:54.982667 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97935b13-2443-45fd-bd37-1011f5a64394 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:55.002231 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:55.019608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204fb7e-07fd-4209-867a-36b6a08cfcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:55.020515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204fb7e-07fd-4209-867a-36b6a08cfcd7 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:55.020812 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204fb7e-07fd-4209-867a-36b6a08cfcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:55.021085 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204fb7e-07fd-4209-867a-36b6a08cfcd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:55.048871 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ab9ed-3945-4b50-bc43-03183974d39d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:55.050346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ab9ed-3945-4b50-bc43-03183974d39d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:55.081652 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:55.088330 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204fb7e-07fd-4209-867a-36b6a08cfcd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:55.089844 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204fb7e-07fd-4209-867a-36b6a08cfcd7 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:55.147252 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 97/194] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:26:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:26:55.148152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ab9ed-3945-4b50-bc43-03183974d39d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:55.191608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 98/195] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:26:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:26:55.191608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654f607-74dc-4015-bb74-3e44f9d14250 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:55.191608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654f607-74dc-4015-bb74-3e44f9d14250 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:55.191608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654f607-74dc-4015-bb74-3e44f9d14250 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:55.191608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 99/196] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:55.191608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654f607-74dc-4015-bb74-3e44f9d14250 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:55.206299 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:55.250340 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ab9ed-3945-4b50-bc43-03183974d39d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:55.283632 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbedcf7-5f41-41f1-a923-89a8fdcfa0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:55.284380 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbedcf7-5f41-41f1-a923-89a8fdcfa0e5 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:55.284706 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbedcf7-5f41-41f1-a923-89a8fdcfa0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:55.284986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbedcf7-5f41-41f1-a923-89a8fdcfa0e5 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:55.285693 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbedcf7-5f41-41f1-a923-89a8fdcfa0e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:55.287157 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbedcf7-5f41-41f1-a923-89a8fdcfa0e5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:55.289827 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:55.298226 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654f607-74dc-4015-bb74-3e44f9d14250 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:55.307644 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 98/197] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 30 10:26:55 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:26:55.308454 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbedcf7-5f41-41f1-a923-89a8fdcfa0e5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:55.338826 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36223f-5510-496d-aacb-ee040c0169db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:55.339616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36223f-5510-496d-aacb-ee040c0169db None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:55.339902 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36223f-5510-496d-aacb-ee040c0169db None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:55.340181 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36223f-5510-496d-aacb-ee040c0169db None admin] PATH_INFO: `/v3/projects/0a89ccc08f1b4490a6206c230a1720ff` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:55.341558 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36223f-5510-496d-aacb-ee040c0169db None admin] RBAC: Authorizing `identity:get_project(project_id=0a89ccc08f1b4490a6206c230a1720ff)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:55.343264 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36223f-5510-496d-aacb-ee040c0169db None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:55.345377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 100/198] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:26:55 2022] GET /identity/v3/projects/0a89ccc08f1b4490a6206c230a1720ff => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:55.346616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd198b9-9092-492a-b6bd-73d2475fece8 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:55.346893 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd198b9-9092-492a-b6bd-73d2475fece8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:55.347177 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd198b9-9092-492a-b6bd-73d2475fece8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:55.370702 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-7fd198b9-9092-492a-b6bd-73d2475fece8 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:55.373130 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7fd198b9-9092-492a-b6bd-73d2475fece8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:55.424173 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbedcf7-5f41-41f1-a923-89a8fdcfa0e5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:55.443771 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:55.469053 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 101/199] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:26:55.469239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b9189-f7f2-49fe-93ee-5c725ec5cf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:55.476612 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd198b9-9092-492a-b6bd-73d2475fece8 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:55.476762 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b9189-f7f2-49fe-93ee-5c725ec5cf4c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:55.476762 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b9189-f7f2-49fe-93ee-5c725ec5cf4c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:55.476762 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b9189-f7f2-49fe-93ee-5c725ec5cf4c None admin] PATH_INFO: `/v3/projects/0a89ccc08f1b4490a6206c230a1720ff` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:55.476762 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b9189-f7f2-49fe-93ee-5c725ec5cf4c None admin] RBAC: Authorizing `identity:get_project(project_id=0a89ccc08f1b4490a6206c230a1720ff)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:55.476762 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b9189-f7f2-49fe-93ee-5c725ec5cf4c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:55.476762 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 99/200] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:26:55 2022] GET /identity/v3/projects/0a89ccc08f1b4490a6206c230a1720ff => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:55.480641 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b9189-f7f2-49fe-93ee-5c725ec5cf4c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:55.583540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:55.594518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd198b9-9092-492a-b6bd-73d2475fece8 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:55.611164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b9189-f7f2-49fe-93ee-5c725ec5cf4c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:55.634615 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff97753-30fc-4859-952e-bbf34c2f14c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:55.635518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff97753-30fc-4859-952e-bbf34c2f14c9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:55.635628 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff97753-30fc-4859-952e-bbf34c2f14c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:55.635821 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff97753-30fc-4859-952e-bbf34c2f14c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:55.636675 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff97753-30fc-4859-952e-bbf34c2f14c9 None admin] RBAC: Adding query filter params (role.id=ab64ea6d0475430195af26a049485569, scope.project.id=0a89ccc08f1b4490a6206c230a1720ff, user.id=87dd676434324d01be989308e6cc05d3) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:55.637266 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff97753-30fc-4859-952e-bbf34c2f14c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:55.638413 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff97753-30fc-4859-952e-bbf34c2f14c9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:55.645548 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 102/201] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:26:55 2022] GET /identity/v3/role_assignments?user.id=87dd676434324d01be989308e6cc05d3&scope.project.id=0a89ccc08f1b4490a6206c230a1720ff&role.id=ab64ea6d0475430195af26a049485569 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:55.646347 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff97753-30fc-4859-952e-bbf34c2f14c9 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:55.655680 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a536b1f-b16a-427f-b8f4-d4ed0096c356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:55.656361 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a536b1f-b16a-427f-b8f4-d4ed0096c356 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:55.656716 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a536b1f-b16a-427f-b8f4-d4ed0096c356 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:55.656998 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a536b1f-b16a-427f-b8f4-d4ed0096c356 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:55.658105 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a536b1f-b16a-427f-b8f4-d4ed0096c356 None admin] RBAC: Adding query filter params (role.id=2d85fe2aee9740f984e944e0d5c80ec5, scope.project.id=0a89ccc08f1b4490a6206c230a1720ff, user.id=87dd676434324d01be989308e6cc05d3) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:55.658224 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a536b1f-b16a-427f-b8f4-d4ed0096c356 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:55.659786 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a536b1f-b16a-427f-b8f4-d4ed0096c356 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:55.667070 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 100/202] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:26:55 2022] GET /identity/v3/role_assignments?user.id=87dd676434324d01be989308e6cc05d3&scope.project.id=0a89ccc08f1b4490a6206c230a1720ff&role.id=2d85fe2aee9740f984e944e0d5c80ec5 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:55.770988 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff97753-30fc-4859-952e-bbf34c2f14c9 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:55.811653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46fbd5-068b-417f-8ab3-a9d60433feb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:55.812844 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46fbd5-068b-417f-8ab3-a9d60433feb7 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:55.813302 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46fbd5-068b-417f-8ab3-a9d60433feb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:55.813770 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46fbd5-068b-417f-8ab3-a9d60433feb7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:55.826839 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46fbd5-068b-417f-8ab3-a9d60433feb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:26:55.835015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-ae46fbd5-068b-417f-8ab3-a9d60433feb7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:26:55.835015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:26:55.835015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:26:55.835015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:26:55.835015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:26:55.835015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:26:55.835015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:26:55.835015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:26:55.835015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:26:55.835015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:26:55.835015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:26:55.835015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:26:55.835015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:26:55.835015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:26:55.835015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:26:55.835015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:26:55.835957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:26:55.835957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:26:55.835957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:26:55.835957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:26:55.835957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:26:55.835957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:26:55.835957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:26:55.835957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:26:55.835957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:26:55.835957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:26:55.835957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:26:55.835957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:26:55.835957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:26:55.835957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:26:55.835957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:26:55.835957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:26:55.836766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:26:55.836766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:26:55.836766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:26:55.836766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:26:55.836766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:26:55.836766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:26:55.836766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:26:55.836766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:26:55.836766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:26:55.836766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:26:55.836766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:26:55.836766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:26:55.838904 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 103/203] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:26:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:26:55.850165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a536b1f-b16a-427f-b8f4-d4ed0096c356 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:55.915052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:55.978180 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a536b1f-b16a-427f-b8f4-d4ed0096c356 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:56.026152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bb661-6afd-4c43-a7c2-68c8ce699bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:56.026832 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bb661-6afd-4c43-a7c2-68c8ce699bba None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:56.027116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bb661-6afd-4c43-a7c2-68c8ce699bba None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:56.027397 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bb661-6afd-4c43-a7c2-68c8ce699bba None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:56.028268 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2bb661-6afd-4c43-a7c2-68c8ce699bba None admin] RBAC: Adding query filter params (name=reader) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:56.029064 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2bb661-6afd-4c43-a7c2-68c8ce699bba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:56.030461 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2bb661-6afd-4c43-a7c2-68c8ce699bba None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:56.042211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 101/204] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:26:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:56.047764 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46fbd5-068b-417f-8ab3-a9d60433feb7 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:56.076437 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:56.189028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46fbd5-068b-417f-8ab3-a9d60433feb7 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:56.241245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b07292-db25-4afb-8f66-2a8a76d5db4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:56.242345 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b07292-db25-4afb-8f66-2a8a76d5db4c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:56.242551 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b07292-db25-4afb-8f66-2a8a76d5db4c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:56.243074 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b07292-db25-4afb-8f66-2a8a76d5db4c None admin] PATH_INFO: `/v3/users/024c27237ea947b3ae990b600a8568fd` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:56.244578 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b07292-db25-4afb-8f66-2a8a76d5db4c None admin] RBAC: Authorizing `identity:get_user(user_id=024c27237ea947b3ae990b600a8568fd)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:56.246828 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b07292-db25-4afb-8f66-2a8a76d5db4c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:56.249795 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 104/205] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:26:56 2022] GET /identity/v3/users/024c27237ea947b3ae990b600a8568fd => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:56.257070 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bb661-6afd-4c43-a7c2-68c8ce699bba None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:56.386415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bb661-6afd-4c43-a7c2-68c8ce699bba None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:56.394067 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:56.428065 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace01bab-ab1d-4fb4-b988-6ac909820c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:56.428747 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace01bab-ab1d-4fb4-b988-6ac909820c25 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:56.429035 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace01bab-ab1d-4fb4-b988-6ac909820c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:56.429315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace01bab-ab1d-4fb4-b988-6ac909820c25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:56.509110 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace01bab-ab1d-4fb4-b988-6ac909820c25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:56.510522 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace01bab-ab1d-4fb4-b988-6ac909820c25 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:56.615257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 102/206] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:26:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:26:56.620940 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b07292-db25-4afb-8f66-2a8a76d5db4c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:56.745577 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:56.766357 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b07292-db25-4afb-8f66-2a8a76d5db4c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:56.818190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859636b9-e0a1-41fc-a706-fc2a5f21db0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:56.819063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859636b9-e0a1-41fc-a706-fc2a5f21db0c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:56.819348 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859636b9-e0a1-41fc-a706-fc2a5f21db0c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:56.819625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859636b9-e0a1-41fc-a706-fc2a5f21db0c None admin] PATH_INFO: `/v3/projects/0796b54c77a1493db97cdbe3488fc82b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:56.820895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859636b9-e0a1-41fc-a706-fc2a5f21db0c None admin] RBAC: Authorizing `identity:get_project(project_id=0796b54c77a1493db97cdbe3488fc82b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:56.822354 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859636b9-e0a1-41fc-a706-fc2a5f21db0c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:56.824379 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 105/207] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:26:56 2022] GET /identity/v3/projects/0796b54c77a1493db97cdbe3488fc82b => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:56.830550 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace01bab-ab1d-4fb4-b988-6ac909820c25 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:56.839349 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:56.936675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace01bab-ab1d-4fb4-b988-6ac909820c25 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:56.971233 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848154ab-434a-4ef5-8f2b-d32e2f48c4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:56.971885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848154ab-434a-4ef5-8f2b-d32e2f48c4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:56.972172 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848154ab-434a-4ef5-8f2b-d32e2f48c4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:56.972451 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848154ab-434a-4ef5-8f2b-d32e2f48c4b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:56.973586 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848154ab-434a-4ef5-8f2b-d32e2f48c4b9 None admin] RBAC: Adding query filter params (role.id=b3bea9d8f5294a5b8aaecb6c9bfeee6a, scope.project.id=0796b54c77a1493db97cdbe3488fc82b, user.id=024c27237ea947b3ae990b600a8568fd) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:56.973897 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848154ab-434a-4ef5-8f2b-d32e2f48c4b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:56.975354 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848154ab-434a-4ef5-8f2b-d32e2f48c4b9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:56.983140 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 103/208] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:26:56 2022] GET /identity/v3/role_assignments?user.id=024c27237ea947b3ae990b600a8568fd&scope.project.id=0796b54c77a1493db97cdbe3488fc82b&role.id=b3bea9d8f5294a5b8aaecb6c9bfeee6a => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:57.642887 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340668a3-8c0a-4f64-852d-eeaa75d12615 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:57.643375 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340668a3-8c0a-4f64-852d-eeaa75d12615 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:57.643473 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340668a3-8c0a-4f64-852d-eeaa75d12615 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:57.644856 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 106/209] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:57.650229 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c444eea-8be3-4dd3-913f-a50b1c3358b8 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:57.651057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c444eea-8be3-4dd3-913f-a50b1c3358b8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:57.651537 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c444eea-8be3-4dd3-913f-a50b1c3358b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:57.669413 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8c444eea-8be3-4dd3-913f-a50b1c3358b8 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:57.670886 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8c444eea-8be3-4dd3-913f-a50b1c3358b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:57.736675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:57.748572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 104/210] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:26:57.767503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340668a3-8c0a-4f64-852d-eeaa75d12615 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:57.881465 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340668a3-8c0a-4f64-852d-eeaa75d12615 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:57.919522 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74c238-9c86-46fa-a113-29d2a8c474e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:57.920240 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74c238-9c86-46fa-a113-29d2a8c474e5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:57.920931 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74c238-9c86-46fa-a113-29d2a8c474e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:57.921641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74c238-9c86-46fa-a113-29d2a8c474e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:57.932262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74c238-9c86-46fa-a113-29d2a8c474e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:26:57.940019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-ce74c238-9c86-46fa-a113-29d2a8c474e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:26:57.940019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:26:57.940019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:26:57.940019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:26:57.940019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:26:57.940019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:26:57.940019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:26:57.940019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:26:57.940019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:26:57.940019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:26:57.940019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:26:57.940019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:26:57.940019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:26:57.940019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:26:57.940019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:26:57.940019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:26:57.940964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:26:57.940964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:26:57.940964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:26:57.940964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:26:57.940964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:26:57.940964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:26:57.940964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:26:57.940964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:26:57.940964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:26:57.940964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:26:57.940964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:26:57.940964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:26:57.940964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:26:57.940964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:26:57.940964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:26:57.940964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:26:57.941746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:26:57.941746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:26:57.941746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:26:57.941746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:26:57.941746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:26:57.941746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:26:57.941746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:26:57.941746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:26:57.941746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:26:57.941746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:26:57.941746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:26:57.941746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:26:57.941746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 107/211] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:26:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:26:57.949121 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c444eea-8be3-4dd3-913f-a50b1c3358b8 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:58.053700 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c444eea-8be3-4dd3-913f-a50b1c3358b8 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:58.094076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32548026-e786-4c1d-ac6c-95278064e7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:58.094748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32548026-e786-4c1d-ac6c-95278064e7fe None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:58.095034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32548026-e786-4c1d-ac6c-95278064e7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:58.095316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32548026-e786-4c1d-ac6c-95278064e7fe None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:58.096072 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32548026-e786-4c1d-ac6c-95278064e7fe None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:58.096382 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32548026-e786-4c1d-ac6c-95278064e7fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:58.097813 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32548026-e786-4c1d-ac6c-95278064e7fe None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:58.104026 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde4176-6c9e-4092-8c38-ddb366b12b25 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:58.104300 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde4176-6c9e-4092-8c38-ddb366b12b25 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:58.104605 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde4176-6c9e-4092-8c38-ddb366b12b25 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:58.106257 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 108/212] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:58.107512 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 105/213] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:26:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:58.111401 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc74a1-a11e-4cb6-8a4b-3fbb6cd3eda9 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:58.111684 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc74a1-a11e-4cb6-8a4b-3fbb6cd3eda9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:58.111958 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc74a1-a11e-4cb6-8a4b-3fbb6cd3eda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:58.117503 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32548026-e786-4c1d-ac6c-95278064e7fe None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:58.129360 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d3cc74a1-a11e-4cb6-8a4b-3fbb6cd3eda9 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:58.130931 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d3cc74a1-a11e-4cb6-8a4b-3fbb6cd3eda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:58.148905 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:58.189566 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:58.213743 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 109/214] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:26:58.222271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07051f65-c637-48df-be98-53c409348672 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:58.222818 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07051f65-c637-48df-be98-53c409348672 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:58.223357 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07051f65-c637-48df-be98-53c409348672 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:58.225539 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 110/215] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:58.230837 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6eb2d-0b07-40cc-adce-7da7b37decf2 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:58.231131 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6eb2d-0b07-40cc-adce-7da7b37decf2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:58.231443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6eb2d-0b07-40cc-adce-7da7b37decf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:58.235695 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32548026-e786-4c1d-ac6c-95278064e7fe None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:58.248263 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-53c6eb2d-0b07-40cc-adce-7da7b37decf2 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:58.249853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-53c6eb2d-0b07-40cc-adce-7da7b37decf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:58.275099 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f316425-c444-405a-8b88-d44d900595fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:58.275971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f316425-c444-405a-8b88-d44d900595fe None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:58.276256 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f316425-c444-405a-8b88-d44d900595fe None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:58.276554 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f316425-c444-405a-8b88-d44d900595fe None admin] PATH_INFO: `/v3/users/1678f7157aaa4e83a8da7a05f71796b8` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:58.290746 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f316425-c444-405a-8b88-d44d900595fe None admin] RBAC: Authorizing `identity:get_user(user_id=1678f7157aaa4e83a8da7a05f71796b8)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:58.292247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f316425-c444-405a-8b88-d44d900595fe None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:58.294018 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 106/216] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:26:58 2022] GET /identity/v3/users/1678f7157aaa4e83a8da7a05f71796b8 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:58.294937 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f316425-c444-405a-8b88-d44d900595fe None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:58.326069 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 111/217] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:26:58.326804 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6eb2d-0b07-40cc-adce-7da7b37decf2 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:58.402455 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:58.408119 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f316425-c444-405a-8b88-d44d900595fe None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:58.427309 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6eb2d-0b07-40cc-adce-7da7b37decf2 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:58.428532 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:58.443030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b04c6-f0ab-419f-9f94-e1f26090d7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:58.443754 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b04c6-f0ab-419f-9f94-e1f26090d7dc None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:58.444040 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b04c6-f0ab-419f-9f94-e1f26090d7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:58.444315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b04c6-f0ab-419f-9f94-e1f26090d7dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:58.445496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b04c6-f0ab-419f-9f94-e1f26090d7dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:58.446954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b04c6-f0ab-419f-9f94-e1f26090d7dc None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:58.448755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 107/218] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:26:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:58.449756 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9fbba-4543-4162-b638-58036327b6c5 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:58.450624 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9fbba-4543-4162-b638-58036327b6c5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:58.450908 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9fbba-4543-4162-b638-58036327b6c5 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:58.452144 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 108/219] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:26:58.452859 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9fbba-4543-4162-b638-58036327b6c5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:58.465714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d83a7-28b1-4bb2-b075-f7885514db6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:58.466436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d83a7-28b1-4bb2-b075-f7885514db6f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:58.466889 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d83a7-28b1-4bb2-b075-f7885514db6f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:58.467068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d83a7-28b1-4bb2-b075-f7885514db6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:58.536116 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d83a7-28b1-4bb2-b075-f7885514db6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:58.537612 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d83a7-28b1-4bb2-b075-f7885514db6f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:58.552472 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9fbba-4543-4162-b638-58036327b6c5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:58.586988 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34055c7-1544-4a56-b64f-8e7f136c7c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:58.587790 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34055c7-1544-4a56-b64f-8e7f136c7c8e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:58.588069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34055c7-1544-4a56-b64f-8e7f136c7c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:58.588350 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34055c7-1544-4a56-b64f-8e7f136c7c8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:58.598400 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34055c7-1544-4a56-b64f-8e7f136c7c8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:26:58.605873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-b34055c7-1544-4a56-b64f-8e7f136c7c8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:26:58.605873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:26:58.605873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:26:58.605873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:26:58.605873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:26:58.605873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:26:58.605873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:26:58.605873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:26:58.605873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:26:58.605873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:26:58.605873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:26:58.605873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:26:58.605873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:26:58.605873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:26:58.605873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:26:58.605873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:26:58.606755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:26:58.606755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:26:58.606755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:26:58.606755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:26:58.606755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:26:58.606755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:26:58.606755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:26:58.606755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:26:58.606755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:26:58.606755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:26:58.606755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:26:58.606755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:26:58.606755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:26:58.606755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:26:58.606755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:26:58.606755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:26:58.613067 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:26:58.613067 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:26:58.613067 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:26:58.613067 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:26:58.613067 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:26:58.613067 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:26:58.613067 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:26:58.613067 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:26:58.613067 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:26:58.613067 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:26:58.613067 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:26:58.613067 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:26:58.613067 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 109/220] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:26:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:26:58.613067 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34055c7-1544-4a56-b64f-8e7f136c7c8e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:58.613784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:58.635972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 112/221] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:26:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:26:58.637477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccb87d-9668-442e-8981-44b125b3be49 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:58.638359 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccb87d-9668-442e-8981-44b125b3be49 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:58.638644 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccb87d-9668-442e-8981-44b125b3be49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:58.655572 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8fccb87d-9668-442e-8981-44b125b3be49 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:58.656781 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8fccb87d-9668-442e-8981-44b125b3be49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:58.659488 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:58.711412 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34055c7-1544-4a56-b64f-8e7f136c7c8e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:58.723534 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 113/222] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:26:58.736659 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccb87d-9668-442e-8981-44b125b3be49 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:58.747644 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a3562-551c-40d4-806d-887fc34e4334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:58.748403 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a3562-551c-40d4-806d-887fc34e4334 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:58.748910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a3562-551c-40d4-806d-887fc34e4334 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:58.749035 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a3562-551c-40d4-806d-887fc34e4334 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:58.749690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a3562-551c-40d4-806d-887fc34e4334 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:58.751141 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a3562-551c-40d4-806d-887fc34e4334 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:58.770516 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 110/223] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 30 10:26:58 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:26:58.771399 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a3562-551c-40d4-806d-887fc34e4334 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:58.830698 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccb87d-9668-442e-8981-44b125b3be49 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:58.834924 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:58.873529 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b03ff-f3f5-4612-848e-014f754324b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:58.874228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b03ff-f3f5-4612-848e-014f754324b0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:58.874496 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b03ff-f3f5-4612-848e-014f754324b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:58.874769 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b03ff-f3f5-4612-848e-014f754324b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:58.875526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b03ff-f3f5-4612-848e-014f754324b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:58.875833 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b03ff-f3f5-4612-848e-014f754324b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:58.877276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b03ff-f3f5-4612-848e-014f754324b0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:58.891615 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 114/224] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:26:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:58.891615 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b03ff-f3f5-4612-848e-014f754324b0 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:58.906203 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a3562-551c-40d4-806d-887fc34e4334 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:58.909235 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:58.949966 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ae8fa-29b7-4f60-a662-9aeda1b6b8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:58.951400 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ae8fa-29b7-4f60-a662-9aeda1b6b8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:58.951827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ae8fa-29b7-4f60-a662-9aeda1b6b8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:58.952115 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ae8fa-29b7-4f60-a662-9aeda1b6b8d9 None admin] PATH_INFO: `/v3/projects/0a89ccc08f1b4490a6206c230a1720ff` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:58.953659 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ae8fa-29b7-4f60-a662-9aeda1b6b8d9 None admin] RBAC: Authorizing `identity:get_project(project_id=0a89ccc08f1b4490a6206c230a1720ff)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:58.955142 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ae8fa-29b7-4f60-a662-9aeda1b6b8d9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:58.957768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 111/225] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:26:58 2022] GET /identity/v3/projects/0a89ccc08f1b4490a6206c230a1720ff => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:58.958412 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ae8fa-29b7-4f60-a662-9aeda1b6b8d9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:59.018650 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b03ff-f3f5-4612-848e-014f754324b0 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:59.066453 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3b628-821d-4b66-8b42-2dab995ef990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:59.067435 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3b628-821d-4b66-8b42-2dab995ef990 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:59.067722 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3b628-821d-4b66-8b42-2dab995ef990 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:59.068006 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3b628-821d-4b66-8b42-2dab995ef990 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:59.082493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ae8fa-29b7-4f60-a662-9aeda1b6b8d9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:59.087524 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3b628-821d-4b66-8b42-2dab995ef990 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:26:59.095780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-96c3b628-821d-4b66-8b42-2dab995ef990 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:26:59.095780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:26:59.095780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:26:59.095780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:26:59.095780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:26:59.095780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:26:59.095780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:26:59.095780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:26:59.095780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:26:59.095780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:26:59.095780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:26:59.095780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:26:59.095780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:26:59.095780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:26:59.095780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:26:59.095780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:26:59.096717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:26:59.096717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:26:59.096717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:26:59.096717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:26:59.096717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:26:59.096717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:26:59.096717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:26:59.096717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:26:59.096717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:26:59.096717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:26:59.096717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:26:59.096717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:26:59.096717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:26:59.096717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:26:59.096717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:26:59.096717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:26:59.097921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:26:59.097921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:26:59.097921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:26:59.097921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:26:59.097921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:26:59.097921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:26:59.097921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:26:59.097921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:26:59.097921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:26:59.097921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:26:59.097921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:26:59.097921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:26:59.097921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 115/226] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 30 10:26:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:26:59.097921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3b628-821d-4b66-8b42-2dab995ef990 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:59.125134 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ba6f7-bc8f-4ae7-9754-a03bd91b0d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:59.126060 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ba6f7-bc8f-4ae7-9754-a03bd91b0d26 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:59.126346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ba6f7-bc8f-4ae7-9754-a03bd91b0d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:59.126619 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ba6f7-bc8f-4ae7-9754-a03bd91b0d26 None admin] PATH_INFO: `/v3/users/87dd676434324d01be989308e6cc05d3` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:59.127877 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ba6f7-bc8f-4ae7-9754-a03bd91b0d26 None admin] RBAC: Authorizing `identity:get_user(user_id=87dd676434324d01be989308e6cc05d3)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:59.129433 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ba6f7-bc8f-4ae7-9754-a03bd91b0d26 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:59.135475 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 112/227] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:26:58 2022] GET /identity/v3/users/87dd676434324d01be989308e6cc05d3 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:59.135475 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ba6f7-bc8f-4ae7-9754-a03bd91b0d26 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:59.135695 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:59.178640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:59.217096 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3b628-821d-4b66-8b42-2dab995ef990 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:59.242487 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ba6f7-bc8f-4ae7-9754-a03bd91b0d26 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:59.252001 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97540ed-43a4-44cc-93fc-acecfa34480c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:59.258051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97540ed-43a4-44cc-93fc-acecfa34480c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:59.258551 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97540ed-43a4-44cc-93fc-acecfa34480c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:59.259012 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97540ed-43a4-44cc-93fc-acecfa34480c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:59.265129 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97540ed-43a4-44cc-93fc-acecfa34480c None admin] RBAC: Adding query filter params (role.id=c68f9f9f32ac40dba0d180dd3f5582bb, scope.project.id=0a89ccc08f1b4490a6206c230a1720ff, user.id=1678f7157aaa4e83a8da7a05f71796b8) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:59.265686 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97540ed-43a4-44cc-93fc-acecfa34480c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:59.267367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97540ed-43a4-44cc-93fc-acecfa34480c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:59.273530 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 116/228] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:26:59 2022] GET /identity/v3/role_assignments?user.id=1678f7157aaa4e83a8da7a05f71796b8&scope.project.id=0a89ccc08f1b4490a6206c230a1720ff&role.id=c68f9f9f32ac40dba0d180dd3f5582bb => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:59.274730 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97540ed-43a4-44cc-93fc-acecfa34480c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:59.280359 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f674c-0a3e-4166-9232-cd2ecebb6d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:59.281078 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f674c-0a3e-4166-9232-cd2ecebb6d76 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:59.281412 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f674c-0a3e-4166-9232-cd2ecebb6d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:59.281694 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f674c-0a3e-4166-9232-cd2ecebb6d76 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:59.282525 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f674c-0a3e-4166-9232-cd2ecebb6d76 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:59.282837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f674c-0a3e-4166-9232-cd2ecebb6d76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:59.284355 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f674c-0a3e-4166-9232-cd2ecebb6d76 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:59.294707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 113/229] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:26:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:59.300241 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f674c-0a3e-4166-9232-cd2ecebb6d76 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:59.420885 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:59.435944 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97540ed-43a4-44cc-93fc-acecfa34480c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:59.505883 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde505f-fc76-4c3b-8bda-8fbff9c5796b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:59.506764 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde505f-fc76-4c3b-8bda-8fbff9c5796b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:59.507048 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde505f-fc76-4c3b-8bda-8fbff9c5796b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:59.507327 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde505f-fc76-4c3b-8bda-8fbff9c5796b None admin] PATH_INFO: `/v3/projects/0a89ccc08f1b4490a6206c230a1720ff` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:59.508560 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde505f-fc76-4c3b-8bda-8fbff9c5796b None admin] RBAC: Authorizing `identity:get_project(project_id=0a89ccc08f1b4490a6206c230a1720ff)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:59.510762 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f674c-0a3e-4166-9232-cd2ecebb6d76 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:59.513272 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:59.514435 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde505f-fc76-4c3b-8bda-8fbff9c5796b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:59.521599 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 117/230] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:26:59 2022] GET /identity/v3/projects/0a89ccc08f1b4490a6206c230a1720ff => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:59.527548 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde505f-fc76-4c3b-8bda-8fbff9c5796b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:59.578454 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72f370-fb0d-4cbf-8287-6c6cd296dbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:59.579343 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72f370-fb0d-4cbf-8287-6c6cd296dbf0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:59.579627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72f370-fb0d-4cbf-8287-6c6cd296dbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:59.579905 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72f370-fb0d-4cbf-8287-6c6cd296dbf0 None admin] PATH_INFO: `/v3/users/87dd676434324d01be989308e6cc05d3` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:59.584394 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72f370-fb0d-4cbf-8287-6c6cd296dbf0 None admin] RBAC: Authorizing `identity:get_user(user_id=87dd676434324d01be989308e6cc05d3)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:59.585900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72f370-fb0d-4cbf-8287-6c6cd296dbf0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:59.593006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 114/231] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:26:59 2022] GET /identity/v3/users/87dd676434324d01be989308e6cc05d3 => generated 283 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:59.593846 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72f370-fb0d-4cbf-8287-6c6cd296dbf0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:59.679671 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde505f-fc76-4c3b-8bda-8fbff9c5796b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:59.715396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b9b90-296c-4d95-b7ef-4712261cb56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:59.716340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b9b90-296c-4d95-b7ef-4712261cb56a None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:59.716651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b9b90-296c-4d95-b7ef-4712261cb56a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:59.716930 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b9b90-296c-4d95-b7ef-4712261cb56a None admin] PATH_INFO: `/v3/projects/0a89ccc08f1b4490a6206c230a1720ff/users/87dd676434324d01be989308e6cc05d3/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:59.718944 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b9b90-296c-4d95-b7ef-4712261cb56a None admin] RBAC: Authorizing `identity:create_grant(project_id=0a89ccc08f1b4490a6206c230a1720ff, user_id=87dd676434324d01be989308e6cc05d3, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:59.720601 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b9b90-296c-4d95-b7ef-4712261cb56a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:59.741683 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 118/232] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 30 10:26:59 2022] PUT /identity/v3/projects/0a89ccc08f1b4490a6206c230a1720ff/users/87dd676434324d01be989308e6cc05d3/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:26:59.763115 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72f370-fb0d-4cbf-8287-6c6cd296dbf0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:59.800222 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e50df-8310-4811-8d1d-54940a8ddd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:59.801028 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e50df-8310-4811-8d1d-54940a8ddd3f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:59.801307 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e50df-8310-4811-8d1d-54940a8ddd3f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:59.801579 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e50df-8310-4811-8d1d-54940a8ddd3f None admin] PATH_INFO: `/v3/projects/0a89ccc08f1b4490a6206c230a1720ff` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:59.802823 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e50df-8310-4811-8d1d-54940a8ddd3f None admin] RBAC: Authorizing `identity:get_project(project_id=0a89ccc08f1b4490a6206c230a1720ff)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:59.804293 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e50df-8310-4811-8d1d-54940a8ddd3f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:59.806041 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 115/233] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:26:59 2022] GET /identity/v3/projects/0a89ccc08f1b4490a6206c230a1720ff => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:59.812724 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b9b90-296c-4d95-b7ef-4712261cb56a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:59.836070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:59.931820 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b9b90-296c-4d95-b7ef-4712261cb56a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:59.974788 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d1330-4a2d-45d9-bd21-f0fd9079dddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:59.975681 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d1330-4a2d-45d9-bd21-f0fd9079dddb None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:59.975961 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d1330-4a2d-45d9-bd21-f0fd9079dddb None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:59.976236 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d1330-4a2d-45d9-bd21-f0fd9079dddb None admin] PATH_INFO: `/v3/projects/0a89ccc08f1b4490a6206c230a1720ff/users/87dd676434324d01be989308e6cc05d3/roles/2d85fe2aee9740f984e944e0d5c80ec5` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:59.980420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d1330-4a2d-45d9-bd21-f0fd9079dddb None admin] RBAC: Authorizing `identity:create_grant(project_id=0a89ccc08f1b4490a6206c230a1720ff, user_id=87dd676434324d01be989308e6cc05d3, role_id=2d85fe2aee9740f984e944e0d5c80ec5)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:59.981955 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d1330-4a2d-45d9-bd21-f0fd9079dddb None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:00.002960 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 119/234] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 30 10:26:59 2022] PUT /identity/v3/projects/0a89ccc08f1b4490a6206c230a1720ff/users/87dd676434324d01be989308e6cc05d3/roles/2d85fe2aee9740f984e944e0d5c80ec5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:27:01.182997 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8fb33-b966-41ba-a04c-b3672f7be290 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:01.183533 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8fb33-b966-41ba-a04c-b3672f7be290 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:01.183533 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8fb33-b966-41ba-a04c-b3672f7be290 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:01.185242 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 116/235] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:01.190701 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f97cc-ba77-49c2-bc0d-5e6f777cc9f7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:01.191120 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f97cc-ba77-49c2-bc0d-5e6f777cc9f7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:01.191289 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f97cc-ba77-49c2-bc0d-5e6f777cc9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:01.209169 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b05f97cc-ba77-49c2-bc0d-5e6f777cc9f7 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:01.210366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b05f97cc-ba77-49c2-bc0d-5e6f777cc9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:01.291151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 120/236] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:27:01.327735 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8fb33-b966-41ba-a04c-b3672f7be290 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:01.351381 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f428bee-c261-47ea-9107-3cf805c7502e None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:01.351965 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f428bee-c261-47ea-9107-3cf805c7502e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:01.352420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f428bee-c261-47ea-9107-3cf805c7502e None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:01.354057 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 121/237] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:01.360195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd150b35-1a49-4e39-98ea-e13cbab4c677 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:01.360728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd150b35-1a49-4e39-98ea-e13cbab4c677 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:01.361307 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd150b35-1a49-4e39-98ea-e13cbab4c677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:01.392873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:01.393057 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-fd150b35-1a49-4e39-98ea-e13cbab4c677 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:01.394131 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-fd150b35-1a49-4e39-98ea-e13cbab4c677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:01.396617 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:01.483722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8fb33-b966-41ba-a04c-b3672f7be290 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:01.528365 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ca63a-0a04-43ad-9a54-762e4f615738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:01.529645 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ca63a-0a04-43ad-9a54-762e4f615738 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:01.530244 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ca63a-0a04-43ad-9a54-762e4f615738 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:01.530748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ca63a-0a04-43ad-9a54-762e4f615738 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:01.541754 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ca63a-0a04-43ad-9a54-762e4f615738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:01.545850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 122/238] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:27:01.550266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-4f7ca63a-0a04-43ad-9a54-762e4f615738 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:27:01.550266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:01.550266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:01.550266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:01.550266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:01.550266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:01.550266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:01.550266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:01.550266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:01.550266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:01.550266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:01.550266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:01.550266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:01.550266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:01.550266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:01.550266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:01.551149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:01.551149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:01.551149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:01.551149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:01.551149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:01.551149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:01.551149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:01.551149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:01.551149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:01.551149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:01.551149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:01.551149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:01.551149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:01.551149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:01.551149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:01.551149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:01.551943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:01.551943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:01.551943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:01.551943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:01.551943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:01.551943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:01.551943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:01.551943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:01.551943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:01.551943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:01.551943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:27:01.551943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:01.554290 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 117/239] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:01.561737 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd150b35-1a49-4e39-98ea-e13cbab4c677 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:01.572555 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ca63a-0a04-43ad-9a54-762e4f615738 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:01.691981 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ca63a-0a04-43ad-9a54-762e4f615738 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:01.700972 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:01.754231 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd150b35-1a49-4e39-98ea-e13cbab4c677 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:01.756718 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa216b58-11e1-416b-82c7-2d9641ea6ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:01.757522 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa216b58-11e1-416b-82c7-2d9641ea6ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:01.757807 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa216b58-11e1-416b-82c7-2d9641ea6ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:01.758083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa216b58-11e1-416b-82c7-2d9641ea6ff3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:01.760140 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa216b58-11e1-416b-82c7-2d9641ea6ff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:01.761830 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa216b58-11e1-416b-82c7-2d9641ea6ff3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:01.768709 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 118/240] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:01.776149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa216b58-11e1-416b-82c7-2d9641ea6ff3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:01.825542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd9667-cd91-4853-a6b7-0630c9a10369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:01.826218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd9667-cd91-4853-a6b7-0630c9a10369 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:01.826505 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd9667-cd91-4853-a6b7-0630c9a10369 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:01.826784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd9667-cd91-4853-a6b7-0630c9a10369 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:01.827536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd9667-cd91-4853-a6b7-0630c9a10369 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:01.827845 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd9667-cd91-4853-a6b7-0630c9a10369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:01.834387 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd9667-cd91-4853-a6b7-0630c9a10369 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:01.841867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:01.847057 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 123/241] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:27:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:01.853150 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f877f9-2a77-4f06-8dfd-1d7d8c2c6198 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:01.853600 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f877f9-2a77-4f06-8dfd-1d7d8c2c6198 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:01.854024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f877f9-2a77-4f06-8dfd-1d7d8c2c6198 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:01.855486 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 124/242] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:01.856852 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f877f9-2a77-4f06-8dfd-1d7d8c2c6198 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:01.909531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa216b58-11e1-416b-82c7-2d9641ea6ff3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:01.952758 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1142703-d819-48d1-83c5-62feb83e7f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:01.953667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1142703-d819-48d1-83c5-62feb83e7f42 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:01.954101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1142703-d819-48d1-83c5-62feb83e7f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:01.954550 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1142703-d819-48d1-83c5-62feb83e7f42 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:01.955417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1142703-d819-48d1-83c5-62feb83e7f42 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:01.957077 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1142703-d819-48d1-83c5-62feb83e7f42 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:01.980277 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 119/243] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 30 10:27:01 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:27:01.982644 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd33040-a7bf-44ea-a138-9039f51f6f28 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:01.983431 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd33040-a7bf-44ea-a138-9039f51f6f28 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:01.983946 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd33040-a7bf-44ea-a138-9039f51f6f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:01.992247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f877f9-2a77-4f06-8dfd-1d7d8c2c6198 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:02.013158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1bd33040-a7bf-44ea-a138-9039f51f6f28 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:02.016695 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1bd33040-a7bf-44ea-a138-9039f51f6f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:02.052334 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:02.070726 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47a261-e8db-42de-b882-e7321533a34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:02.071921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47a261-e8db-42de-b882-e7321533a34b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:02.072450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47a261-e8db-42de-b882-e7321533a34b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:02.073011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47a261-e8db-42de-b882-e7321533a34b None admin] PATH_INFO: `/v3/users/fa707faac66e4209b2a3dcfc3d3f78e7` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:02.089433 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47a261-e8db-42de-b882-e7321533a34b None admin] RBAC: Authorizing `identity:get_user(user_id=fa707faac66e4209b2a3dcfc3d3f78e7)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:02.091313 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47a261-e8db-42de-b882-e7321533a34b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:02.093433 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 125/244] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:27:01 2022] GET /identity/v3/users/fa707faac66e4209b2a3dcfc3d3f78e7 => generated 297 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:02.099709 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47a261-e8db-42de-b882-e7321533a34b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:02.137769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 120/245] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:02.166977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd33040-a7bf-44ea-a138-9039f51f6f28 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:02.246981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:02.302965 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd33040-a7bf-44ea-a138-9039f51f6f28 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:02.315318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47a261-e8db-42de-b882-e7321533a34b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:02.344028 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a3925-078d-477e-9a56-0fc7887a2309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:02.344889 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a3925-078d-477e-9a56-0fc7887a2309 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:02.345379 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a3925-078d-477e-9a56-0fc7887a2309 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:02.345836 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a3925-078d-477e-9a56-0fc7887a2309 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:02.357956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a3925-078d-477e-9a56-0fc7887a2309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:02.359382 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbe11b-f9b2-4459-a34b-6cf4b71650d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:02.360041 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbe11b-f9b2-4459-a34b-6cf4b71650d0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:02.360322 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbe11b-f9b2-4459-a34b-6cf4b71650d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:02.360632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbe11b-f9b2-4459-a34b-6cf4b71650d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:02.366528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-425a3925-078d-477e-9a56-0fc7887a2309 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:27:02.366528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:02.366528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:02.366528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:02.366528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:02.366528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:02.366528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:02.366528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:02.366528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:02.366528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:02.366528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:02.366528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:02.366528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:02.366528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:02.366528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:02.366528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:02.367430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:02.367430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:02.367430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:02.367430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:02.367430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:02.367430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:02.367430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:02.367430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:02.367430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:02.367430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:02.367430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:02.367430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:02.367430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:02.367430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:02.367430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:02.367430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:02.368235 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:02.368235 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:02.368235 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:02.368235 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:02.368235 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:02.368235 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:02.368235 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:02.368235 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:02.368235 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:02.368235 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:02.368235 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:27:02.368235 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:02.368235 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 121/246] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:02.369384 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b19fea-8b2f-42b6-9b68-deb56693c9e5 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:02.370028 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b19fea-8b2f-42b6-9b68-deb56693c9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:02.370028 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b19fea-8b2f-42b6-9b68-deb56693c9e5 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:02.371412 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 122/247] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:02.376614 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b19fea-8b2f-42b6-9b68-deb56693c9e5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:02.393998 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:02.455600 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbe11b-f9b2-4459-a34b-6cf4b71650d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:02.457147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbe11b-f9b2-4459-a34b-6cf4b71650d0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:02.502653 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b19fea-8b2f-42b6-9b68-deb56693c9e5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:02.531261 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:02.550603 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32341f59-164d-423a-81d5-5af25e4ad434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:02.551670 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32341f59-164d-423a-81d5-5af25e4ad434 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:02.551961 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32341f59-164d-423a-81d5-5af25e4ad434 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:02.552236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32341f59-164d-423a-81d5-5af25e4ad434 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:02.553640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32341f59-164d-423a-81d5-5af25e4ad434 None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:02.553903 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32341f59-164d-423a-81d5-5af25e4ad434 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:02.556353 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32341f59-164d-423a-81d5-5af25e4ad434 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:02.567047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 123/248] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:27:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:02.568142 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b02954-c9b9-484d-8fe7-7aff6fdff6ae None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:02.568436 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b02954-c9b9-484d-8fe7-7aff6fdff6ae None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:02.568752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b02954-c9b9-484d-8fe7-7aff6fdff6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:02.592442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 126/249] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 10:27:02.592674 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-80b02954-c9b9-484d-8fe7-7aff6fdff6ae None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:02.593740 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbe11b-f9b2-4459-a34b-6cf4b71650d0 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:02.593928 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-80b02954-c9b9-484d-8fe7-7aff6fdff6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:02.674727 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 124/250] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:02.676055 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b02954-c9b9-484d-8fe7-7aff6fdff6ae None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:02.679558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:02.756116 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbe11b-f9b2-4459-a34b-6cf4b71650d0 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:02.785983 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b02954-c9b9-484d-8fe7-7aff6fdff6ae None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:02.805150 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9a808-1daa-43f1-a907-692e254cecd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:02.806890 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9a808-1daa-43f1-a907-692e254cecd9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:02.807580 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9a808-1daa-43f1-a907-692e254cecd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:02.808255 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9a808-1daa-43f1-a907-692e254cecd9 None admin] PATH_INFO: `/v3/users/1678f7157aaa4e83a8da7a05f71796b8` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:02.810403 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9a808-1daa-43f1-a907-692e254cecd9 None admin] RBAC: Authorizing `identity:get_user(user_id=1678f7157aaa4e83a8da7a05f71796b8)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:02.813006 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9a808-1daa-43f1-a907-692e254cecd9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:02.815506 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 127/251] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:27:02 2022] GET /identity/v3/users/1678f7157aaa4e83a8da7a05f71796b8 => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:02.817117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22cc8c-fe8a-4904-8aa1-e1443d616052 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:02.817633 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22cc8c-fe8a-4904-8aa1-e1443d616052 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:02.818104 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22cc8c-fe8a-4904-8aa1-e1443d616052 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:02.820290 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 128/252] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:02.821677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22cc8c-fe8a-4904-8aa1-e1443d616052 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:02.834148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53714d07-18e7-4c96-88ba-1cb570518b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:02.835598 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53714d07-18e7-4c96-88ba-1cb570518b80 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:02.835881 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53714d07-18e7-4c96-88ba-1cb570518b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:02.836162 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53714d07-18e7-4c96-88ba-1cb570518b80 None admin] PATH_INFO: `/v3/projects/0a89ccc08f1b4490a6206c230a1720ff` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:02.837408 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53714d07-18e7-4c96-88ba-1cb570518b80 None admin] RBAC: Authorizing `identity:get_project(project_id=0a89ccc08f1b4490a6206c230a1720ff)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:02.839367 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53714d07-18e7-4c96-88ba-1cb570518b80 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:02.848540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 125/253] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:27:02 2022] GET /identity/v3/projects/0a89ccc08f1b4490a6206c230a1720ff => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:02.848540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53714d07-18e7-4c96-88ba-1cb570518b80 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:02.866822 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:02.936879 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:02.954008 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22cc8c-fe8a-4904-8aa1-e1443d616052 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:02.976004 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53714d07-18e7-4c96-88ba-1cb570518b80 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:02.998869 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bd904-3bbb-433f-a5bf-c5b40d0f2464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:03.000091 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bd904-3bbb-433f-a5bf-c5b40d0f2464 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:03.000400 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bd904-3bbb-433f-a5bf-c5b40d0f2464 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:03.000888 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bd904-3bbb-433f-a5bf-c5b40d0f2464 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:03.015224 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee5cae-b743-4c55-bb05-d31ff47c2b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:03.015785 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8bd904-3bbb-433f-a5bf-c5b40d0f2464 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:03.016656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee5cae-b743-4c55-bb05-d31ff47c2b04 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:03.017183 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee5cae-b743-4c55-bb05-d31ff47c2b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:03.017674 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee5cae-b743-4c55-bb05-d31ff47c2b04 None admin] PATH_INFO: `/v3/projects/0a89ccc08f1b4490a6206c230a1720ff` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:03.019089 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee5cae-b743-4c55-bb05-d31ff47c2b04 None admin] RBAC: Authorizing `identity:get_project(project_id=0a89ccc08f1b4490a6206c230a1720ff)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:03.020947 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee5cae-b743-4c55-bb05-d31ff47c2b04 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:03.022914 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 126/254] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:27:02 2022] GET /identity/v3/projects/0a89ccc08f1b4490a6206c230a1720ff => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:03.023700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-6b8bd904-3bbb-433f-a5bf-c5b40d0f2464 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:27:03.023700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:03.023700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:03.023700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:03.023700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:03.023700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:03.023700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:03.023700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:03.023700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:03.023700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:03.023700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:03.023700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:03.023700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:03.023700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:03.023700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:03.023700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:03.024613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:03.024613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:03.024613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:03.024613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:03.024613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:03.024613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:03.024613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:03.024613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:03.024613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:03.024613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:03.024613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:03.024613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:03.024613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:03.024613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:03.024613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:03.024613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:03.025423 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:03.025423 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:03.025423 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:03.025423 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:03.025423 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:03.025423 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:03.025423 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:03.025423 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:03.025423 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:03.025423 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:03.025423 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:27:03.025423 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:03.025423 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 129/255] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:27:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:03.026542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bd904-3bbb-433f-a5bf-c5b40d0f2464 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:03.027811 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d7769-0440-4f67-86b9-dc10cdef92ef None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:03.028379 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d7769-0440-4f67-86b9-dc10cdef92ef None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:03.031421 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d7769-0440-4f67-86b9-dc10cdef92ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:03.049467 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1a6d7769-0440-4f67-86b9-dc10cdef92ef None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:03.050988 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1a6d7769-0440-4f67-86b9-dc10cdef92ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:03.127102 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 127/256] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:03.128866 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d7769-0440-4f67-86b9-dc10cdef92ef None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:03.151038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:03.177073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bd904-3bbb-433f-a5bf-c5b40d0f2464 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:03.219476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:03.226223 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e1421-bb92-49b6-b092-7b55ed30374f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:03.227071 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e1421-bb92-49b6-b092-7b55ed30374f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:03.227499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e1421-bb92-49b6-b092-7b55ed30374f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:03.227940 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e1421-bb92-49b6-b092-7b55ed30374f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:03.229498 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e1421-bb92-49b6-b092-7b55ed30374f None admin] RBAC: Adding query filter params (role.id=b3bea9d8f5294a5b8aaecb6c9bfeee6a, scope.project.id=0a89ccc08f1b4490a6206c230a1720ff, user.id=fa707faac66e4209b2a3dcfc3d3f78e7) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:03.229984 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e1421-bb92-49b6-b092-7b55ed30374f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:03.232628 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e1421-bb92-49b6-b092-7b55ed30374f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:03.241142 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 130/257] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:27:03 2022] GET /identity/v3/role_assignments?user.id=fa707faac66e4209b2a3dcfc3d3f78e7&scope.project.id=0a89ccc08f1b4490a6206c230a1720ff&role.id=b3bea9d8f5294a5b8aaecb6c9bfeee6a => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:03.242186 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e1421-bb92-49b6-b092-7b55ed30374f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:03.275876 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d7769-0440-4f67-86b9-dc10cdef92ef None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:03.368404 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e1421-bb92-49b6-b092-7b55ed30374f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:03.378766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716a949-b825-4034-ae88-4b63691fd16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:03.379884 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716a949-b825-4034-ae88-4b63691fd16e None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:03.380170 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716a949-b825-4034-ae88-4b63691fd16e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:03.380606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716a949-b825-4034-ae88-4b63691fd16e None admin] PATH_INFO: `/v3/projects/0a89ccc08f1b4490a6206c230a1720ff/users/1678f7157aaa4e83a8da7a05f71796b8/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:03.389454 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716a949-b825-4034-ae88-4b63691fd16e None admin] RBAC: Authorizing `identity:create_grant(project_id=0a89ccc08f1b4490a6206c230a1720ff, user_id=1678f7157aaa4e83a8da7a05f71796b8, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:03.391037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716a949-b825-4034-ae88-4b63691fd16e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:03.410383 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba820a-2337-4589-b243-495db0568945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:03.411390 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba820a-2337-4589-b243-495db0568945 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:03.411848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba820a-2337-4589-b243-495db0568945 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:03.412301 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba820a-2337-4589-b243-495db0568945 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:03.413277 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba820a-2337-4589-b243-495db0568945 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:03.413766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba820a-2337-4589-b243-495db0568945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:03.414877 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 128/258] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 30 10:27:03 2022] PUT /identity/v3/projects/0a89ccc08f1b4490a6206c230a1720ff/users/1678f7157aaa4e83a8da7a05f71796b8/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:27:03.415719 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba820a-2337-4589-b243-495db0568945 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:03.415827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716a949-b825-4034-ae88-4b63691fd16e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:03.426564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 131/259] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:03.438143 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba820a-2337-4589-b243-495db0568945 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:03.459618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:03.561466 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba820a-2337-4589-b243-495db0568945 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:03.586231 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716a949-b825-4034-ae88-4b63691fd16e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:03.609501 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa801a7-e618-4f0b-88fa-b53a78a4baea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:03.612091 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa801a7-e618-4f0b-88fa-b53a78a4baea None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:03.613133 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa801a7-e618-4f0b-88fa-b53a78a4baea None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:03.613735 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa801a7-e618-4f0b-88fa-b53a78a4baea None admin] PATH_INFO: `/v3/users/87dd676434324d01be989308e6cc05d3` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:03.620967 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa801a7-e618-4f0b-88fa-b53a78a4baea None admin] RBAC: Authorizing `identity:get_user(user_id=87dd676434324d01be989308e6cc05d3)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:03.624535 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa801a7-e618-4f0b-88fa-b53a78a4baea None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:03.628249 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 132/260] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:27:03 2022] GET /identity/v3/users/87dd676434324d01be989308e6cc05d3 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:03.636047 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa801a7-e618-4f0b-88fa-b53a78a4baea None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:03.664997 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:03.679359 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086b9c4-1198-4b00-b4dd-a1c138800041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:03.680631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086b9c4-1198-4b00-b4dd-a1c138800041 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:03.682807 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086b9c4-1198-4b00-b4dd-a1c138800041 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:03.683347 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086b9c4-1198-4b00-b4dd-a1c138800041 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:03.711403 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086b9c4-1198-4b00-b4dd-a1c138800041 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:03.722263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-1086b9c4-1198-4b00-b4dd-a1c138800041 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:27:03.722263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:03.722263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:03.722263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:03.722263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:03.722263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:03.722263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:03.722263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:03.722263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:03.722263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:03.722263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:03.722263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:03.722263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:03.722263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:03.722263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:03.722263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:03.723428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:03.723428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:03.723428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:03.723428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:03.723428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:03.723428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:03.723428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:03.723428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:03.723428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:03.723428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:03.723428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:03.723428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:03.723428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:03.723428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:03.723428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:03.723428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:03.724211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:03.724211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:03.724211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:03.724211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:03.724211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:03.724211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:03.724211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:03.724211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:03.724211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:03.724211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:03.724211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:27:03.724211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:03.730534 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 129/261] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 30 10:27:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:03.734310 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086b9c4-1198-4b00-b4dd-a1c138800041 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:03.796718 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:03.834204 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa801a7-e618-4f0b-88fa-b53a78a4baea None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:03.889994 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086b9c4-1198-4b00-b4dd-a1c138800041 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:03.936433 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479714e-45bb-49e4-bf0c-25ed65088c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:03.937603 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479714e-45bb-49e4-bf0c-25ed65088c93 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:03.937889 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479714e-45bb-49e4-bf0c-25ed65088c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:03.938163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479714e-45bb-49e4-bf0c-25ed65088c93 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:03.938909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479714e-45bb-49e4-bf0c-25ed65088c93 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:03.939216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479714e-45bb-49e4-bf0c-25ed65088c93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:03.940634 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479714e-45bb-49e4-bf0c-25ed65088c93 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:03.944990 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e8595-7cee-4fdb-8603-adef853be68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:03.945719 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e8595-7cee-4fdb-8603-adef853be68c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:03.946006 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e8595-7cee-4fdb-8603-adef853be68c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:03.946284 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e8595-7cee-4fdb-8603-adef853be68c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:03.963195 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 130/262] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:27:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:03.986019 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479714e-45bb-49e4-bf0c-25ed65088c93 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:04.076196 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:04.086762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e8595-7cee-4fdb-8603-adef853be68c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:04.088360 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e8595-7cee-4fdb-8603-adef853be68c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:04.135628 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479714e-45bb-49e4-bf0c-25ed65088c93 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:04.177396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421aa162-8745-459d-8332-fbbc7b832d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:04.178637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421aa162-8745-459d-8332-fbbc7b832d80 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:04.179087 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421aa162-8745-459d-8332-fbbc7b832d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:04.179757 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421aa162-8745-459d-8332-fbbc7b832d80 None admin] PATH_INFO: `/v3/users/87dd676434324d01be989308e6cc05d3` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:04.181608 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421aa162-8745-459d-8332-fbbc7b832d80 None admin] RBAC: Authorizing `identity:get_user(user_id=87dd676434324d01be989308e6cc05d3)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:04.183544 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421aa162-8745-459d-8332-fbbc7b832d80 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:04.186253 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 131/263] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:27:03 2022] GET /identity/v3/users/87dd676434324d01be989308e6cc05d3 => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:04.193696 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421aa162-8745-459d-8332-fbbc7b832d80 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:04.252240 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:04.330038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421aa162-8745-459d-8332-fbbc7b832d80 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:04.347483 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 133/264] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 712 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:27:04.352528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:04.353259 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e8595-7cee-4fdb-8603-adef853be68c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:04.375098 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa95702-4cbe-45ff-9c91-9e88a65661dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:04.375752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa95702-4cbe-45ff-9c91-9e88a65661dd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:04.376034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa95702-4cbe-45ff-9c91-9e88a65661dd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:04.376311 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa95702-4cbe-45ff-9c91-9e88a65661dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:04.455854 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa95702-4cbe-45ff-9c91-9e88a65661dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:04.457284 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa95702-4cbe-45ff-9c91-9e88a65661dd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:04.571041 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 132/265] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:27:04.576997 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa95702-4cbe-45ff-9c91-9e88a65661dd None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:04.600368 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:04.602642 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e8595-7cee-4fdb-8603-adef853be68c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:04.685975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab45a30-29f9-47a3-a279-32e62e2c56f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:04.686845 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab45a30-29f9-47a3-a279-32e62e2c56f4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:04.687128 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab45a30-29f9-47a3-a279-32e62e2c56f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:04.687404 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab45a30-29f9-47a3-a279-32e62e2c56f4 None admin] PATH_INFO: `/v3/projects/0a89ccc08f1b4490a6206c230a1720ff` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:04.691887 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa95702-4cbe-45ff-9c91-9e88a65661dd None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:04.693268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab45a30-29f9-47a3-a279-32e62e2c56f4 None admin] RBAC: Authorizing `identity:get_project(project_id=0a89ccc08f1b4490a6206c230a1720ff)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:04.694747 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab45a30-29f9-47a3-a279-32e62e2c56f4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:04.696885 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 134/266] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:27:04 2022] GET /identity/v3/projects/0a89ccc08f1b4490a6206c230a1720ff => generated 302 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:04.702743 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab45a30-29f9-47a3-a279-32e62e2c56f4 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:04.731316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941322db-5b62-48f5-af23-bc480ead67c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:04.732168 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941322db-5b62-48f5-af23-bc480ead67c7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:04.732449 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941322db-5b62-48f5-af23-bc480ead67c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:04.732752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941322db-5b62-48f5-af23-bc480ead67c7 None admin] PATH_INFO: `/v3/projects/0a89ccc08f1b4490a6206c230a1720ff` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:04.733942 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941322db-5b62-48f5-af23-bc480ead67c7 None admin] RBAC: Authorizing `identity:get_project(project_id=0a89ccc08f1b4490a6206c230a1720ff)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:04.735455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941322db-5b62-48f5-af23-bc480ead67c7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:04.738002 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 133/267] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:27:04 2022] GET /identity/v3/projects/0a89ccc08f1b4490a6206c230a1720ff => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:04.743865 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941322db-5b62-48f5-af23-bc480ead67c7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:04.787563 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:04.853991 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab45a30-29f9-47a3-a279-32e62e2c56f4 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:04.871523 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:04.885913 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941322db-5b62-48f5-af23-bc480ead67c7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:04.900390 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a30b49-a8a9-4b3a-9cfd-9de1dd89fe69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:04.901327 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a30b49-a8a9-4b3a-9cfd-9de1dd89fe69 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:04.901610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a30b49-a8a9-4b3a-9cfd-9de1dd89fe69 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:04.902350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a30b49-a8a9-4b3a-9cfd-9de1dd89fe69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:04.904061 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a30b49-a8a9-4b3a-9cfd-9de1dd89fe69 None admin] RBAC: Adding query filter params (role.id=ab64ea6d0475430195af26a049485569, scope.project.id=0a89ccc08f1b4490a6206c230a1720ff, user.id=87dd676434324d01be989308e6cc05d3) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:04.904380 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a30b49-a8a9-4b3a-9cfd-9de1dd89fe69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:04.906489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a30b49-a8a9-4b3a-9cfd-9de1dd89fe69 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:04.914366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 135/268] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:27:04 2022] GET /identity/v3/role_assignments?user.id=87dd676434324d01be989308e6cc05d3&scope.project.id=0a89ccc08f1b4490a6206c230a1720ff&role.id=ab64ea6d0475430195af26a049485569 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:04.915937 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5312f7-8c62-4a56-9ca1-68bff0bb9160 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:04.916622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5312f7-8c62-4a56-9ca1-68bff0bb9160 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:04.916904 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5312f7-8c62-4a56-9ca1-68bff0bb9160 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:04.919094 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 136/269] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:04.920857 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3f44f-fcf2-48c8-907f-2267a0dde8c5 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:04.921145 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3f44f-fcf2-48c8-907f-2267a0dde8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:04.921421 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3f44f-fcf2-48c8-907f-2267a0dde8c5 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:04.922681 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 137/270] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:04.923710 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67d5ae-50dd-431a-8788-8bc67a35a510 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:04.923993 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67d5ae-50dd-431a-8788-8bc67a35a510 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:04.924268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67d5ae-50dd-431a-8788-8bc67a35a510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:04.931852 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb687b1-ae28-484c-b80c-23fdde154e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:04.934321 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb687b1-ae28-484c-b80c-23fdde154e73 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:04.934680 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb687b1-ae28-484c-b80c-23fdde154e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:04.934964 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb687b1-ae28-484c-b80c-23fdde154e73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:04.935849 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb687b1-ae28-484c-b80c-23fdde154e73 None admin] RBAC: Adding query filter params (role.id=2d85fe2aee9740f984e944e0d5c80ec5, scope.project.id=0a89ccc08f1b4490a6206c230a1720ff, user.id=87dd676434324d01be989308e6cc05d3) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:04.936169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb687b1-ae28-484c-b80c-23fdde154e73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:04.937722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb687b1-ae28-484c-b80c-23fdde154e73 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:04.955020 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 134/271] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:27:04 2022] GET /identity/v3/role_assignments?user.id=87dd676434324d01be989308e6cc05d3&scope.project.id=0a89ccc08f1b4490a6206c230a1720ff&role.id=2d85fe2aee9740f984e944e0d5c80ec5 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:04.956332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319e88c-74c3-4c09-a1e0-ae9e5c437c3e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:04.956647 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319e88c-74c3-4c09-a1e0-ae9e5c437c3e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:04.956928 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319e88c-74c3-4c09-a1e0-ae9e5c437c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:04.962600 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0d67d5ae-50dd-431a-8788-8bc67a35a510 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:04.963826 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0d67d5ae-50dd-431a-8788-8bc67a35a510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:04.997773 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e319e88c-74c3-4c09-a1e0-ae9e5c437c3e None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:05.001708 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e319e88c-74c3-4c09-a1e0-ae9e5c437c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:05.113616 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 135/272] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:05.127611 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 138/273] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:27:05.139403 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319e88c-74c3-4c09-a1e0-ae9e5c437c3e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:05.165523 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67d5ae-50dd-431a-8788-8bc67a35a510 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:05.241189 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:05.267656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319e88c-74c3-4c09-a1e0-ae9e5c437c3e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:05.268017 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:05.302733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39895c5-d9b7-40ff-ab94-43bf45227c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:05.303579 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39895c5-d9b7-40ff-ab94-43bf45227c3e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:05.303868 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39895c5-d9b7-40ff-ab94-43bf45227c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:05.304143 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39895c5-d9b7-40ff-ab94-43bf45227c3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:05.315928 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39895c5-d9b7-40ff-ab94-43bf45227c3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:05.324749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-b39895c5-d9b7-40ff-ab94-43bf45227c3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:27:05.324749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:05.324749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:05.324749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:05.324749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:05.324749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:05.324749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:05.324749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:05.324749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:05.324749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:05.324749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:05.324749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:05.324749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:05.324749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:05.324749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:05.324749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:05.326207 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:05.326207 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:05.326207 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:05.326207 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:05.326207 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:05.326207 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:05.326207 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:05.326207 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:05.326207 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:05.326207 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:05.326207 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:05.326207 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:05.326207 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:05.326207 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:05.326207 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:05.326207 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:05.327003 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:05.327003 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:05.327003 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:05.327003 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:05.327003 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:05.327003 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:05.327003 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:05.327003 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:05.327003 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:05.327003 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:05.327003 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:27:05.327003 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:05.327003 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 136/274] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:05.332427 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39895c5-d9b7-40ff-ab94-43bf45227c3e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:05.346857 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67d5ae-50dd-431a-8788-8bc67a35a510 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:05.383425 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6e70b-b534-498c-b6b8-5d5575614914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:05.384226 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6e70b-b534-498c-b6b8-5d5575614914 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:05.384558 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6e70b-b534-498c-b6b8-5d5575614914 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:05.384807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6e70b-b534-498c-b6b8-5d5575614914 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:05.386080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6e70b-b534-498c-b6b8-5d5575614914 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:05.388198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6e70b-b534-498c-b6b8-5d5575614914 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:05.390271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 139/275] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:05.395354 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6e70b-b534-498c-b6b8-5d5575614914 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:05.440762 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39895c5-d9b7-40ff-ab94-43bf45227c3e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:05.483593 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc76c93-50ac-4293-8620-35afd28f058e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:05.484344 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc76c93-50ac-4293-8620-35afd28f058e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:05.484612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc76c93-50ac-4293-8620-35afd28f058e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:05.484896 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc76c93-50ac-4293-8620-35afd28f058e None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:05.485660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc76c93-50ac-4293-8620-35afd28f058e None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:05.485971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc76c93-50ac-4293-8620-35afd28f058e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:05.487425 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc76c93-50ac-4293-8620-35afd28f058e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:05.499860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 137/276] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:27:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:05.505611 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc76c93-50ac-4293-8620-35afd28f058e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:05.511419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:05.530057 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6e70b-b534-498c-b6b8-5d5575614914 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:05.544757 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:05.576521 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c99f69-3145-4ea3-adae-34981658ae37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:05.577604 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c99f69-3145-4ea3-adae-34981658ae37 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:05.577887 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c99f69-3145-4ea3-adae-34981658ae37 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:05.578168 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c99f69-3145-4ea3-adae-34981658ae37 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:05.578888 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c99f69-3145-4ea3-adae-34981658ae37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:05.580901 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c99f69-3145-4ea3-adae-34981658ae37 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:05.605300 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 140/277] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 30 10:27:05 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:27:05.643476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc76c93-50ac-4293-8620-35afd28f058e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:05.684946 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3cb32-4cb5-48f9-b80b-2d6716f0d708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:05.686198 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3cb32-4cb5-48f9-b80b-2d6716f0d708 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:05.686702 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3cb32-4cb5-48f9-b80b-2d6716f0d708 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:05.687159 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3cb32-4cb5-48f9-b80b-2d6716f0d708 None admin] PATH_INFO: `/v3/users/31835e2a6dbd4385882eee34519ecfad` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:05.703786 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3cb32-4cb5-48f9-b80b-2d6716f0d708 None admin] RBAC: Authorizing `identity:get_user(user_id=31835e2a6dbd4385882eee34519ecfad)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:05.705614 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3cb32-4cb5-48f9-b80b-2d6716f0d708 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:05.707600 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 138/278] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:27:05 2022] GET /identity/v3/users/31835e2a6dbd4385882eee34519ecfad => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:05.713693 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c99f69-3145-4ea3-adae-34981658ae37 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:05.820350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c99f69-3145-4ea3-adae-34981658ae37 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:05.856185 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74043ec7-ed48-44e0-99f1-ce89778a5167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:05.856884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74043ec7-ed48-44e0-99f1-ce89778a5167 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:05.857222 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74043ec7-ed48-44e0-99f1-ce89778a5167 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:05.857499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74043ec7-ed48-44e0-99f1-ce89778a5167 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:05.858436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74043ec7-ed48-44e0-99f1-ce89778a5167 None admin] RBAC: Adding query filter params (role.id=c68f9f9f32ac40dba0d180dd3f5582bb, user.id=31835e2a6dbd4385882eee34519ecfad, scope.system=all) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:05.858753 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74043ec7-ed48-44e0-99f1-ce89778a5167 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:05.860197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74043ec7-ed48-44e0-99f1-ce89778a5167 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:05.865897 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 141/279] 10.222.0.59 () {56 vars in 1308 bytes} [Thu Jun 30 10:27:05 2022] GET /identity/v3/role_assignments?user.id=31835e2a6dbd4385882eee34519ecfad&scope.system=all&role.id=c68f9f9f32ac40dba0d180dd3f5582bb => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:06.176754 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85e265-65b9-4c7d-87fd-6e06e3be1ec2 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:06.177443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85e265-65b9-4c7d-87fd-6e06e3be1ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:06.177955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85e265-65b9-4c7d-87fd-6e06e3be1ec2 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:06.179817 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 139/280] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:06.185863 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb6a5f-875f-45a1-9c5e-38aebbd665aa None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:06.186442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb6a5f-875f-45a1-9c5e-38aebbd665aa None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:06.186926 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb6a5f-875f-45a1-9c5e-38aebbd665aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:06.205028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-1deb6a5f-875f-45a1-9c5e-38aebbd665aa None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:06.206511 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1deb6a5f-875f-45a1-9c5e-38aebbd665aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:06.244129 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:06.318867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 142/281] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:06.362682 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85e265-65b9-4c7d-87fd-6e06e3be1ec2 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:06.429948 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:06.472128 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85e265-65b9-4c7d-87fd-6e06e3be1ec2 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:06.487098 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca9a98-4986-4c0a-8531-8fde3dd0c828 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:06.487406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca9a98-4986-4c0a-8531-8fde3dd0c828 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:06.487672 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca9a98-4986-4c0a-8531-8fde3dd0c828 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:06.490376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 143/282] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:27:06.494667 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e1f75-8447-48a4-b4d5-9c28b9629a07 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:06.494955 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e1f75-8447-48a4-b4d5-9c28b9629a07 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:06.495232 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e1f75-8447-48a4-b4d5-9c28b9629a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:06.518207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-436e1f75-8447-48a4-b4d5-9c28b9629a07 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:06.518388 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c42850-ff76-4790-acb7-d3c3b62d024d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:06.519053 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c42850-ff76-4790-acb7-d3c3b62d024d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:06.519342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c42850-ff76-4790-acb7-d3c3b62d024d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:06.519525 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-436e1f75-8447-48a4-b4d5-9c28b9629a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:06.519617 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c42850-ff76-4790-acb7-d3c3b62d024d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:06.538219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c42850-ff76-4790-acb7-d3c3b62d024d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:06.556418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-68c42850-ff76-4790-acb7-d3c3b62d024d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:27:06.556418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:06.556418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:06.556418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:06.556418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:06.556418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:06.556418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:06.556418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:06.556418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:06.556418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:06.556418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:06.556418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:06.556418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:06.556418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:06.556418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:06.556418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:06.557373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:06.557373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:06.557373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:06.557373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:06.557373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:06.557373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:06.557373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:06.557373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:06.557373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:06.557373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:06.557373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:06.557373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:06.557373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:06.557373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:06.557373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:06.557373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:06.558164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:06.558164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:06.558164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:06.558164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:06.558164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:06.558164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:06.558164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:06.558164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:06.558164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:06.558164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:06.558164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:27:06.558164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:06.558164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 140/283] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:06.565319 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c42850-ff76-4790-acb7-d3c3b62d024d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:06.592683 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 144/284] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:27:06.630105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e1f75-8447-48a4-b4d5-9c28b9629a07 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:06.693601 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c42850-ff76-4790-acb7-d3c3b62d024d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:06.717078 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:06.732899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:06.746423 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded069d-6319-4519-8716-3740b16ad13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:06.750542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e1f75-8447-48a4-b4d5-9c28b9629a07 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:06.752381 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded069d-6319-4519-8716-3740b16ad13b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:06.752700 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded069d-6319-4519-8716-3740b16ad13b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:06.752980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded069d-6319-4519-8716-3740b16ad13b None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:06.753743 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded069d-6319-4519-8716-3740b16ad13b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:06.754111 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded069d-6319-4519-8716-3740b16ad13b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:06.755560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded069d-6319-4519-8716-3740b16ad13b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:06.772348 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 141/285] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:27:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:06.777488 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded069d-6319-4519-8716-3740b16ad13b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:06.791517 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f603af-0215-4bbf-a943-9e0096e837f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:06.792379 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f603af-0215-4bbf-a943-9e0096e837f4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:06.792694 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f603af-0215-4bbf-a943-9e0096e837f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:06.792969 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f603af-0215-4bbf-a943-9e0096e837f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:06.803835 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f603af-0215-4bbf-a943-9e0096e837f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:06.812282 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-26f603af-0215-4bbf-a943-9e0096e837f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:27:06.812282 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:06.812282 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:06.812282 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:06.812282 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:06.812282 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:06.812282 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:06.812282 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:06.812282 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:06.812282 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:06.812282 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:06.812282 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:06.812282 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:06.812282 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:06.812282 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:06.812282 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:06.813372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:06.813372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:06.813372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:06.813372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:06.813372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:06.813372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:06.813372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:06.813372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:06.813372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:06.813372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:06.813372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:06.813372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:06.813372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:06.813372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:06.813372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:06.813372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:06.814366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:06.814366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:06.814366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:06.814366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:06.814366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:06.814366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:06.814366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:06.814366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:06.814366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:06.814366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:06.814366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:27:06.814366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:06.814366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 145/286] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:27:06.836367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f603af-0215-4bbf-a943-9e0096e837f4 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:06.922340 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded069d-6319-4519-8716-3740b16ad13b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:06.975949 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f603af-0215-4bbf-a943-9e0096e837f4 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:06.992998 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd597e-f654-472f-a3a2-da09df42f2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:06.993873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd597e-f654-472f-a3a2-da09df42f2da None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:06.994303 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd597e-f654-472f-a3a2-da09df42f2da None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:06.994590 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd597e-f654-472f-a3a2-da09df42f2da None admin] PATH_INFO: `/v3/users/fa707faac66e4209b2a3dcfc3d3f78e7` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:06.999532 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd597e-f654-472f-a3a2-da09df42f2da None admin] RBAC: Authorizing `identity:get_user(user_id=fa707faac66e4209b2a3dcfc3d3f78e7)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:07.003753 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd597e-f654-472f-a3a2-da09df42f2da None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:07.007764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 142/287] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:27:06 2022] GET /identity/v3/users/fa707faac66e4209b2a3dcfc3d3f78e7 => generated 297 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:07.010672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd597e-f654-472f-a3a2-da09df42f2da None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:07.049872 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96daf86c-7a9a-4ce5-b0cd-4e5252983258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:07.050555 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96daf86c-7a9a-4ce5-b0cd-4e5252983258 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:07.050842 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96daf86c-7a9a-4ce5-b0cd-4e5252983258 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:07.051117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96daf86c-7a9a-4ce5-b0cd-4e5252983258 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:07.051868 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96daf86c-7a9a-4ce5-b0cd-4e5252983258 None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:07.052178 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96daf86c-7a9a-4ce5-b0cd-4e5252983258 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:07.053638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96daf86c-7a9a-4ce5-b0cd-4e5252983258 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:07.074491 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 146/288] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:27:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:07.080717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96daf86c-7a9a-4ce5-b0cd-4e5252983258 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:07.107834 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:07.116980 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:07.177091 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd597e-f654-472f-a3a2-da09df42f2da None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:07.214483 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df346d-9c1e-4308-91e8-6a87acc84076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:07.215342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df346d-9c1e-4308-91e8-6a87acc84076 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:07.215651 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df346d-9c1e-4308-91e8-6a87acc84076 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:07.215928 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df346d-9c1e-4308-91e8-6a87acc84076 None admin] PATH_INFO: `/v3/projects/0a89ccc08f1b4490a6206c230a1720ff` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:07.217450 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df346d-9c1e-4308-91e8-6a87acc84076 None admin] RBAC: Authorizing `identity:get_project(project_id=0a89ccc08f1b4490a6206c230a1720ff)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:07.219360 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df346d-9c1e-4308-91e8-6a87acc84076 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:07.221528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 143/289] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:27:07 2022] GET /identity/v3/projects/0a89ccc08f1b4490a6206c230a1720ff => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:07.227436 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df346d-9c1e-4308-91e8-6a87acc84076 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:07.293036 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96daf86c-7a9a-4ce5-b0cd-4e5252983258 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:07.327844 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a303f25-6cdc-41d5-8874-e7dd23557a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:07.328732 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a303f25-6cdc-41d5-8874-e7dd23557a11 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:07.329011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a303f25-6cdc-41d5-8874-e7dd23557a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:07.329284 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a303f25-6cdc-41d5-8874-e7dd23557a11 None admin] PATH_INFO: `/v3/users/1678f7157aaa4e83a8da7a05f71796b8` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:07.330457 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a303f25-6cdc-41d5-8874-e7dd23557a11 None admin] RBAC: Authorizing `identity:get_user(user_id=1678f7157aaa4e83a8da7a05f71796b8)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:07.331880 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a303f25-6cdc-41d5-8874-e7dd23557a11 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:07.333815 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 147/290] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:27:07 2022] GET /identity/v3/users/1678f7157aaa4e83a8da7a05f71796b8 => generated 297 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:07.338868 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a303f25-6cdc-41d5-8874-e7dd23557a11 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:07.422218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:07.441498 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a303f25-6cdc-41d5-8874-e7dd23557a11 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:07.451513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df346d-9c1e-4308-91e8-6a87acc84076 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:07.477184 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5ad09-7d05-4226-99a3-bbe3789acd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:07.477892 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5ad09-7d05-4226-99a3-bbe3789acd04 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:07.478118 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5ad09-7d05-4226-99a3-bbe3789acd04 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:07.478538 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5ad09-7d05-4226-99a3-bbe3789acd04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:07.499865 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:07.537011 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae237030-2719-457f-9a2a-156cef3fd9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:07.538877 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae237030-2719-457f-9a2a-156cef3fd9e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:07.539373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae237030-2719-457f-9a2a-156cef3fd9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:07.539929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae237030-2719-457f-9a2a-156cef3fd9e3 None admin] PATH_INFO: `/v3/projects/0a89ccc08f1b4490a6206c230a1720ff/users/fa707faac66e4209b2a3dcfc3d3f78e7/roles/b3bea9d8f5294a5b8aaecb6c9bfeee6a` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:07.542463 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae237030-2719-457f-9a2a-156cef3fd9e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a89ccc08f1b4490a6206c230a1720ff, user_id=fa707faac66e4209b2a3dcfc3d3f78e7, role_id=b3bea9d8f5294a5b8aaecb6c9bfeee6a)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:07.544966 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae237030-2719-457f-9a2a-156cef3fd9e3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:07.554444 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5ad09-7d05-4226-99a3-bbe3789acd04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:07.556364 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5ad09-7d05-4226-99a3-bbe3789acd04 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:07.571154 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 144/291] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 30 10:27:07 2022] PUT /identity/v3/projects/0a89ccc08f1b4490a6206c230a1720ff/users/fa707faac66e4209b2a3dcfc3d3f78e7/roles/b3bea9d8f5294a5b8aaecb6c9bfeee6a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:27:07.643322 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:07.663960 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 148/292] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:27:07.669825 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae237030-2719-457f-9a2a-156cef3fd9e3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:07.790008 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae237030-2719-457f-9a2a-156cef3fd9e3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:07.828990 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb523e8-06e7-4a46-99a9-9ee2b0e4ef78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:07.829852 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb523e8-06e7-4a46-99a9-9ee2b0e4ef78 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:07.830133 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb523e8-06e7-4a46-99a9-9ee2b0e4ef78 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:07.830406 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb523e8-06e7-4a46-99a9-9ee2b0e4ef78 None admin] PATH_INFO: `/v3/projects/0a89ccc08f1b4490a6206c230a1720ff` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:07.831650 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb523e8-06e7-4a46-99a9-9ee2b0e4ef78 None admin] RBAC: Authorizing `identity:get_project(project_id=0a89ccc08f1b4490a6206c230a1720ff)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:07.833236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb523e8-06e7-4a46-99a9-9ee2b0e4ef78 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:07.835314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 145/293] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:27:07 2022] GET /identity/v3/projects/0a89ccc08f1b4490a6206c230a1720ff => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:07.841269 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5ad09-7d05-4226-99a3-bbe3789acd04 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:07.946902 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5ad09-7d05-4226-99a3-bbe3789acd04 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:07.982200 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a136b14-d008-4501-b601-089c9e73fe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:07.982851 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a136b14-d008-4501-b601-089c9e73fe88 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:07.983130 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a136b14-d008-4501-b601-089c9e73fe88 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:07.983403 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a136b14-d008-4501-b601-089c9e73fe88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:07.984218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a136b14-d008-4501-b601-089c9e73fe88 None admin] RBAC: Adding query filter params (role.id=c68f9f9f32ac40dba0d180dd3f5582bb, scope.project.id=0a89ccc08f1b4490a6206c230a1720ff, user.id=1678f7157aaa4e83a8da7a05f71796b8) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:07.984547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a136b14-d008-4501-b601-089c9e73fe88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:07.985995 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a136b14-d008-4501-b601-089c9e73fe88 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:07.992342 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 149/294] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:27:07 2022] GET /identity/v3/role_assignments?user.id=1678f7157aaa4e83a8da7a05f71796b8&scope.project.id=0a89ccc08f1b4490a6206c230a1720ff&role.id=c68f9f9f32ac40dba0d180dd3f5582bb => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:08.219777 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396464bc-a3d9-45c8-ab3d-cdc4caf0e8e3 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:08.220151 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396464bc-a3d9-45c8-ab3d-cdc4caf0e8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:08.220352 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396464bc-a3d9-45c8-ab3d-cdc4caf0e8e3 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:08.221914 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 146/295] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:08.227833 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3026cf0-481e-471c-9ce9-6d0081a0497e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:08.228126 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3026cf0-481e-471c-9ce9-6d0081a0497e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:08.228401 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3026cf0-481e-471c-9ce9-6d0081a0497e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:08.249139 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c3026cf0-481e-471c-9ce9-6d0081a0497e None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:08.250324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c3026cf0-481e-471c-9ce9-6d0081a0497e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:08.260048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de244c3e-b3c1-4e47-85ec-8877f7ac6b68 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:08.260344 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de244c3e-b3c1-4e47-85ec-8877f7ac6b68 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:08.260672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de244c3e-b3c1-4e47-85ec-8877f7ac6b68 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:08.262332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 147/296] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:08.268019 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d164c7-e8a4-42de-881e-8310d3a52a78 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:08.268303 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d164c7-e8a4-42de-881e-8310d3a52a78 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:08.268638 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d164c7-e8a4-42de-881e-8310d3a52a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:08.290290 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-84d164c7-e8a4-42de-881e-8310d3a52a78 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:08.291488 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-84d164c7-e8a4-42de-881e-8310d3a52a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:08.306444 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:08.344689 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:08.349224 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 150/297] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:27:08.376107 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 148/298] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:27:08.376722 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3026cf0-481e-471c-9ce9-6d0081a0497e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:08.399414 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d164c7-e8a4-42de-881e-8310d3a52a78 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:08.510694 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3026cf0-481e-471c-9ce9-6d0081a0497e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:08.517735 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d164c7-e8a4-42de-881e-8310d3a52a78 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:08.549072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fe0c5-ca07-4141-96dc-831d9c9351ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:08.550100 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fe0c5-ca07-4141-96dc-831d9c9351ef None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:08.550524 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fe0c5-ca07-4141-96dc-831d9c9351ef None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:08.550965 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fe0c5-ca07-4141-96dc-831d9c9351ef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:08.562686 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d4844-9ed6-48d0-a00e-2a6ee807b130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:08.563488 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d4844-9ed6-48d0-a00e-2a6ee807b130 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:08.563600 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7fe0c5-ca07-4141-96dc-831d9c9351ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:08.563772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d4844-9ed6-48d0-a00e-2a6ee807b130 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:08.564053 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d4844-9ed6-48d0-a00e-2a6ee807b130 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:08.565290 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d4844-9ed6-48d0-a00e-2a6ee807b130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:08.566762 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d4844-9ed6-48d0-a00e-2a6ee807b130 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:08.572313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 149/299] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:08.576256 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-9e7fe0c5-ca07-4141-96dc-831d9c9351ef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:27:08.576256 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:08.576256 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:08.576256 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:08.576256 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:08.576256 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:08.576256 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:08.576256 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:08.576256 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:08.576256 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:08.576256 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:08.576256 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:08.576256 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:08.576256 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:08.576256 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:08.576256 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:08.577175 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:08.577175 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:08.577175 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:08.577175 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:08.577175 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:08.577175 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:08.577175 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:08.577175 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:08.577175 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:08.577175 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:08.577175 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:08.577175 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:08.577175 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:08.577175 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:08.577175 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:08.577175 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:08.577965 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:08.577965 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:08.577965 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:08.577965 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:08.577965 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:08.577965 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:08.577965 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:08.577965 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:08.577965 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:08.577965 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:08.577965 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:27:08.577965 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:08.578558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d4844-9ed6-48d0-a00e-2a6ee807b130 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:08.579184 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 151/300] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:27:08.584308 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fe0c5-ca07-4141-96dc-831d9c9351ef None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:08.622408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:08.651317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:08.698857 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fe0c5-ca07-4141-96dc-831d9c9351ef None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:08.714605 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d4844-9ed6-48d0-a00e-2a6ee807b130 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:08.735593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772a123-1eae-4312-aa12-c043a16b0417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:08.736256 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772a123-1eae-4312-aa12-c043a16b0417 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:08.736571 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772a123-1eae-4312-aa12-c043a16b0417 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:08.736847 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772a123-1eae-4312-aa12-c043a16b0417 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:08.737768 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772a123-1eae-4312-aa12-c043a16b0417 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:08.738114 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772a123-1eae-4312-aa12-c043a16b0417 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:08.739445 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772a123-1eae-4312-aa12-c043a16b0417 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:08.749023 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 152/301] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:27:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:08.749023 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135bc9f-55ed-4123-89ad-0ed3e795f243 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:08.749023 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135bc9f-55ed-4123-89ad-0ed3e795f243 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:08.749023 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135bc9f-55ed-4123-89ad-0ed3e795f243 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:08.749023 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 153/302] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:08.755239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365ac62-c132-4553-be3c-a4a6dc9836ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:08.755912 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365ac62-c132-4553-be3c-a4a6dc9836ee None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:08.756199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365ac62-c132-4553-be3c-a4a6dc9836ee None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:08.756475 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365ac62-c132-4553-be3c-a4a6dc9836ee None admin] PATH_INFO: `/v3/groups` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:08.757202 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365ac62-c132-4553-be3c-a4a6dc9836ee None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:08.757293 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135bc9f-55ed-4123-89ad-0ed3e795f243 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:08.758690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365ac62-c132-4553-be3c-a4a6dc9836ee None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:08.774256 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 150/303] 10.222.0.59 () {60 vars in 1134 bytes} [Thu Jun 30 10:27:08 2022] POST /identity/v3/groups => generated 229 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:27:08.775783 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf310b-a75e-48f8-868e-857d20f3b0eb None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:08.776080 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf310b-a75e-48f8-868e-857d20f3b0eb None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:08.776360 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf310b-a75e-48f8-868e-857d20f3b0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:08.797002 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6cbf310b-a75e-48f8-868e-857d20f3b0eb None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:08.798560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6cbf310b-a75e-48f8-868e-857d20f3b0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:08.884733 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:08.894111 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135bc9f-55ed-4123-89ad-0ed3e795f243 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:08.904653 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 151/304] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:08.930762 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf310b-a75e-48f8-868e-857d20f3b0eb None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:08.943749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801de757-9542-4424-ac4d-585c6fddb344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:08.944725 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801de757-9542-4424-ac4d-585c6fddb344 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:08.945003 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801de757-9542-4424-ac4d-585c6fddb344 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:08.945509 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801de757-9542-4424-ac4d-585c6fddb344 None admin] PATH_INFO: `/v3/users/e7189cfc8d9240c2a1e4be0f3f447f98` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:08.962090 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801de757-9542-4424-ac4d-585c6fddb344 None admin] RBAC: Authorizing `identity:get_user(user_id=e7189cfc8d9240c2a1e4be0f3f447f98)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:08.963897 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801de757-9542-4424-ac4d-585c6fddb344 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:08.965971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 154/305] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:27:08 2022] GET /identity/v3/users/e7189cfc8d9240c2a1e4be0f3f447f98 => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:08.971515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801de757-9542-4424-ac4d-585c6fddb344 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:08.972070 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:09.056645 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf310b-a75e-48f8-868e-857d20f3b0eb None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:09.096825 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b4143-91de-4dcf-87d3-1a8c38428d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:09.097915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b4143-91de-4dcf-87d3-1a8c38428d54 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:09.098650 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b4143-91de-4dcf-87d3-1a8c38428d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:09.099071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b4143-91de-4dcf-87d3-1a8c38428d54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:09.111476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b4143-91de-4dcf-87d3-1a8c38428d54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:09.113621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801de757-9542-4424-ac4d-585c6fddb344 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:09.119920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-430b4143-91de-4dcf-87d3-1a8c38428d54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:27:09.119920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:09.119920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:09.119920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:09.119920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:09.119920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:09.119920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:09.119920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:09.119920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:09.119920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:09.119920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:09.119920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:09.119920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:09.119920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:09.119920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:09.119920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:09.121017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:09.121017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:09.121017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:09.121017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:09.121017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:09.121017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:09.121017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:09.121017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:09.121017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:09.121017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:09.121017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:09.121017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:09.121017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:09.121017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:09.121017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:09.121017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:09.122370 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:09.122370 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:09.122370 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:09.122370 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:09.122370 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:09.122370 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:09.122370 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:09.122370 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:09.122370 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:09.122370 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:09.122370 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:27:09.122370 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:09.125127 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 152/306] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:27:09.130540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b4143-91de-4dcf-87d3-1a8c38428d54 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:09.153811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb35df-3736-4d4b-8e56-c24501a38d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:09.154567 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb35df-3736-4d4b-8e56-c24501a38d65 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:09.154923 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb35df-3736-4d4b-8e56-c24501a38d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:09.155272 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb35df-3736-4d4b-8e56-c24501a38d65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:09.156161 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb35df-3736-4d4b-8e56-c24501a38d65 None admin] RBAC: Adding query filter params (role.id=b3bea9d8f5294a5b8aaecb6c9bfeee6a, user.id=e7189cfc8d9240c2a1e4be0f3f447f98, scope.system=all) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:09.156574 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb35df-3736-4d4b-8e56-c24501a38d65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:09.158121 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb35df-3736-4d4b-8e56-c24501a38d65 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:09.167949 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 155/307] 10.222.0.59 () {56 vars in 1308 bytes} [Thu Jun 30 10:27:08 2022] GET /identity/v3/role_assignments?user.id=e7189cfc8d9240c2a1e4be0f3f447f98&scope.system=all&role.id=b3bea9d8f5294a5b8aaecb6c9bfeee6a => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:09.251975 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:09.257800 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b4143-91de-4dcf-87d3-1a8c38428d54 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:09.296067 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53828d0b-0ab9-4763-9642-f23f5833f28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:09.296765 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53828d0b-0ab9-4763-9642-f23f5833f28f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:09.297052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53828d0b-0ab9-4763-9642-f23f5833f28f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:09.297330 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53828d0b-0ab9-4763-9642-f23f5833f28f None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:09.298087 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53828d0b-0ab9-4763-9642-f23f5833f28f None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:09.298396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53828d0b-0ab9-4763-9642-f23f5833f28f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:09.299825 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53828d0b-0ab9-4763-9642-f23f5833f28f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:09.309202 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 153/308] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:27:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:09.315497 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb35df-3736-4d4b-8e56-c24501a38d65 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:09.338638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:09.428522 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb35df-3736-4d4b-8e56-c24501a38d65 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:09.464194 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbebde49-a59b-4c63-bb26-9d5c5e31e3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:09.465466 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebde49-a59b-4c63-bb26-9d5c5e31e3fd None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:09.465972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebde49-a59b-4c63-bb26-9d5c5e31e3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:09.466474 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebde49-a59b-4c63-bb26-9d5c5e31e3fd None admin] PATH_INFO: `/v3/users/31835e2a6dbd4385882eee34519ecfad` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:09.467853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbebde49-a59b-4c63-bb26-9d5c5e31e3fd None admin] RBAC: Authorizing `identity:get_user(user_id=31835e2a6dbd4385882eee34519ecfad)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:09.469518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbebde49-a59b-4c63-bb26-9d5c5e31e3fd None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:09.471661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 156/309] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:27:09 2022] GET /identity/v3/users/31835e2a6dbd4385882eee34519ecfad => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:09.477551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53828d0b-0ab9-4763-9642-f23f5833f28f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:09.588867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53828d0b-0ab9-4763-9642-f23f5833f28f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:09.624594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f261699-3bdd-44bc-879f-1d5e7a763931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:09.625466 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f261699-3bdd-44bc-879f-1d5e7a763931 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:09.625747 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f261699-3bdd-44bc-879f-1d5e7a763931 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:09.626025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f261699-3bdd-44bc-879f-1d5e7a763931 None admin] PATH_INFO: `/v3/system/users/31835e2a6dbd4385882eee34519ecfad/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:09.627508 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f261699-3bdd-44bc-879f-1d5e7a763931 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=31835e2a6dbd4385882eee34519ecfad, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:09.628929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f261699-3bdd-44bc-879f-1d5e7a763931 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:09.641703 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 154/310] 10.222.0.59 () {58 vars in 1334 bytes} [Thu Jun 30 10:27:09 2022] PUT /identity/v3/system/users/31835e2a6dbd4385882eee34519ecfad/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:27:10.056461 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b480073-5001-410d-8cab-7bd7356bbf03 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:10.057420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b480073-5001-410d-8cab-7bd7356bbf03 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:10.057899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b480073-5001-410d-8cab-7bd7356bbf03 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:10.060217 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 157/311] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:10.066394 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6dea2-40fd-44d0-bfe6-30d1a9b739a9 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:10.066985 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6dea2-40fd-44d0-bfe6-30d1a9b739a9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:10.067464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6dea2-40fd-44d0-bfe6-30d1a9b739a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:10.085050 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b1c6dea2-40fd-44d0-bfe6-30d1a9b739a9 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:10.086623 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b1c6dea2-40fd-44d0-bfe6-30d1a9b739a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:10.105944 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:10.163081 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 155/312] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:10.186340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b480073-5001-410d-8cab-7bd7356bbf03 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:10.276266 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:10.294148 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b480073-5001-410d-8cab-7bd7356bbf03 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:10.329040 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3388bc-2ad4-4a15-a51f-52fd2ef6a61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:10.330195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3388bc-2ad4-4a15-a51f-52fd2ef6a61b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:10.330674 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3388bc-2ad4-4a15-a51f-52fd2ef6a61b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:10.331166 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3388bc-2ad4-4a15-a51f-52fd2ef6a61b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:10.344349 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3388bc-2ad4-4a15-a51f-52fd2ef6a61b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:10.352895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-2f3388bc-2ad4-4a15-a51f-52fd2ef6a61b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:27:10.352895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:10.352895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:10.352895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:10.352895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:10.352895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:10.352895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:10.352895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:10.352895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:10.352895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:10.352895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:10.352895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:10.352895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:10.352895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:10.352895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:10.352895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:10.353807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:10.353807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:10.353807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:10.353807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:10.353807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:10.353807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:10.353807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:10.353807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:10.353807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:10.353807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:10.353807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:10.353807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:10.353807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:10.353807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:10.353807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:10.353807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:10.354625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:10.354625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:10.354625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:10.354625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:10.354625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:10.354625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:10.354625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:10.354625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:10.354625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:10.354625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:10.354625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:27:10.354625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:10.357114 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 158/313] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:10.365822 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6dea2-40fd-44d0-bfe6-30d1a9b739a9 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:10.467727 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6dea2-40fd-44d0-bfe6-30d1a9b739a9 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:10.503489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17de330-91df-46e6-8aa3-f75a0b63ce7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:10.504149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17de330-91df-46e6-8aa3-f75a0b63ce7e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:10.504433 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17de330-91df-46e6-8aa3-f75a0b63ce7e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:10.504741 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17de330-91df-46e6-8aa3-f75a0b63ce7e None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:10.505489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17de330-91df-46e6-8aa3-f75a0b63ce7e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:10.505798 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17de330-91df-46e6-8aa3-f75a0b63ce7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:10.507184 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17de330-91df-46e6-8aa3-f75a0b63ce7e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:10.516254 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 156/314] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:27:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:10.521849 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3388bc-2ad4-4a15-a51f-52fd2ef6a61b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:10.621111 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3388bc-2ad4-4a15-a51f-52fd2ef6a61b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:10.657854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b7d76-5d07-4c82-835b-bd564e16f1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:10.659128 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b7d76-5d07-4c82-835b-bd564e16f1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:10.659621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b7d76-5d07-4c82-835b-bd564e16f1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:10.660149 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b7d76-5d07-4c82-835b-bd564e16f1b8 None admin] PATH_INFO: `/v3/users/fa707faac66e4209b2a3dcfc3d3f78e7` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:10.661627 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b7d76-5d07-4c82-835b-bd564e16f1b8 None admin] RBAC: Authorizing `identity:get_user(user_id=fa707faac66e4209b2a3dcfc3d3f78e7)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:10.663271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b7d76-5d07-4c82-835b-bd564e16f1b8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:10.665138 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 159/315] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:27:10 2022] GET /identity/v3/users/fa707faac66e4209b2a3dcfc3d3f78e7 => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:10.676557 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17de330-91df-46e6-8aa3-f75a0b63ce7e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:10.687707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:10.778010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17de330-91df-46e6-8aa3-f75a0b63ce7e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:10.813437 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42130ba6-82e5-496b-ac92-4503b0fa663d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:10.814088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42130ba6-82e5-496b-ac92-4503b0fa663d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:10.814372 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42130ba6-82e5-496b-ac92-4503b0fa663d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:10.814647 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42130ba6-82e5-496b-ac92-4503b0fa663d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:10.883704 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42130ba6-82e5-496b-ac92-4503b0fa663d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:10.885225 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42130ba6-82e5-496b-ac92-4503b0fa663d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:10.899909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:10.987649 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 157/316] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:27:10.993187 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b7d76-5d07-4c82-835b-bd564e16f1b8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:11.010135 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:11.021791 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eaa357-8906-41ec-b229-5bbb613a835e None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:11.022082 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eaa357-8906-41ec-b229-5bbb613a835e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:11.022362 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eaa357-8906-41ec-b229-5bbb613a835e None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:11.023985 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 158/317] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:11.029467 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af86e8-a787-4582-ba1d-ba215dcf59fd None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:11.029864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af86e8-a787-4582-ba1d-ba215dcf59fd None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:11.030241 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af86e8-a787-4582-ba1d-ba215dcf59fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:11.047754 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c7af86e8-a787-4582-ba1d-ba215dcf59fd None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:11.049116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c7af86e8-a787-4582-ba1d-ba215dcf59fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:11.098026 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b7d76-5d07-4c82-835b-bd564e16f1b8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:11.122377 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 159/318] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:27:11.135974 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f677ed2-5e4a-497b-8413-97a70dea53fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:11.136825 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f677ed2-5e4a-497b-8413-97a70dea53fa None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:11.137106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f677ed2-5e4a-497b-8413-97a70dea53fa None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:11.137418 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f677ed2-5e4a-497b-8413-97a70dea53fa None admin] PATH_INFO: `/v3/projects/0a89ccc08f1b4490a6206c230a1720ff` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:11.138596 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f677ed2-5e4a-497b-8413-97a70dea53fa None admin] RBAC: Authorizing `identity:get_project(project_id=0a89ccc08f1b4490a6206c230a1720ff)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:11.140114 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f677ed2-5e4a-497b-8413-97a70dea53fa None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:11.142042 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 160/319] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:27:10 2022] GET /identity/v3/projects/0a89ccc08f1b4490a6206c230a1720ff => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:11.145777 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af86e8-a787-4582-ba1d-ba215dcf59fd None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:11.147323 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f677ed2-5e4a-497b-8413-97a70dea53fa None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:11.197278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:11.254271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:11.263340 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af86e8-a787-4582-ba1d-ba215dcf59fd None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:11.277589 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f677ed2-5e4a-497b-8413-97a70dea53fa None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:11.301195 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94023fc-e2bd-42ad-bac8-ba227d440292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:11.302385 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94023fc-e2bd-42ad-bac8-ba227d440292 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:11.302878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94023fc-e2bd-42ad-bac8-ba227d440292 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:11.303330 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94023fc-e2bd-42ad-bac8-ba227d440292 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:11.304707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94023fc-e2bd-42ad-bac8-ba227d440292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:11.306560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94023fc-e2bd-42ad-bac8-ba227d440292 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:11.312915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 160/320] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:11.315196 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94023fc-e2bd-42ad-bac8-ba227d440292 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:11.318499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bac85-c22c-428d-82c4-815b10cc5782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:11.319151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bac85-c22c-428d-82c4-815b10cc5782 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:11.319438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bac85-c22c-428d-82c4-815b10cc5782 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:11.320558 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bac85-c22c-428d-82c4-815b10cc5782 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:11.321410 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8bac85-c22c-428d-82c4-815b10cc5782 None admin] RBAC: Adding query filter params (role.id=b3bea9d8f5294a5b8aaecb6c9bfeee6a, scope.project.id=0a89ccc08f1b4490a6206c230a1720ff, user.id=fa707faac66e4209b2a3dcfc3d3f78e7) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:11.321729 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8bac85-c22c-428d-82c4-815b10cc5782 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:11.323171 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8bac85-c22c-428d-82c4-815b10cc5782 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:11.332373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 161/321] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:27:11 2022] GET /identity/v3/role_assignments?user.id=fa707faac66e4209b2a3dcfc3d3f78e7&scope.project.id=0a89ccc08f1b4490a6206c230a1720ff&role.id=b3bea9d8f5294a5b8aaecb6c9bfeee6a => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:11.333786 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bc6f0-b14b-44b0-a6fd-d2e393e271ca None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:11.334127 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bc6f0-b14b-44b0-a6fd-d2e393e271ca None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:11.334358 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bc6f0-b14b-44b0-a6fd-d2e393e271ca None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:11.335709 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 162/322] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:11.342066 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f27812-da6a-4994-94ad-455402162947 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:11.342394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f27812-da6a-4994-94ad-455402162947 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:11.342689 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f27812-da6a-4994-94ad-455402162947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:11.363214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-94f27812-da6a-4994-94ad-455402162947 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:11.364486 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-94f27812-da6a-4994-94ad-455402162947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:11.445210 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94023fc-e2bd-42ad-bac8-ba227d440292 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:11.460021 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:11.470919 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 163/323] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:11.489343 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d0bf3-3bd0-49f2-afe7-ec1cf069878e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:11.490032 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d0bf3-3bd0-49f2-afe7-ec1cf069878e None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:11.490314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d0bf3-3bd0-49f2-afe7-ec1cf069878e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:11.490588 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d0bf3-3bd0-49f2-afe7-ec1cf069878e None admin] PATH_INFO: `/v3/groups` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:11.491287 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d0bf3-3bd0-49f2-afe7-ec1cf069878e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:11.492810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d0bf3-3bd0-49f2-afe7-ec1cf069878e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:11.498417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f27812-da6a-4994-94ad-455402162947 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:11.510462 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 161/324] 10.222.0.59 () {60 vars in 1134 bytes} [Thu Jun 30 10:27:11 2022] POST /identity/v3/groups => generated 226 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:27:11.592572 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:11.625758 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f27812-da6a-4994-94ad-455402162947 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:11.665228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9bec2e-cda6-419a-8d55-11dba53c746e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:11.666094 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bec2e-cda6-419a-8d55-11dba53c746e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:11.666347 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bec2e-cda6-419a-8d55-11dba53c746e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:11.666625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bec2e-cda6-419a-8d55-11dba53c746e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:11.678303 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9bec2e-cda6-419a-8d55-11dba53c746e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:11.686850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-0d9bec2e-cda6-419a-8d55-11dba53c746e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:27:11.686850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:11.686850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:11.686850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:11.686850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:11.686850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:11.686850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:11.686850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:11.686850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:11.686850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:11.686850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:11.686850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:11.686850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:11.686850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:11.686850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:11.686850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:11.687918 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:11.687918 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:11.687918 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:11.687918 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:11.687918 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:11.687918 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:11.687918 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:11.687918 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:11.687918 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:11.687918 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:11.687918 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:11.687918 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:11.687918 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:11.687918 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:11.687918 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:11.687918 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:11.688896 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:11.688896 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:11.688896 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:11.688896 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:11.688896 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:11.688896 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:11.688896 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:11.688896 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:11.688896 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:11.688896 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:11.688896 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:27:11.688896 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:11.689879 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 164/325] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:11.695768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d0bf3-3bd0-49f2-afe7-ec1cf069878e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:11.734481 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaeae0e-80cb-45af-a769-6247022ca3aa None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:11.734764 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaeae0e-80cb-45af-a769-6247022ca3aa None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:11.735052 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaeae0e-80cb-45af-a769-6247022ca3aa None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:11.736437 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 165/326] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:11.741484 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086ab19-d02a-4d82-a002-6c3b3becfa14 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:11.741774 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086ab19-d02a-4d82-a002-6c3b3becfa14 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:11.742051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086ab19-d02a-4d82-a002-6c3b3becfa14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:11.759231 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-4086ab19-d02a-4d82-a002-6c3b3becfa14 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:11.760429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4086ab19-d02a-4d82-a002-6c3b3becfa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:11.818610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d0bf3-3bd0-49f2-afe7-ec1cf069878e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:11.844813 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 166/327] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:27:11.857828 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54c483-81a4-454a-9252-59a254033008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:11.858560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54c483-81a4-454a-9252-59a254033008 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:11.858854 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54c483-81a4-454a-9252-59a254033008 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:11.859133 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54c483-81a4-454a-9252-59a254033008 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:11.859887 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54c483-81a4-454a-9252-59a254033008 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:11.860199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54c483-81a4-454a-9252-59a254033008 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:11.861683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54c483-81a4-454a-9252-59a254033008 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:11.869059 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086ab19-d02a-4d82-a002-6c3b3becfa14 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:11.871403 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 162/328] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:27:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:11.876803 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54c483-81a4-454a-9252-59a254033008 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:11.916481 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:11.959238 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:12.001296 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086ab19-d02a-4d82-a002-6c3b3becfa14 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:12.005855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54c483-81a4-454a-9252-59a254033008 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:12.053161 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b5dbd-b672-4974-9d36-b7db0393437e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:12.053414 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7e915-bb3d-4389-8884-493e659905a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:12.053980 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b5dbd-b672-4974-9d36-b7db0393437e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:12.054155 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7e915-bb3d-4389-8884-493e659905a2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:12.054247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b5dbd-b672-4974-9d36-b7db0393437e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:12.054411 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7e915-bb3d-4389-8884-493e659905a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:12.054519 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b5dbd-b672-4974-9d36-b7db0393437e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:12.054687 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7e915-bb3d-4389-8884-493e659905a2 None admin] PATH_INFO: `/v3/users/e7189cfc8d9240c2a1e4be0f3f447f98` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:12.055901 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d7e915-bb3d-4389-8884-493e659905a2 None admin] RBAC: Authorizing `identity:get_user(user_id=e7189cfc8d9240c2a1e4be0f3f447f98)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:12.058205 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d7e915-bb3d-4389-8884-493e659905a2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:12.060452 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 163/329] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:27:11 2022] GET /identity/v3/users/e7189cfc8d9240c2a1e4be0f3f447f98 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:12.066165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7e915-bb3d-4389-8884-493e659905a2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:12.073579 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b5dbd-b672-4974-9d36-b7db0393437e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:12.082761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-603b5dbd-b672-4974-9d36-b7db0393437e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:27:12.082761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:12.082761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:12.082761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:12.082761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:12.082761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:12.082761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:12.082761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:12.082761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:12.082761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:12.082761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:12.082761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:12.082761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:12.082761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:12.082761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:12.082761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:12.083678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:12.083678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:12.083678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:12.083678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:12.083678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:12.083678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:12.083678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:12.083678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:12.083678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:12.083678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:12.083678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:12.083678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:12.083678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:12.083678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:12.083678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:12.083678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:12.084444 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:12.084444 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:12.084444 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:12.084444 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:12.084444 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:12.084444 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:12.084444 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:12.084444 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:12.084444 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:12.084444 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:12.084444 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:27:12.084444 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:12.086373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 167/330] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:27:12.093605 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b5dbd-b672-4974-9d36-b7db0393437e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:12.203887 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7e915-bb3d-4389-8884-493e659905a2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:12.205662 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:12.250346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0b197-5510-4e63-a13d-7d3fa16ff448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:12.250650 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b5dbd-b672-4974-9d36-b7db0393437e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:12.251135 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0b197-5510-4e63-a13d-7d3fa16ff448 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:12.251401 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0b197-5510-4e63-a13d-7d3fa16ff448 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:12.251680 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0b197-5510-4e63-a13d-7d3fa16ff448 None admin] PATH_INFO: `/v3/system/users/e7189cfc8d9240c2a1e4be0f3f447f98/roles/b3bea9d8f5294a5b8aaecb6c9bfeee6a` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:12.253223 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0b197-5510-4e63-a13d-7d3fa16ff448 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e7189cfc8d9240c2a1e4be0f3f447f98, role_id=b3bea9d8f5294a5b8aaecb6c9bfeee6a)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:12.256525 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0b197-5510-4e63-a13d-7d3fa16ff448 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:12.267155 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 164/331] 10.222.0.59 () {58 vars in 1334 bytes} [Thu Jun 30 10:27:12 2022] PUT /identity/v3/system/users/e7189cfc8d9240c2a1e4be0f3f447f98/roles/b3bea9d8f5294a5b8aaecb6c9bfeee6a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:27:12.285021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:12.295300 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ce89f-ca0d-4664-9c92-a7ee7ca02ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:12.295990 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ce89f-ca0d-4664-9c92-a7ee7ca02ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:12.296284 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ce89f-ca0d-4664-9c92-a7ee7ca02ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:12.296590 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ce89f-ca0d-4664-9c92-a7ee7ca02ab5 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:12.297361 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ce89f-ca0d-4664-9c92-a7ee7ca02ab5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:12.297682 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ce89f-ca0d-4664-9c92-a7ee7ca02ab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:12.299101 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ce89f-ca0d-4664-9c92-a7ee7ca02ab5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:12.309417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 168/332] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:27:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:12.314910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0b197-5510-4e63-a13d-7d3fa16ff448 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:12.447561 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0b197-5510-4e63-a13d-7d3fa16ff448 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:12.484328 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c7da4-d850-4363-a8ea-ec585f5ec728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:12.485312 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c7da4-d850-4363-a8ea-ec585f5ec728 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:12.485603 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c7da4-d850-4363-a8ea-ec585f5ec728 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:12.485882 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c7da4-d850-4363-a8ea-ec585f5ec728 None admin] PATH_INFO: `/v3/users/31835e2a6dbd4385882eee34519ecfad` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:12.487093 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c7da4-d850-4363-a8ea-ec585f5ec728 None admin] RBAC: Authorizing `identity:get_user(user_id=31835e2a6dbd4385882eee34519ecfad)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:12.488585 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c7da4-d850-4363-a8ea-ec585f5ec728 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:12.490534 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 165/333] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:27:12 2022] GET /identity/v3/users/31835e2a6dbd4385882eee34519ecfad => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:12.496190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ce89f-ca0d-4664-9c92-a7ee7ca02ab5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:12.600978 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ce89f-ca0d-4664-9c92-a7ee7ca02ab5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:12.642817 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9a498-107f-4030-b6b8-11ad2ed3c57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:12.643481 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9a498-107f-4030-b6b8-11ad2ed3c57d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:12.643767 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9a498-107f-4030-b6b8-11ad2ed3c57d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:12.644045 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9a498-107f-4030-b6b8-11ad2ed3c57d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:12.644947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9a498-107f-4030-b6b8-11ad2ed3c57d None admin] RBAC: Adding query filter params (role.id=c68f9f9f32ac40dba0d180dd3f5582bb, user.id=31835e2a6dbd4385882eee34519ecfad, scope.system=all) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:12.645261 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9a498-107f-4030-b6b8-11ad2ed3c57d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:12.646699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9a498-107f-4030-b6b8-11ad2ed3c57d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:12.668016 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 169/334] 10.222.0.59 () {56 vars in 1308 bytes} [Thu Jun 30 10:27:12 2022] GET /identity/v3/role_assignments?user.id=31835e2a6dbd4385882eee34519ecfad&scope.system=all&role.id=c68f9f9f32ac40dba0d180dd3f5582bb => generated 510 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:14.176472 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d451665-4a52-4385-94f6-26d82fe9c045 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:14.177007 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d451665-4a52-4385-94f6-26d82fe9c045 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:14.177082 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d451665-4a52-4385-94f6-26d82fe9c045 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:14.178978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 166/335] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:14.185093 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49001cb3-0ed9-4804-bf65-50afa6688f12 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:14.185527 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49001cb3-0ed9-4804-bf65-50afa6688f12 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:14.185700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49001cb3-0ed9-4804-bf65-50afa6688f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:14.204423 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-49001cb3-0ed9-4804-bf65-50afa6688f12 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:14.205644 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-49001cb3-0ed9-4804-bf65-50afa6688f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:14.270484 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:14.314830 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 170/336] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:27:14.356916 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d451665-4a52-4385-94f6-26d82fe9c045 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:14.407538 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:14.486569 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d451665-4a52-4385-94f6-26d82fe9c045 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:14.533029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa38368-4798-4ba1-8968-ebc79198b68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:14.533816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa38368-4798-4ba1-8968-ebc79198b68e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:14.534095 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa38368-4798-4ba1-8968-ebc79198b68e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:14.534368 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa38368-4798-4ba1-8968-ebc79198b68e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:14.557446 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa38368-4798-4ba1-8968-ebc79198b68e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:14.565606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-daa38368-4798-4ba1-8968-ebc79198b68e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:27:14.565606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:14.565606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:14.565606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:14.565606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:14.565606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:14.565606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:14.565606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:14.565606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:14.565606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:14.565606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:14.565606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:14.565606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:14.565606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:14.565606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:14.565606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:14.566476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:14.566476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:14.566476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:14.566476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:14.566476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:14.566476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:14.566476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:14.566476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:14.566476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:14.566476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:14.566476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:14.566476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:14.566476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:14.566476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:14.566476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:14.566476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:14.567364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:14.567364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:14.567364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:14.567364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:14.567364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:14.567364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:14.567364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:14.567364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:14.567364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:14.567364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:14.567364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:27:14.567364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:14.567364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 167/337] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:14.572983 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49001cb3-0ed9-4804-bf65-50afa6688f12 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:14.584541 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1f204-37e4-431e-8eb4-069c909bb2d5 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:14.584541 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1f204-37e4-431e-8eb4-069c909bb2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:14.584541 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1f204-37e4-431e-8eb4-069c909bb2d5 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:14.584541 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 168/338] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:14.592553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a374214-3449-4b84-8052-54a9ffde7fb1 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:14.592553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a374214-3449-4b84-8052-54a9ffde7fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:14.592553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a374214-3449-4b84-8052-54a9ffde7fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:14.615360 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-5a374214-3449-4b84-8052-54a9ffde7fb1 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:14.620175 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5a374214-3449-4b84-8052-54a9ffde7fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:14.724366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49001cb3-0ed9-4804-bf65-50afa6688f12 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:14.726489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 169/339] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:27:14.763664 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a374214-3449-4b84-8052-54a9ffde7fb1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:14.772082 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4be41-0cba-432d-98f7-ab5cd48ccbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:14.772082 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4be41-0cba-432d-98f7-ab5cd48ccbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:14.772082 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4be41-0cba-432d-98f7-ab5cd48ccbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:14.772082 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4be41-0cba-432d-98f7-ab5cd48ccbf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:14.772417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4be41-0cba-432d-98f7-ab5cd48ccbf9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:14.772417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4be41-0cba-432d-98f7-ab5cd48ccbf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:14.772417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4be41-0cba-432d-98f7-ab5cd48ccbf9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:14.781366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 171/340] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:27:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:14.786308 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4be41-0cba-432d-98f7-ab5cd48ccbf9 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:14.817527 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:14.854506 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:14.911734 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a374214-3449-4b84-8052-54a9ffde7fb1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:14.938845 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4be41-0cba-432d-98f7-ab5cd48ccbf9 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:14.948780 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52992c9e-1c14-41d5-aecc-82cf35c7452d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:14.950509 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52992c9e-1c14-41d5-aecc-82cf35c7452d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:14.950943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52992c9e-1c14-41d5-aecc-82cf35c7452d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:14.951407 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52992c9e-1c14-41d5-aecc-82cf35c7452d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:14.962876 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52992c9e-1c14-41d5-aecc-82cf35c7452d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:14.972667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-52992c9e-1c14-41d5-aecc-82cf35c7452d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:27:14.972667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:14.972667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:14.972667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:14.972667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:14.972667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:14.972667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:14.972667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:14.972667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:14.972667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:14.972667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:14.972667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:14.972667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:14.972667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:14.972667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:14.972667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:14.974057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:14.974057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:14.974057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:14.974057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:14.974057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:14.974057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:14.974057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:14.974057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:14.974057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:14.974057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:14.974057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:14.974057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:14.974057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:14.974057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:14.974057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:14.974057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:14.975051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:14.975051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:14.975051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:14.975051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:14.975051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:14.975051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:14.975051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:14.975051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:14.975051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:14.975051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:14.975051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:27:14.975051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:14.977447 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 170/341] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:27:14.978187 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23928e49-3324-4dfd-84af-67e1ff4a08f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:14.978911 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23928e49-3324-4dfd-84af-67e1ff4a08f5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:14.979181 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b840e2-9795-4518-b61b-9a36dae09699 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:14.979313 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23928e49-3324-4dfd-84af-67e1ff4a08f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:14.979662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23928e49-3324-4dfd-84af-67e1ff4a08f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:14.979878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b840e2-9795-4518-b61b-9a36dae09699 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:14.980294 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b840e2-9795-4518-b61b-9a36dae09699 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:14.981802 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 171/342] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:14.985471 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b840e2-9795-4518-b61b-9a36dae09699 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:15.075502 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23928e49-3324-4dfd-84af-67e1ff4a08f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:15.077232 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23928e49-3324-4dfd-84af-67e1ff4a08f5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:15.106736 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:15.121523 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:15.130807 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b840e2-9795-4518-b61b-9a36dae09699 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:15.175368 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110876b5-00b5-4f53-9cf2-6b05ae6ff432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:15.176362 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110876b5-00b5-4f53-9cf2-6b05ae6ff432 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:15.176842 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110876b5-00b5-4f53-9cf2-6b05ae6ff432 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:15.177714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110876b5-00b5-4f53-9cf2-6b05ae6ff432 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:15.178719 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110876b5-00b5-4f53-9cf2-6b05ae6ff432 None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:15.179174 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110876b5-00b5-4f53-9cf2-6b05ae6ff432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:15.182760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110876b5-00b5-4f53-9cf2-6b05ae6ff432 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:15.192954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 172/343] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:27:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:15.194530 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae3fd0-bdc8-4338-9eac-e73dafcb3025 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:15.195040 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae3fd0-bdc8-4338-9eac-e73dafcb3025 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:15.195462 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae3fd0-bdc8-4338-9eac-e73dafcb3025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:15.196968 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 172/344] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:27:15.198699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23928e49-3324-4dfd-84af-67e1ff4a08f5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:15.223914 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b3ae3fd0-bdc8-4338-9eac-e73dafcb3025 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:15.225603 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b3ae3fd0-bdc8-4338-9eac-e73dafcb3025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:15.339326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 173/345] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:15.340106 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae3fd0-bdc8-4338-9eac-e73dafcb3025 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:15.385490 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23928e49-3324-4dfd-84af-67e1ff4a08f5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:15.448763 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b1fa3-4a44-4bdf-98f1-403479552043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:15.449422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b1fa3-4a44-4bdf-98f1-403479552043 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:15.449748 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b1fa3-4a44-4bdf-98f1-403479552043 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:15.450032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b1fa3-4a44-4bdf-98f1-403479552043 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:15.468742 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:15.520810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:15.534437 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b1fa3-4a44-4bdf-98f1-403479552043 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:15.536250 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b1fa3-4a44-4bdf-98f1-403479552043 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:15.553800 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae3fd0-bdc8-4338-9eac-e73dafcb3025 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:15.630044 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75549a-2d2c-4f66-a44c-f3cf0bcacf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:15.631150 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75549a-2d2c-4f66-a44c-f3cf0bcacf77 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:15.631573 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75549a-2d2c-4f66-a44c-f3cf0bcacf77 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:15.631981 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75549a-2d2c-4f66-a44c-f3cf0bcacf77 None admin] PATH_INFO: `/v3/projects/0796b54c77a1493db97cdbe3488fc82b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:15.637231 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75549a-2d2c-4f66-a44c-f3cf0bcacf77 None admin] RBAC: Authorizing `identity:get_project(project_id=0796b54c77a1493db97cdbe3488fc82b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:15.638874 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75549a-2d2c-4f66-a44c-f3cf0bcacf77 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:15.644528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 174/346] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:27:15 2022] GET /identity/v3/projects/0796b54c77a1493db97cdbe3488fc82b => generated 298 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:15.644528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75549a-2d2c-4f66-a44c-f3cf0bcacf77 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:15.658543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 173/347] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:27:15.659663 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b1fa3-4a44-4bdf-98f1-403479552043 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:15.708560 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:15.787458 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b1fa3-4a44-4bdf-98f1-403479552043 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:15.798613 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75549a-2d2c-4f66-a44c-f3cf0bcacf77 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:15.837244 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31e74f-2869-4c66-b1ca-6fb131e31a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:15.838456 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31e74f-2869-4c66-b1ca-6fb131e31a7c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:15.838965 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31e74f-2869-4c66-b1ca-6fb131e31a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:15.839437 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31e74f-2869-4c66-b1ca-6fb131e31a7c None admin] PATH_INFO: `/v3/groups/1aedfc2f0f344be8a264e13c70093465` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:15.841891 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be26a5-40d1-413f-85a9-941891074982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:15.842969 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be26a5-40d1-413f-85a9-941891074982 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:15.843252 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be26a5-40d1-413f-85a9-941891074982 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:15.843526 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be26a5-40d1-413f-85a9-941891074982 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:15.849796 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31e74f-2869-4c66-b1ca-6fb131e31a7c None admin] RBAC: Authorizing `identity:get_group(group_id=1aedfc2f0f344be8a264e13c70093465)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:15.851506 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31e74f-2869-4c66-b1ca-6fb131e31a7c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:15.853463 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 174/348] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 30 10:27:15 2022] GET /identity/v3/groups/1aedfc2f0f344be8a264e13c70093465 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:15.854923 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395abbcb-e844-4e14-bd45-b4deaa9aabcd None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:15.855445 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395abbcb-e844-4e14-bd45-b4deaa9aabcd None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:15.855958 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395abbcb-e844-4e14-bd45-b4deaa9aabcd None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:15.857346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be26a5-40d1-413f-85a9-941891074982 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:15.858480 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 175/349] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:15.859435 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395abbcb-e844-4e14-bd45-b4deaa9aabcd None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:15.865900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-30be26a5-40d1-413f-85a9-941891074982 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:27:15.865900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:15.865900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:15.865900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:15.865900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:15.865900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:15.865900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:15.865900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:15.865900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:15.865900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:15.865900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:15.865900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:15.865900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:15.865900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:15.865900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:15.865900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:15.867005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:15.867005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:15.867005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:15.867005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:15.867005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:15.867005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:15.867005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:15.867005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:15.867005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:15.867005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:15.867005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:15.867005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:15.867005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:15.867005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:15.867005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:15.867005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:15.868025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:15.868025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:15.868025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:15.868025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:15.868025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:15.868025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:15.868025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:15.868025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:15.868025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:15.868025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:15.868025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:27:15.868025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:15.868025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 175/350] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 30 10:27:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:15.868732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a5a1c-7162-48ae-95f0-215a53cc5486 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:15.868732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a5a1c-7162-48ae-95f0-215a53cc5486 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:15.868908 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a5a1c-7162-48ae-95f0-215a53cc5486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:15.875629 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:15.890089 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-843a5a1c-7162-48ae-95f0-215a53cc5486 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:15.891717 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-843a5a1c-7162-48ae-95f0-215a53cc5486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:15.968292 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 176/351] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:15.969635 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a5a1c-7162-48ae-95f0-215a53cc5486 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:15.983013 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395abbcb-e844-4e14-bd45-b4deaa9aabcd None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:15.984576 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:16.025734 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db84d17-a448-4284-ab39-a3d55f1e8589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:16.026775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db84d17-a448-4284-ab39-a3d55f1e8589 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:16.027124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db84d17-a448-4284-ab39-a3d55f1e8589 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:16.027481 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db84d17-a448-4284-ab39-a3d55f1e8589 None admin] PATH_INFO: `/v3/projects/0a89ccc08f1b4490a6206c230a1720ff` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:16.030090 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db84d17-a448-4284-ab39-a3d55f1e8589 None admin] RBAC: Authorizing `identity:get_project(project_id=0a89ccc08f1b4490a6206c230a1720ff)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:16.031530 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db84d17-a448-4284-ab39-a3d55f1e8589 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:16.033459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 176/352] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:27:15 2022] GET /identity/v3/projects/0a89ccc08f1b4490a6206c230a1720ff => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:16.037825 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db84d17-a448-4284-ab39-a3d55f1e8589 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:16.095767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a5a1c-7162-48ae-95f0-215a53cc5486 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:16.135636 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bb8b1-ec49-47ec-9fa7-be38787301bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:16.136310 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bb8b1-ec49-47ec-9fa7-be38787301bc None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:16.136626 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bb8b1-ec49-47ec-9fa7-be38787301bc None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:16.136906 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bb8b1-ec49-47ec-9fa7-be38787301bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:16.138273 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bb8b1-ec49-47ec-9fa7-be38787301bc None admin] RBAC: Adding query filter params (group.id=1aedfc2f0f344be8a264e13c70093465, role.id=c68f9f9f32ac40dba0d180dd3f5582bb, scope.project.id=0796b54c77a1493db97cdbe3488fc82b) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:16.138587 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bb8b1-ec49-47ec-9fa7-be38787301bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:16.140433 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bb8b1-ec49-47ec-9fa7-be38787301bc None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:16.142313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:16.146540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 177/353] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 30 10:27:15 2022] GET /identity/v3/role_assignments?group.id=1aedfc2f0f344be8a264e13c70093465&scope.project.id=0796b54c77a1493db97cdbe3488fc82b&role.id=c68f9f9f32ac40dba0d180dd3f5582bb => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:16.147801 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40179fdb-02f6-46df-9943-3d80070c06f1 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:16.148098 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40179fdb-02f6-46df-9943-3d80070c06f1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:16.148377 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40179fdb-02f6-46df-9943-3d80070c06f1 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:16.155123 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 178/354] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:16.156256 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40179fdb-02f6-46df-9943-3d80070c06f1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:16.167659 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db84d17-a448-4284-ab39-a3d55f1e8589 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:16.209567 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce50a7-31ff-415a-9b64-420ca771b4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:16.210190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce50a7-31ff-415a-9b64-420ca771b4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:16.210190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce50a7-31ff-415a-9b64-420ca771b4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:16.210190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce50a7-31ff-415a-9b64-420ca771b4d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:16.211092 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce50a7-31ff-415a-9b64-420ca771b4d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:16.211468 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce50a7-31ff-415a-9b64-420ca771b4d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:16.212986 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce50a7-31ff-415a-9b64-420ca771b4d8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:16.223278 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 177/355] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:27:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:16.224287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce50a7-31ff-415a-9b64-420ca771b4d8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:16.260990 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:16.320073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40179fdb-02f6-46df-9943-3d80070c06f1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:16.347457 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce50a7-31ff-415a-9b64-420ca771b4d8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:16.370419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbec27-2991-40d8-ad63-df78e8d57b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:16.372695 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbec27-2991-40d8-ad63-df78e8d57b99 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:16.373153 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbec27-2991-40d8-ad63-df78e8d57b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:16.373780 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbec27-2991-40d8-ad63-df78e8d57b99 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:16.391342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabbec27-2991-40d8-ad63-df78e8d57b99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:16.394639 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884bad6-c084-4662-9461-01444c795a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:16.395777 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884bad6-c084-4662-9461-01444c795a50 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:16.396250 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884bad6-c084-4662-9461-01444c795a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:16.396778 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884bad6-c084-4662-9461-01444c795a50 None admin] PATH_INFO: `/v3/groups/1aedfc2f0f344be8a264e13c70093465` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:16.398197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884bad6-c084-4662-9461-01444c795a50 None admin] RBAC: Authorizing `identity:get_group(group_id=1aedfc2f0f344be8a264e13c70093465)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:16.399332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-aabbec27-2991-40d8-ad63-df78e8d57b99 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:27:16.399332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:16.399332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:16.399332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:16.399332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:16.399332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:16.399332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:16.399332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:16.399332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:16.399332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:16.399332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:16.399332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:16.399332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:16.399332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:16.399332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:16.399332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:16.400169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:16.400169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:16.400169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:16.400169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:16.400169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:16.400169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:16.400169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:16.400169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:16.400169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:16.400169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:16.400169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:16.400169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:16.400169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:16.400169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:16.400169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:16.400169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:16.401148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:16.401148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:16.401148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:16.401148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:16.401148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:16.401148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:16.401148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:16.401148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:16.401148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:16.401148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:16.401148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:27:16.401148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:16.401148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 179/356] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 30 10:27:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:16.402133 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdcd7d-1593-4772-b296-6dbcd35d753e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:16.403626 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884bad6-c084-4662-9461-01444c795a50 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:16.405808 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 178/357] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 30 10:27:16 2022] GET /identity/v3/groups/1aedfc2f0f344be8a264e13c70093465 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:16.406771 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884bad6-c084-4662-9461-01444c795a50 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:16.407528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdcd7d-1593-4772-b296-6dbcd35d753e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:16.407838 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdcd7d-1593-4772-b296-6dbcd35d753e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:16.439652 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0cfdcd7d-1593-4772-b296-6dbcd35d753e None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:16.441040 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0cfdcd7d-1593-4772-b296-6dbcd35d753e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:16.512959 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:16.530662 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 180/358] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:16.531589 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdcd7d-1593-4772-b296-6dbcd35d753e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:16.545449 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884bad6-c084-4662-9461-01444c795a50 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:16.547659 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:16.598235 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebb803-ba68-42f4-8187-bff425a8e1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:16.599278 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebb803-ba68-42f4-8187-bff425a8e1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:16.599553 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebb803-ba68-42f4-8187-bff425a8e1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:16.599827 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebb803-ba68-42f4-8187-bff425a8e1f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:16.678180 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdcd7d-1593-4772-b296-6dbcd35d753e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:16.690644 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebb803-ba68-42f4-8187-bff425a8e1f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:16.692153 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebb803-ba68-42f4-8187-bff425a8e1f8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:16.717105 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09dcf12-8b2e-422c-b3e7-081879b4da5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:16.717869 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dcf12-8b2e-422c-b3e7-081879b4da5f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:16.718250 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dcf12-8b2e-422c-b3e7-081879b4da5f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:16.718551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dcf12-8b2e-422c-b3e7-081879b4da5f None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:16.719274 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09dcf12-8b2e-422c-b3e7-081879b4da5f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:16.719577 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09dcf12-8b2e-422c-b3e7-081879b4da5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:16.721207 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09dcf12-8b2e-422c-b3e7-081879b4da5f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:16.731026 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 181/359] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:27:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:16.731668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09dcf12-8b2e-422c-b3e7-081879b4da5f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:16.789857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:16.805742 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:16.811536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 179/360] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:27:16.813321 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f872ab3-745f-4701-bcbc-0d48a504fe83 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:16.813934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f872ab3-745f-4701-bcbc-0d48a504fe83 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:16.814276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f872ab3-745f-4701-bcbc-0d48a504fe83 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:16.815702 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 180/361] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:16.816459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f872ab3-745f-4701-bcbc-0d48a504fe83 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:16.853589 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09dcf12-8b2e-422c-b3e7-081879b4da5f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:16.902088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e88cd3-1090-4ad8-a151-fb75794cdd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:16.903059 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e88cd3-1090-4ad8-a151-fb75794cdd3f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:16.903364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e88cd3-1090-4ad8-a151-fb75794cdd3f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:16.903642 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e88cd3-1090-4ad8-a151-fb75794cdd3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:16.904474 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e88cd3-1090-4ad8-a151-fb75794cdd3f None admin] RBAC: Adding query filter params (group.id=1aedfc2f0f344be8a264e13c70093465, role.id=c68f9f9f32ac40dba0d180dd3f5582bb, scope.project.id=0a89ccc08f1b4490a6206c230a1720ff) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:16.905385 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e88cd3-1090-4ad8-a151-fb75794cdd3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:16.907505 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e88cd3-1090-4ad8-a151-fb75794cdd3f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:16.913063 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 182/362] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 30 10:27:16 2022] GET /identity/v3/role_assignments?group.id=1aedfc2f0f344be8a264e13c70093465&scope.project.id=0a89ccc08f1b4490a6206c230a1720ff&role.id=c68f9f9f32ac40dba0d180dd3f5582bb => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:16.917144 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e88cd3-1090-4ad8-a151-fb75794cdd3f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:16.941596 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f872ab3-745f-4701-bcbc-0d48a504fe83 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:16.981590 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b2947-baee-4627-8af2-f15e86e42266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:16.982912 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b2947-baee-4627-8af2-f15e86e42266 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:16.983421 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b2947-baee-4627-8af2-f15e86e42266 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:16.983898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b2947-baee-4627-8af2-f15e86e42266 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:16.997223 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b2947-baee-4627-8af2-f15e86e42266 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:17.005661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-710b2947-baee-4627-8af2-f15e86e42266 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:27:17.005661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:17.005661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:17.005661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:17.005661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:17.005661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:17.005661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:17.005661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:17.005661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:17.005661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:17.005661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:17.005661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:17.005661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:17.005661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:17.005661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:17.005661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:17.006666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:17.006666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:17.006666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:17.006666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:17.006666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:17.006666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:17.006666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:17.006666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:17.006666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:17.006666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:17.006666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:17.006666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:17.006666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:17.006666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:17.006666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:17.006666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:17.007583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:17.007583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:17.007583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:17.007583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:17.007583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:17.007583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:17.007583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:17.007583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:17.007583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:17.007583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:17.007583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:27:17.007583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:17.010462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 181/363] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:17.011583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b2947-baee-4627-8af2-f15e86e42266 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:17.043059 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e88cd3-1090-4ad8-a151-fb75794cdd3f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:17.060150 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:17.079466 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:17.085930 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9e01c-b516-4cfe-b514-fd0ea10c9d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:17.086818 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9e01c-b516-4cfe-b514-fd0ea10c9d01 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:17.087245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9e01c-b516-4cfe-b514-fd0ea10c9d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:17.087745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9e01c-b516-4cfe-b514-fd0ea10c9d01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:17.126087 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b2947-baee-4627-8af2-f15e86e42266 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:17.164696 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9e01c-b516-4cfe-b514-fd0ea10c9d01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:17.165010 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e8368-ce3a-4fe4-8189-6a7faa2dacec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:17.165990 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e8368-ce3a-4fe4-8189-6a7faa2dacec None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:17.166377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e8368-ce3a-4fe4-8189-6a7faa2dacec None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:17.166754 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e8368-ce3a-4fe4-8189-6a7faa2dacec None admin] PATH_INFO: `/v3/projects/0796b54c77a1493db97cdbe3488fc82b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:17.167054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9e01c-b516-4cfe-b514-fd0ea10c9d01 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:17.168206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e8368-ce3a-4fe4-8189-6a7faa2dacec None admin] RBAC: Authorizing `identity:get_project(project_id=0796b54c77a1493db97cdbe3488fc82b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:17.170403 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e8368-ce3a-4fe4-8189-6a7faa2dacec None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:17.177885 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 182/364] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:27:17 2022] GET /identity/v3/projects/0796b54c77a1493db97cdbe3488fc82b => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:17.179478 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bb417-5cc5-44c8-9839-fcf28407e00c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:17.179875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bb417-5cc5-44c8-9839-fcf28407e00c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:17.180255 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bb417-5cc5-44c8-9839-fcf28407e00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:17.201591 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-029bb417-5cc5-44c8-9839-fcf28407e00c None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:17.203363 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-029bb417-5cc5-44c8-9839-fcf28407e00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:17.289609 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 183/365] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:27:17.296151 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9e01c-b516-4cfe-b514-fd0ea10c9d01 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:17.302136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 183/366] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:17.303066 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bb417-5cc5-44c8-9839-fcf28407e00c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:17.316413 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:17.369922 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:17.414551 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bb417-5cc5-44c8-9839-fcf28407e00c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:17.424985 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9e01c-b516-4cfe-b514-fd0ea10c9d01 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:17.454378 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ca196-72b7-43b9-b044-6638ccb2d604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:17.457685 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ca196-72b7-43b9-b044-6638ccb2d604 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:17.457685 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ca196-72b7-43b9-b044-6638ccb2d604 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:17.457685 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ca196-72b7-43b9-b044-6638ccb2d604 None admin] PATH_INFO: `/v3/groups/1aedfc2f0f344be8a264e13c70093465` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:17.457685 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ca196-72b7-43b9-b044-6638ccb2d604 None admin] RBAC: Authorizing `identity:get_group(group_id=1aedfc2f0f344be8a264e13c70093465)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:17.458429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ca196-72b7-43b9-b044-6638ccb2d604 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:17.460358 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 184/367] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 30 10:27:17 2022] GET /identity/v3/groups/1aedfc2f0f344be8a264e13c70093465 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:17.464639 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ca196-72b7-43b9-b044-6638ccb2d604 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:17.478325 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cbdc5-36f6-47b1-a9b7-821478c40b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:17.479406 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cbdc5-36f6-47b1-a9b7-821478c40b49 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:17.479908 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cbdc5-36f6-47b1-a9b7-821478c40b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:17.480406 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cbdc5-36f6-47b1-a9b7-821478c40b49 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:17.482070 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cbdc5-36f6-47b1-a9b7-821478c40b49 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:17.482603 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cbdc5-36f6-47b1-a9b7-821478c40b49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:17.484313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cbdc5-36f6-47b1-a9b7-821478c40b49 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:17.498047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 184/368] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:27:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:17.499096 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cbdc5-36f6-47b1-a9b7-821478c40b49 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:17.583631 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ca196-72b7-43b9-b044-6638ccb2d604 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:17.611847 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:17.617228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:17.628678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bbc50-9e6c-495e-b7ab-b474ead3140b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:17.629878 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bbc50-9e6c-495e-b7ab-b474ead3140b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:17.630389 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bbc50-9e6c-495e-b7ab-b474ead3140b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:17.630914 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bbc50-9e6c-495e-b7ab-b474ead3140b None admin] PATH_INFO: `/v3/projects/0a89ccc08f1b4490a6206c230a1720ff` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:17.632339 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bbc50-9e6c-495e-b7ab-b474ead3140b None admin] RBAC: Authorizing `identity:get_project(project_id=0a89ccc08f1b4490a6206c230a1720ff)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:17.634191 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bbc50-9e6c-495e-b7ab-b474ead3140b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:17.636168 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 185/369] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:27:17 2022] GET /identity/v3/projects/0a89ccc08f1b4490a6206c230a1720ff => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:17.637849 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bbc50-9e6c-495e-b7ab-b474ead3140b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:17.645757 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cbdc5-36f6-47b1-a9b7-821478c40b49 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:17.688555 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1357adb-3dc0-4d19-976e-4396e98074b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:17.689766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1357adb-3dc0-4d19-976e-4396e98074b2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:17.690295 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1357adb-3dc0-4d19-976e-4396e98074b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:17.690789 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1357adb-3dc0-4d19-976e-4396e98074b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:17.704930 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1357adb-3dc0-4d19-976e-4396e98074b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:17.714954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-a1357adb-3dc0-4d19-976e-4396e98074b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:27:17.714954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:17.714954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:17.714954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:17.714954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:17.714954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:17.714954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:17.714954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:17.714954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:17.714954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:17.714954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:17.714954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:17.714954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:17.714954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:17.714954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:17.714954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:17.716460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:17.716460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:17.716460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:17.716460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:17.716460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:17.716460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:17.716460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:17.716460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:17.716460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:17.716460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:17.716460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:17.716460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:17.716460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:17.716460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:17.716460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:17.716460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:17.717279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:17.717279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:17.717279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:17.717279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:17.717279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:17.717279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:17.717279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:17.717279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:17.717279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:17.717279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:17.717279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:27:17.717279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:17.720576 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 185/370] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:27:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:17.721587 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1357adb-3dc0-4d19-976e-4396e98074b2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:17.779733 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bbc50-9e6c-495e-b7ab-b474ead3140b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:17.816827 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87391f79-b1f3-4444-9159-d047b1e82729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:17.817450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87391f79-b1f3-4444-9159-d047b1e82729 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:17.817739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87391f79-b1f3-4444-9159-d047b1e82729 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:17.818017 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87391f79-b1f3-4444-9159-d047b1e82729 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:17.818837 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87391f79-b1f3-4444-9159-d047b1e82729 None admin] RBAC: Adding query filter params (group.id=1aedfc2f0f344be8a264e13c70093465, role.id=2d85fe2aee9740f984e944e0d5c80ec5, scope.project.id=0796b54c77a1493db97cdbe3488fc82b) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:17.819150 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87391f79-b1f3-4444-9159-d047b1e82729 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:17.820615 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87391f79-b1f3-4444-9159-d047b1e82729 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:17.827564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 186/371] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 30 10:27:17 2022] GET /identity/v3/role_assignments?group.id=1aedfc2f0f344be8a264e13c70093465&scope.project.id=0796b54c77a1493db97cdbe3488fc82b&role.id=2d85fe2aee9740f984e944e0d5c80ec5 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:17.828477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87391f79-b1f3-4444-9159-d047b1e82729 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:17.878201 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1357adb-3dc0-4d19-976e-4396e98074b2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:17.929672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7567f6-7cc2-4b78-b353-5ee678ca0917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:17.931054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7567f6-7cc2-4b78-b353-5ee678ca0917 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:17.931571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7567f6-7cc2-4b78-b353-5ee678ca0917 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:17.932273 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7567f6-7cc2-4b78-b353-5ee678ca0917 None admin] PATH_INFO: `/v3/users/e7189cfc8d9240c2a1e4be0f3f447f98` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:17.933783 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7567f6-7cc2-4b78-b353-5ee678ca0917 None admin] RBAC: Authorizing `identity:get_user(user_id=e7189cfc8d9240c2a1e4be0f3f447f98)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:17.936013 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7567f6-7cc2-4b78-b353-5ee678ca0917 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:17.939057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 186/372] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:27:17 2022] GET /identity/v3/users/e7189cfc8d9240c2a1e4be0f3f447f98 => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:17.940172 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7567f6-7cc2-4b78-b353-5ee678ca0917 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:17.944834 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:17.964311 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:18.054065 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87391f79-b1f3-4444-9159-d047b1e82729 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:18.066435 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7567f6-7cc2-4b78-b353-5ee678ca0917 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:18.109310 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7eef3-2bda-484c-b9ca-41d965e6e1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:18.110170 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7eef3-2bda-484c-b9ca-41d965e6e1fe None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:18.110456 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7eef3-2bda-484c-b9ca-41d965e6e1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:18.110734 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7eef3-2bda-484c-b9ca-41d965e6e1fe None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:18.111490 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7eef3-2bda-484c-b9ca-41d965e6e1fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:18.111800 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7eef3-2bda-484c-b9ca-41d965e6e1fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:18.114252 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7eef3-2bda-484c-b9ca-41d965e6e1fe None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:18.125259 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 187/373] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:18.126113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7eef3-2bda-484c-b9ca-41d965e6e1fe None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:18.128271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bb5a1-a49d-485a-9a6f-fa1fb71372c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:18.129650 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bb5a1-a49d-485a-9a6f-fa1fb71372c9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:18.130202 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bb5a1-a49d-485a-9a6f-fa1fb71372c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:18.130702 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bb5a1-a49d-485a-9a6f-fa1fb71372c9 None admin] PATH_INFO: `/v3/groups/1aedfc2f0f344be8a264e13c70093465` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:18.134337 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7bb5a1-a49d-485a-9a6f-fa1fb71372c9 None admin] RBAC: Authorizing `identity:get_group(group_id=1aedfc2f0f344be8a264e13c70093465)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:18.136083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7bb5a1-a49d-485a-9a6f-fa1fb71372c9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:18.138712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 187/374] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 30 10:27:17 2022] GET /identity/v3/groups/1aedfc2f0f344be8a264e13c70093465 => generated 226 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:18.141905 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bb5a1-a49d-485a-9a6f-fa1fb71372c9 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:18.222427 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:18.265358 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7eef3-2bda-484c-b9ca-41d965e6e1fe None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:18.310165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a776ccc-517c-491f-9d11-22a45be4dc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:18.310851 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a776ccc-517c-491f-9d11-22a45be4dc01 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:18.311137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a776ccc-517c-491f-9d11-22a45be4dc01 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:18.311412 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a776ccc-517c-491f-9d11-22a45be4dc01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:18.312356 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a776ccc-517c-491f-9d11-22a45be4dc01 None admin] RBAC: Adding query filter params (role.id=b3bea9d8f5294a5b8aaecb6c9bfeee6a, user.id=e7189cfc8d9240c2a1e4be0f3f447f98, scope.system=all) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:18.312794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a776ccc-517c-491f-9d11-22a45be4dc01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:18.314249 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a776ccc-517c-491f-9d11-22a45be4dc01 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:18.322812 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bb5a1-a49d-485a-9a6f-fa1fb71372c9 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:18.343634 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 188/375] 10.222.0.59 () {56 vars in 1308 bytes} [Thu Jun 30 10:27:18 2022] GET /identity/v3/role_assignments?user.id=e7189cfc8d9240c2a1e4be0f3f447f98&scope.system=all&role.id=b3bea9d8f5294a5b8aaecb6c9bfeee6a => generated 510 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:18.345002 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a776ccc-517c-491f-9d11-22a45be4dc01 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:18.349470 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:18.359570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25671c48-b13a-4761-8134-bc2c8f53039b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:18.360327 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25671c48-b13a-4761-8134-bc2c8f53039b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:18.360716 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25671c48-b13a-4761-8134-bc2c8f53039b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:18.361096 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25671c48-b13a-4761-8134-bc2c8f53039b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:18.439243 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25671c48-b13a-4761-8134-bc2c8f53039b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:18.440868 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25671c48-b13a-4761-8134-bc2c8f53039b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:18.531345 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a776ccc-517c-491f-9d11-22a45be4dc01 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:18.555534 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 188/376] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:27:18.556621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25671c48-b13a-4761-8134-bc2c8f53039b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:18.569721 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:18.587977 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:18.600669 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52c978-c28d-4731-8739-369e3bc762a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:18.601353 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52c978-c28d-4731-8739-369e3bc762a1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:18.601624 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52c978-c28d-4731-8739-369e3bc762a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:18.601900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52c978-c28d-4731-8739-369e3bc762a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:18.602740 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52c978-c28d-4731-8739-369e3bc762a1 None admin] RBAC: Adding query filter params (group.id=1aedfc2f0f344be8a264e13c70093465, role.id=2d85fe2aee9740f984e944e0d5c80ec5, scope.project.id=0a89ccc08f1b4490a6206c230a1720ff) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:18.603053 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52c978-c28d-4731-8739-369e3bc762a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:18.604522 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52c978-c28d-4731-8739-369e3bc762a1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:18.615247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 189/377] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 30 10:27:18 2022] GET /identity/v3/role_assignments?group.id=1aedfc2f0f344be8a264e13c70093465&scope.project.id=0a89ccc08f1b4490a6206c230a1720ff&role.id=2d85fe2aee9740f984e944e0d5c80ec5 => generated 260 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:18.681241 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25671c48-b13a-4761-8134-bc2c8f53039b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:18.727714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2a79a-3703-454d-8a72-ec5e3bb22106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:18.728596 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2a79a-3703-454d-8a72-ec5e3bb22106 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:18.728881 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2a79a-3703-454d-8a72-ec5e3bb22106 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:18.729153 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2a79a-3703-454d-8a72-ec5e3bb22106 None admin] PATH_INFO: `/v3/projects/e1140dfc0b9a4b21aa549fc69cc6961b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:18.730395 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f2a79a-3703-454d-8a72-ec5e3bb22106 None admin] RBAC: Authorizing `identity:get_project(project_id=e1140dfc0b9a4b21aa549fc69cc6961b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:18.732447 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f2a79a-3703-454d-8a72-ec5e3bb22106 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:18.734572 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 189/378] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:27:18 2022] GET /identity/v3/projects/e1140dfc0b9a4b21aa549fc69cc6961b => generated 344 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:18.740289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52c978-c28d-4731-8739-369e3bc762a1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:18.878647 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52c978-c28d-4731-8739-369e3bc762a1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:18.896471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6d950-e35b-46b1-a8b9-de91aad6217f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:18.898396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6d950-e35b-46b1-a8b9-de91aad6217f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:18.898860 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6d950-e35b-46b1-a8b9-de91aad6217f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:18.903960 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 190/379] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:18.910129 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5e2a3-42c1-488a-8fcd-198d8fb7dd41 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:18.910526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5e2a3-42c1-488a-8fcd-198d8fb7dd41 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:18.910879 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5e2a3-42c1-488a-8fcd-198d8fb7dd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:18.923187 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e69b98-c6e9-4edd-919e-04a56a2cd6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:18.924046 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e69b98-c6e9-4edd-919e-04a56a2cd6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:18.924370 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e69b98-c6e9-4edd-919e-04a56a2cd6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:18.924722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e69b98-c6e9-4edd-919e-04a56a2cd6a2 None admin] PATH_INFO: `/v3/groups/ab872b86497143f89c1681c8e9c5675a` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:18.933645 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e69b98-c6e9-4edd-919e-04a56a2cd6a2 None admin] RBAC: Authorizing `identity:get_group(group_id=ab872b86497143f89c1681c8e9c5675a)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:18.935168 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e69b98-c6e9-4edd-919e-04a56a2cd6a2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:18.937088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 190/380] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 30 10:27:18 2022] GET /identity/v3/groups/ab872b86497143f89c1681c8e9c5675a => generated 229 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:18.943213 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-4dc5e2a3-42c1-488a-8fcd-198d8fb7dd41 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:18.943458 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e69b98-c6e9-4edd-919e-04a56a2cd6a2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:18.944425 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4dc5e2a3-42c1-488a-8fcd-198d8fb7dd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:18.999471 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:19.047892 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 191/381] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:19.066409 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e69b98-c6e9-4edd-919e-04a56a2cd6a2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:19.068681 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5e2a3-42c1-488a-8fcd-198d8fb7dd41 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:19.106368 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:19.143500 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e657b-d3ad-432e-94ea-04c1b20e8d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:19.144155 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e657b-d3ad-432e-94ea-04c1b20e8d65 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:19.144436 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e657b-d3ad-432e-94ea-04c1b20e8d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:19.144743 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e657b-d3ad-432e-94ea-04c1b20e8d65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:19.145570 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e657b-d3ad-432e-94ea-04c1b20e8d65 None admin] RBAC: Adding query filter params (group.id=ab872b86497143f89c1681c8e9c5675a, role.id=ab64ea6d0475430195af26a049485569, scope.project.id=e1140dfc0b9a4b21aa549fc69cc6961b) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:19.145884 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e657b-d3ad-432e-94ea-04c1b20e8d65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:19.147321 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e657b-d3ad-432e-94ea-04c1b20e8d65 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:19.159637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 191/382] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 30 10:27:18 2022] GET /identity/v3/role_assignments?group.id=ab872b86497143f89c1681c8e9c5675a&scope.project.id=e1140dfc0b9a4b21aa549fc69cc6961b&role.id=ab64ea6d0475430195af26a049485569 => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:19.219937 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5e2a3-42c1-488a-8fcd-198d8fb7dd41 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:19.263879 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904c631-5026-4a0e-bc9f-e9a78badfb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:19.264709 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904c631-5026-4a0e-bc9f-e9a78badfb72 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:19.264995 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904c631-5026-4a0e-bc9f-e9a78badfb72 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:19.265273 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904c631-5026-4a0e-bc9f-e9a78badfb72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:19.281411 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904c631-5026-4a0e-bc9f-e9a78badfb72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:19.289471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-c904c631-5026-4a0e-bc9f-e9a78badfb72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:27:19.289471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:19.289471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:19.289471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:19.289471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:19.289471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:19.289471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:19.289471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:19.289471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:19.289471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:19.289471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:19.289471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:19.289471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:19.289471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:19.289471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:19.289471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:19.290422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:19.290422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:19.290422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:19.290422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:19.290422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:19.290422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:19.290422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:19.290422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:19.290422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:19.290422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:19.290422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:19.290422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:19.290422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:19.290422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:19.290422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:19.290422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:19.291208 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:19.291208 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:19.291208 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:19.291208 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:19.291208 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:19.291208 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:19.291208 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:19.291208 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:19.291208 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:19.291208 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:19.291208 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:27:19.291208 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:19.291208 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 192/383] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:27:19.299194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e657b-d3ad-432e-94ea-04c1b20e8d65 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:19.433319 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e657b-d3ad-432e-94ea-04c1b20e8d65 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:19.455207 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:19.462712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429507b3-e845-4bf5-ab29-f81d270afcb9 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:19.463227 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429507b3-e845-4bf5-ab29-f81d270afcb9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:19.463303 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429507b3-e845-4bf5-ab29-f81d270afcb9 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:19.464776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 193/384] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:27:19.475084 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93200299-b1ae-4abc-b07c-ebd0c8d935dc None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:19.475699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93200299-b1ae-4abc-b07c-ebd0c8d935dc None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:19.476169 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93200299-b1ae-4abc-b07c-ebd0c8d935dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:19.491933 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827c635-34d1-4c92-b239-076ceeecf7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:19.494687 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827c635-34d1-4c92-b239-076ceeecf7ec None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:19.494687 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827c635-34d1-4c92-b239-076ceeecf7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:19.494687 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827c635-34d1-4c92-b239-076ceeecf7ec None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:19.494687 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827c635-34d1-4c92-b239-076ceeecf7ec None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:19.494982 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827c635-34d1-4c92-b239-076ceeecf7ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:19.496228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827c635-34d1-4c92-b239-076ceeecf7ec None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:19.504286 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-93200299-b1ae-4abc-b07c-ebd0c8d935dc None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:19.505748 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-93200299-b1ae-4abc-b07c-ebd0c8d935dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:19.507004 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 192/385] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:27:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:19.515532 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827c635-34d1-4c92-b239-076ceeecf7ec None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:19.631101 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 194/386] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:19.644005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827c635-34d1-4c92-b239-076ceeecf7ec None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:19.689280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d3be5-240f-49dd-b15e-5ff58723df01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:19.690262 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d3be5-240f-49dd-b15e-5ff58723df01 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:19.690737 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d3be5-240f-49dd-b15e-5ff58723df01 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:19.691219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d3be5-240f-49dd-b15e-5ff58723df01 None admin] PATH_INFO: `/v3/groups/1aedfc2f0f344be8a264e13c70093465` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:19.693345 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d3be5-240f-49dd-b15e-5ff58723df01 None admin] RBAC: Authorizing `identity:get_group(group_id=1aedfc2f0f344be8a264e13c70093465)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:19.696087 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d3be5-240f-49dd-b15e-5ff58723df01 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:19.699192 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 193/387] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 30 10:27:19 2022] GET /identity/v3/groups/1aedfc2f0f344be8a264e13c70093465 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:19.705464 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93200299-b1ae-4abc-b07c-ebd0c8d935dc None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:19.714687 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d3be5-240f-49dd-b15e-5ff58723df01 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:19.738022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:19.770262 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:19.831711 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d3be5-240f-49dd-b15e-5ff58723df01 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:19.869914 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae326931-499d-4e67-893c-9af8c90beee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:19.870708 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae326931-499d-4e67-893c-9af8c90beee4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:19.870999 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae326931-499d-4e67-893c-9af8c90beee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:19.871277 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae326931-499d-4e67-893c-9af8c90beee4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:19.893435 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae326931-499d-4e67-893c-9af8c90beee4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:19.902073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-ae326931-499d-4e67-893c-9af8c90beee4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:27:19.902073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:19.902073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:19.902073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:19.902073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:19.902073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:19.902073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:19.902073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:19.902073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:19.902073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:19.902073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:19.902073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:19.902073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:19.902073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:19.902073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:19.902073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:19.903022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:19.903022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:19.903022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:19.903022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:19.903022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:19.903022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:19.903022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:19.903022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:19.903022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:19.903022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:19.903022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:19.903022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:19.903022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:19.903022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:19.903022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:19.903022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:19.903863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:19.903863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:19.903863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:19.903863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:19.903863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:19.903863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:19.903863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:19.903863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:19.903863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:19.903863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:19.903863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:27:19.903863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:19.912466 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 194/388] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:27:19.921210 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93200299-b1ae-4abc-b07c-ebd0c8d935dc None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:19.922369 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae326931-499d-4e67-893c-9af8c90beee4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:19.989588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759078c-403e-4114-8dc8-0dc27073db92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:19.990792 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759078c-403e-4114-8dc8-0dc27073db92 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:19.991274 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759078c-403e-4114-8dc8-0dc27073db92 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:19.991748 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759078c-403e-4114-8dc8-0dc27073db92 None admin] PATH_INFO: `/v3/projects/0796b54c77a1493db97cdbe3488fc82b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:19.993558 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759078c-403e-4114-8dc8-0dc27073db92 None admin] RBAC: Authorizing `identity:get_project(project_id=0796b54c77a1493db97cdbe3488fc82b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:19.995245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759078c-403e-4114-8dc8-0dc27073db92 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:19.998700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 195/389] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:27:19 2022] GET /identity/v3/projects/0796b54c77a1493db97cdbe3488fc82b => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:20.006547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759078c-403e-4114-8dc8-0dc27073db92 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:20.098675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae326931-499d-4e67-893c-9af8c90beee4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:20.107999 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:20.160272 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6865d-9d43-482c-8cf8-e8db5cc73f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:20.161467 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6865d-9d43-482c-8cf8-e8db5cc73f36 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:20.161971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6865d-9d43-482c-8cf8-e8db5cc73f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:20.165665 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6865d-9d43-482c-8cf8-e8db5cc73f36 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:20.166858 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6865d-9d43-482c-8cf8-e8db5cc73f36 None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:20.167399 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6865d-9d43-482c-8cf8-e8db5cc73f36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:20.169716 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6865d-9d43-482c-8cf8-e8db5cc73f36 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:20.170241 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:20.181622 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 195/390] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:27:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:20.187165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6865d-9d43-482c-8cf8-e8db5cc73f36 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:20.213503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759078c-403e-4114-8dc8-0dc27073db92 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:20.293222 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53adf5-8448-43d7-ad62-51d88b77d6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:20.294691 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53adf5-8448-43d7-ad62-51d88b77d6de None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:20.294972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53adf5-8448-43d7-ad62-51d88b77d6de None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:20.295242 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53adf5-8448-43d7-ad62-51d88b77d6de None admin] PATH_INFO: `/v3/projects/0796b54c77a1493db97cdbe3488fc82b/groups/1aedfc2f0f344be8a264e13c70093465/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:20.301314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53adf5-8448-43d7-ad62-51d88b77d6de None admin] RBAC: Authorizing `identity:create_grant(project_id=0796b54c77a1493db97cdbe3488fc82b, group_id=1aedfc2f0f344be8a264e13c70093465, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:20.302786 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53adf5-8448-43d7-ad62-51d88b77d6de None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:20.326729 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 196/391] 10.222.0.59 () {58 vars in 1442 bytes} [Thu Jun 30 10:27:20 2022] PUT /identity/v3/projects/0796b54c77a1493db97cdbe3488fc82b/groups/1aedfc2f0f344be8a264e13c70093465/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:27:20.339158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6865d-9d43-482c-8cf8-e8db5cc73f36 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:20.386308 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ccc87-69b0-4c9e-88bc-51878491ff7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:20.387775 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ccc87-69b0-4c9e-88bc-51878491ff7d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:20.388096 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ccc87-69b0-4c9e-88bc-51878491ff7d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:20.388349 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ccc87-69b0-4c9e-88bc-51878491ff7d None admin] PATH_INFO: `/v3/groups/1aedfc2f0f344be8a264e13c70093465` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:20.389670 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ccc87-69b0-4c9e-88bc-51878491ff7d None admin] RBAC: Authorizing `identity:get_group(group_id=1aedfc2f0f344be8a264e13c70093465)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:20.391238 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ccc87-69b0-4c9e-88bc-51878491ff7d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:20.393022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 196/392] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 30 10:27:20 2022] GET /identity/v3/groups/1aedfc2f0f344be8a264e13c70093465 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:20.398691 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53adf5-8448-43d7-ad62-51d88b77d6de None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:20.512866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53adf5-8448-43d7-ad62-51d88b77d6de None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:20.549091 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2613d7f-5ce3-4e8e-a863-260985ae956c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:20.549955 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2613d7f-5ce3-4e8e-a863-260985ae956c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:20.550236 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2613d7f-5ce3-4e8e-a863-260985ae956c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:20.550512 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2613d7f-5ce3-4e8e-a863-260985ae956c None admin] PATH_INFO: `/v3/projects/0a89ccc08f1b4490a6206c230a1720ff` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:20.551778 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2613d7f-5ce3-4e8e-a863-260985ae956c None admin] RBAC: Authorizing `identity:get_project(project_id=0a89ccc08f1b4490a6206c230a1720ff)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:20.553264 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2613d7f-5ce3-4e8e-a863-260985ae956c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:20.555269 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 197/393] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:27:20 2022] GET /identity/v3/projects/0a89ccc08f1b4490a6206c230a1720ff => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:20.561416 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ccc87-69b0-4c9e-88bc-51878491ff7d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:20.597724 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa081834-05ab-4b23-95b5-ab22317335f6 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:20.598062 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa081834-05ab-4b23-95b5-ab22317335f6 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:20.598276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa081834-05ab-4b23-95b5-ab22317335f6 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:20.600132 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 198/394] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:20.605348 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972189a5-272c-4833-a19b-bcd99ddd5652 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:20.605636 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972189a5-272c-4833-a19b-bcd99ddd5652 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:20.606440 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972189a5-272c-4833-a19b-bcd99ddd5652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:20.615935 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:20.627366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-972189a5-272c-4833-a19b-bcd99ddd5652 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:20.628586 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-972189a5-272c-4833-a19b-bcd99ddd5652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:20.641483 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:20.702600 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ccc87-69b0-4c9e-88bc-51878491ff7d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:20.722886 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 199/395] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:27:20.751009 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97303fa4-c941-42c3-9827-eaf0792da0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:20.751900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97303fa4-c941-42c3-9827-eaf0792da0fb None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:20.752184 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97303fa4-c941-42c3-9827-eaf0792da0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:20.752465 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97303fa4-c941-42c3-9827-eaf0792da0fb None admin] PATH_INFO: `/v3/projects/0a89ccc08f1b4490a6206c230a1720ff/groups/1aedfc2f0f344be8a264e13c70093465/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:20.756732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97303fa4-c941-42c3-9827-eaf0792da0fb None admin] RBAC: Authorizing `identity:create_grant(project_id=0a89ccc08f1b4490a6206c230a1720ff, group_id=1aedfc2f0f344be8a264e13c70093465, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:20.758200 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97303fa4-c941-42c3-9827-eaf0792da0fb None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:20.760339 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972189a5-272c-4833-a19b-bcd99ddd5652 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:20.780117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 197/396] 10.222.0.59 () {58 vars in 1442 bytes} [Thu Jun 30 10:27:20 2022] PUT /identity/v3/projects/0a89ccc08f1b4490a6206c230a1720ff/groups/1aedfc2f0f344be8a264e13c70093465/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:27:20.900357 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972189a5-272c-4833-a19b-bcd99ddd5652 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:20.946428 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1216f8-aa70-4fe2-8f52-087e9c400ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:20.947263 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1216f8-aa70-4fe2-8f52-087e9c400ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:20.947542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1216f8-aa70-4fe2-8f52-087e9c400ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:20.947816 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1216f8-aa70-4fe2-8f52-087e9c400ec4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:20.959604 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:20.968655 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1216f8-aa70-4fe2-8f52-087e9c400ec4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:20.977219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-df1216f8-aa70-4fe2-8f52-087e9c400ec4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:27:20.977219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:20.977219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:20.977219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:20.977219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:20.977219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:20.977219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:20.977219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:20.977219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:20.977219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:20.977219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:20.977219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:20.977219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:20.977219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:20.977219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:20.977219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:20.978105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:20.978105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:20.978105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:20.978105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:20.978105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:20.978105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:20.978105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:20.978105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:20.978105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:20.978105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:20.978105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:20.978105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:20.978105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:20.978105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:20.978105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:20.978105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:20.978884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:20.978884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:20.978884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:20.978884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:20.978884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:20.978884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:20.978884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:20.978884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:20.978884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:20.978884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:20.978884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:27:20.978884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:20.979489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 200/397] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 30 10:27:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:27:20.984898 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97303fa4-c941-42c3-9827-eaf0792da0fb None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:21.096197 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:21.105018 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97303fa4-c941-42c3-9827-eaf0792da0fb None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:21.150413 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0003dfe-b974-4e43-8f9c-eea0770a8516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:21.151090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0003dfe-b974-4e43-8f9c-eea0770a8516 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:21.151379 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0003dfe-b974-4e43-8f9c-eea0770a8516 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:21.151660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0003dfe-b974-4e43-8f9c-eea0770a8516 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:21.152423 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0003dfe-b974-4e43-8f9c-eea0770a8516 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:21.152808 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0003dfe-b974-4e43-8f9c-eea0770a8516 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:21.154290 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0003dfe-b974-4e43-8f9c-eea0770a8516 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:21.168289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 198/398] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:27:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:21.174331 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1216f8-aa70-4fe2-8f52-087e9c400ec4 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:21.295583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1216f8-aa70-4fe2-8f52-087e9c400ec4 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:21.342964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b2e5f-3f44-4104-b4ea-c2f0536606b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:21.343837 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b2e5f-3f44-4104-b4ea-c2f0536606b3 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:21.344122 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b2e5f-3f44-4104-b4ea-c2f0536606b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:21.344402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b2e5f-3f44-4104-b4ea-c2f0536606b3 None admin] PATH_INFO: `/v3/groups/1aedfc2f0f344be8a264e13c70093465` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:21.345621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b2e5f-3f44-4104-b4ea-c2f0536606b3 None admin] RBAC: Authorizing `identity:get_group(group_id=1aedfc2f0f344be8a264e13c70093465)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:21.347130 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b2e5f-3f44-4104-b4ea-c2f0536606b3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:21.351548 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 201/399] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 30 10:27:21 2022] GET /identity/v3/groups/1aedfc2f0f344be8a264e13c70093465 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:21.354496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0003dfe-b974-4e43-8f9c-eea0770a8516 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:21.379469 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141064bc-d8ac-4749-aae4-7ca0ea8827cc None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:21.379779 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141064bc-d8ac-4749-aae4-7ca0ea8827cc None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:21.380039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141064bc-d8ac-4749-aae4-7ca0ea8827cc None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:21.381442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 202/400] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:27:21.386689 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23219993-87ad-4ac0-9a81-816bce230050 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:21.386980 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23219993-87ad-4ac0-9a81-816bce230050 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:21.387296 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23219993-87ad-4ac0-9a81-816bce230050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:21.404372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-23219993-87ad-4ac0-9a81-816bce230050 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:21.405656 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-23219993-87ad-4ac0-9a81-816bce230050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:21.493601 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:21.505107 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 203/401] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:27:21.519492 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0003dfe-b974-4e43-8f9c-eea0770a8516 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:21.525934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23219993-87ad-4ac0-9a81-816bce230050 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:21.556668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312f626-deee-4e2d-b169-a4d49a8724a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:21.557524 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312f626-deee-4e2d-b169-a4d49a8724a8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:21.557809 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312f626-deee-4e2d-b169-a4d49a8724a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:21.558088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312f626-deee-4e2d-b169-a4d49a8724a8 None admin] PATH_INFO: `/v3/projects/0796b54c77a1493db97cdbe3488fc82b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:21.559343 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312f626-deee-4e2d-b169-a4d49a8724a8 None admin] RBAC: Authorizing `identity:get_project(project_id=0796b54c77a1493db97cdbe3488fc82b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:21.560827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312f626-deee-4e2d-b169-a4d49a8724a8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:21.563203 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 199/402] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:27:21 2022] GET /identity/v3/projects/0796b54c77a1493db97cdbe3488fc82b => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:21.569047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312f626-deee-4e2d-b169-a4d49a8724a8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:21.599639 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:21.678425 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312f626-deee-4e2d-b169-a4d49a8724a8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:21.714782 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6802d-612c-4b25-b6d7-79e05bf0ed68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:21.715699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6802d-612c-4b25-b6d7-79e05bf0ed68 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:21.715985 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6802d-612c-4b25-b6d7-79e05bf0ed68 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:21.717576 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6802d-612c-4b25-b6d7-79e05bf0ed68 None admin] PATH_INFO: `/v3/projects/0796b54c77a1493db97cdbe3488fc82b/groups/1aedfc2f0f344be8a264e13c70093465/roles/2d85fe2aee9740f984e944e0d5c80ec5` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:21.721231 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6802d-612c-4b25-b6d7-79e05bf0ed68 None admin] RBAC: Authorizing `identity:create_grant(project_id=0796b54c77a1493db97cdbe3488fc82b, group_id=1aedfc2f0f344be8a264e13c70093465, role_id=2d85fe2aee9740f984e944e0d5c80ec5)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:21.722690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6802d-612c-4b25-b6d7-79e05bf0ed68 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:21.727068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23219993-87ad-4ac0-9a81-816bce230050 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:21.748048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 200/403] 10.222.0.59 () {58 vars in 1442 bytes} [Thu Jun 30 10:27:21 2022] PUT /identity/v3/projects/0796b54c77a1493db97cdbe3488fc82b/groups/1aedfc2f0f344be8a264e13c70093465/roles/2d85fe2aee9740f984e944e0d5c80ec5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:27:21.792586 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69c58f-a7a4-4966-892b-ee5fb6341863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:21.793760 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69c58f-a7a4-4966-892b-ee5fb6341863 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:21.794241 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69c58f-a7a4-4966-892b-ee5fb6341863 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:21.794684 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69c58f-a7a4-4966-892b-ee5fb6341863 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:21.815818 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69c58f-a7a4-4966-892b-ee5fb6341863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:21.824415 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-0d69c58f-a7a4-4966-892b-ee5fb6341863 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:27:21.824415 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:21.824415 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:21.824415 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:21.824415 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:21.824415 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:21.824415 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:21.824415 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:21.824415 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:21.824415 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:21.824415 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:21.824415 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:21.824415 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:21.824415 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:21.824415 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:21.824415 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:21.826007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:21.826007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:21.826007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:21.826007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:21.826007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:21.826007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:21.826007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:21.826007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:21.826007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:21.826007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:21.826007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:21.826007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:21.826007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:21.826007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:21.826007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:21.826007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:21.826791 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:21.826791 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:21.826791 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:21.826791 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:21.826791 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:21.826791 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:21.826791 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:21.826791 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:21.826791 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:21.826791 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:21.826791 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:27:21.826791 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:21.829082 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 204/404] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 30 10:27:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:21.835511 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6802d-612c-4b25-b6d7-79e05bf0ed68 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:21.937533 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:21.955626 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6802d-612c-4b25-b6d7-79e05bf0ed68 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:21.990026 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53aef01-1f6b-46f1-bd52-cbbf9ee8029a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:21.990707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53aef01-1f6b-46f1-bd52-cbbf9ee8029a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:21.990992 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53aef01-1f6b-46f1-bd52-cbbf9ee8029a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:21.991264 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53aef01-1f6b-46f1-bd52-cbbf9ee8029a None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:21.992028 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53aef01-1f6b-46f1-bd52-cbbf9ee8029a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:21.992336 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53aef01-1f6b-46f1-bd52-cbbf9ee8029a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:21.993773 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53aef01-1f6b-46f1-bd52-cbbf9ee8029a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:22.005411 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 201/405] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:27:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:22.010881 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69c58f-a7a4-4966-892b-ee5fb6341863 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:22.075441 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:22.121336 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69c58f-a7a4-4966-892b-ee5fb6341863 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:22.165651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e31aec-a575-4e24-a3f1-1b8a064b69f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:22.166581 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e31aec-a575-4e24-a3f1-1b8a064b69f7 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:22.166865 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e31aec-a575-4e24-a3f1-1b8a064b69f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:22.167139 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e31aec-a575-4e24-a3f1-1b8a064b69f7 None admin] PATH_INFO: `/v3/groups/1aedfc2f0f344be8a264e13c70093465` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:22.173306 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e31aec-a575-4e24-a3f1-1b8a064b69f7 None admin] RBAC: Authorizing `identity:get_group(group_id=1aedfc2f0f344be8a264e13c70093465)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:22.174774 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e31aec-a575-4e24-a3f1-1b8a064b69f7 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:22.176455 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 205/406] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 30 10:27:22 2022] GET /identity/v3/groups/1aedfc2f0f344be8a264e13c70093465 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:22.182251 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53aef01-1f6b-46f1-bd52-cbbf9ee8029a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:22.286637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53aef01-1f6b-46f1-bd52-cbbf9ee8029a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:22.320354 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd95a2a-cb46-4eb2-a992-0cb04d48c8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:22.321243 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd95a2a-cb46-4eb2-a992-0cb04d48c8c7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:22.321527 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd95a2a-cb46-4eb2-a992-0cb04d48c8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:22.321803 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd95a2a-cb46-4eb2-a992-0cb04d48c8c7 None admin] PATH_INFO: `/v3/projects/0a89ccc08f1b4490a6206c230a1720ff` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:22.322976 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd95a2a-cb46-4eb2-a992-0cb04d48c8c7 None admin] RBAC: Authorizing `identity:get_project(project_id=0a89ccc08f1b4490a6206c230a1720ff)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:22.324423 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd95a2a-cb46-4eb2-a992-0cb04d48c8c7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:22.326974 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 202/407] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:27:22 2022] GET /identity/v3/projects/0a89ccc08f1b4490a6206c230a1720ff => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:22.333521 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e31aec-a575-4e24-a3f1-1b8a064b69f7 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:22.364349 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b2139-542c-4230-ad03-458df8fcb2e0 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:22.364714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b2139-542c-4230-ad03-458df8fcb2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:22.364997 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b2139-542c-4230-ad03-458df8fcb2e0 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:22.366501 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 203/408] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:22.374650 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b3b39-1ffe-4042-8904-2d41d9fc6b41 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:22.375467 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b3b39-1ffe-4042-8904-2d41d9fc6b41 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:22.376047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b3b39-1ffe-4042-8904-2d41d9fc6b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:22.395569 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6d8b3b39-1ffe-4042-8904-2d41d9fc6b41 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:22.398354 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6d8b3b39-1ffe-4042-8904-2d41d9fc6b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:22.432920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:22.506512 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e31aec-a575-4e24-a3f1-1b8a064b69f7 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:22.520274 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 204/409] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:27:22.550042 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:22.562721 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d695d77-8577-48a1-beb2-36a91a1da5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:22.563610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d695d77-8577-48a1-beb2-36a91a1da5f0 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:22.563897 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d695d77-8577-48a1-beb2-36a91a1da5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:22.564170 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d695d77-8577-48a1-beb2-36a91a1da5f0 None admin] PATH_INFO: `/v3/projects/0a89ccc08f1b4490a6206c230a1720ff/groups/1aedfc2f0f344be8a264e13c70093465/roles/2d85fe2aee9740f984e944e0d5c80ec5` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:22.570001 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b3b39-1ffe-4042-8904-2d41d9fc6b41 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:22.570624 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d695d77-8577-48a1-beb2-36a91a1da5f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a89ccc08f1b4490a6206c230a1720ff, group_id=1aedfc2f0f344be8a264e13c70093465, role_id=2d85fe2aee9740f984e944e0d5c80ec5)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:22.572073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d695d77-8577-48a1-beb2-36a91a1da5f0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:22.600088 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 206/410] 10.222.0.59 () {58 vars in 1442 bytes} [Thu Jun 30 10:27:22 2022] PUT /identity/v3/projects/0a89ccc08f1b4490a6206c230a1720ff/groups/1aedfc2f0f344be8a264e13c70093465/roles/2d85fe2aee9740f984e944e0d5c80ec5 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:27:22.694846 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b3b39-1ffe-4042-8904-2d41d9fc6b41 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:22.732574 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e12a1-9f7a-450b-b036-973063de6186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:22.733363 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e12a1-9f7a-450b-b036-973063de6186 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:22.733649 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e12a1-9f7a-450b-b036-973063de6186 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:22.733922 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e12a1-9f7a-450b-b036-973063de6186 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:22.745393 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e12a1-9f7a-450b-b036-973063de6186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:22.753794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-533e12a1-9f7a-450b-b036-973063de6186 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:27:22.753794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:22.753794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:22.753794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:22.753794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:22.753794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:22.753794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:22.753794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:22.753794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:22.753794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:22.753794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:22.753794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:22.753794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:22.753794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:22.753794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:22.753794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:22.754711 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:22.754711 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:22.754711 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:22.754711 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:22.754711 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:22.754711 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:22.754711 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:22.754711 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:22.754711 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:22.754711 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:22.754711 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:22.754711 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:22.754711 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:22.754711 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:22.754711 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:22.754711 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:22.755788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:22.755788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:22.755788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:22.755788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:22.755788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:22.755788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:22.755788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:22.755788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:22.755788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:22.755788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:22.755788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:27:22.755788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:22.755788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 205/411] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:27:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:27:22.763341 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d695d77-8577-48a1-beb2-36a91a1da5f0 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:22.901705 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d695d77-8577-48a1-beb2-36a91a1da5f0 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:22.938723 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1221251-8f5a-4100-9834-38b72f91100e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:22.939398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1221251-8f5a-4100-9834-38b72f91100e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:22.939680 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1221251-8f5a-4100-9834-38b72f91100e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:22.939953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1221251-8f5a-4100-9834-38b72f91100e None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:22.940732 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1221251-8f5a-4100-9834-38b72f91100e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:22.941041 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1221251-8f5a-4100-9834-38b72f91100e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:22.942396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1221251-8f5a-4100-9834-38b72f91100e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:22.951613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 207/412] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:22.957192 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e12a1-9f7a-450b-b036-973063de6186 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:22.967364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:23.045286 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa88e1-48ab-4133-a8aa-d18b73b9e05f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:23.045606 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa88e1-48ab-4133-a8aa-d18b73b9e05f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:23.045849 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa88e1-48ab-4133-a8aa-d18b73b9e05f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:23.048151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 208/413] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:27:23.053445 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e5ae3-73b5-44f3-b9a3-b0472f7c008f None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:23.053735 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e5ae3-73b5-44f3-b9a3-b0472f7c008f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:23.054014 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e5ae3-73b5-44f3-b9a3-b0472f7c008f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:23.073845 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c62e5ae3-73b5-44f3-b9a3-b0472f7c008f None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:23.075842 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c62e5ae3-73b5-44f3-b9a3-b0472f7c008f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:23.076876 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e12a1-9f7a-450b-b036-973063de6186 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:23.127051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:23.157308 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac8b08-e2b6-4c43-b30e-f36ea8269c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:23.157732 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 209/414] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:27:23.158391 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac8b08-e2b6-4c43-b30e-f36ea8269c18 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:23.158677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac8b08-e2b6-4c43-b30e-f36ea8269c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:23.159014 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac8b08-e2b6-4c43-b30e-f36ea8269c18 None admin] PATH_INFO: `/v3/groups/ab872b86497143f89c1681c8e9c5675a` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:23.165362 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac8b08-e2b6-4c43-b30e-f36ea8269c18 None admin] RBAC: Authorizing `identity:get_group(group_id=ab872b86497143f89c1681c8e9c5675a)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:23.166841 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac8b08-e2b6-4c43-b30e-f36ea8269c18 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:23.172703 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 206/415] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 30 10:27:22 2022] GET /identity/v3/groups/ab872b86497143f89c1681c8e9c5675a => generated 229 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:23.174298 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e5ae3-73b5-44f3-b9a3-b0472f7c008f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:23.212924 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac8b08-e2b6-4c43-b30e-f36ea8269c18 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:23.317725 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:23.346369 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac8b08-e2b6-4c43-b30e-f36ea8269c18 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:23.383839 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8139ae-d18b-4e2b-8406-0b440de5108d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:23.384684 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8139ae-d18b-4e2b-8406-0b440de5108d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:23.384987 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8139ae-d18b-4e2b-8406-0b440de5108d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:23.385253 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8139ae-d18b-4e2b-8406-0b440de5108d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:23.386881 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e5ae3-73b5-44f3-b9a3-b0472f7c008f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:23.398752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8139ae-d18b-4e2b-8406-0b440de5108d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:23.406827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-8c8139ae-d18b-4e2b-8406-0b440de5108d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:27:23.406827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:23.406827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:23.406827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:23.406827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:23.406827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:23.406827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:23.406827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:23.406827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:23.406827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:23.406827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:23.406827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:23.406827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:23.406827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:23.406827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:23.406827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:23.407769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:23.407769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:23.407769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:23.407769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:23.407769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:23.407769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:23.407769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:23.407769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:23.407769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:23.407769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:23.407769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:23.407769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:23.407769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:23.407769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:23.407769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:23.407769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:23.408778 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:23.408778 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:23.408778 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:23.408778 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:23.408778 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:23.408778 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:23.408778 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:23.408778 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:23.408778 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:23.408778 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:23.408778 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:27:23.408778 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:23.408778 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 207/416] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:27:23.414517 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8139ae-d18b-4e2b-8406-0b440de5108d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:23.469768 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56064e75-33df-4a4d-a9ba-00cc7490a6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:23.471126 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56064e75-33df-4a4d-a9ba-00cc7490a6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:23.471617 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56064e75-33df-4a4d-a9ba-00cc7490a6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:23.472073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56064e75-33df-4a4d-a9ba-00cc7490a6a8 None admin] PATH_INFO: `/v3/projects/e1140dfc0b9a4b21aa549fc69cc6961b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:23.477228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56064e75-33df-4a4d-a9ba-00cc7490a6a8 None admin] RBAC: Authorizing `identity:get_project(project_id=e1140dfc0b9a4b21aa549fc69cc6961b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:23.478889 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56064e75-33df-4a4d-a9ba-00cc7490a6a8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:23.481229 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 210/417] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:27:23 2022] GET /identity/v3/projects/e1140dfc0b9a4b21aa549fc69cc6961b => generated 344 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:23.488998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56064e75-33df-4a4d-a9ba-00cc7490a6a8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:23.533451 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8139ae-d18b-4e2b-8406-0b440de5108d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:23.541328 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:23.574024 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297dd0cc-5486-43ff-b3c6-292aa9729911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:23.575062 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dd0cc-5486-43ff-b3c6-292aa9729911 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:23.575514 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dd0cc-5486-43ff-b3c6-292aa9729911 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:23.575939 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dd0cc-5486-43ff-b3c6-292aa9729911 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:23.576864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297dd0cc-5486-43ff-b3c6-292aa9729911 None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:23.577317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297dd0cc-5486-43ff-b3c6-292aa9729911 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:23.579049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297dd0cc-5486-43ff-b3c6-292aa9729911 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:23.580729 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:23.591028 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 208/418] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:27:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:23.597066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a5bb4-1082-4935-afe0-90a1eea9be7e None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:23.597508 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a5bb4-1082-4935-afe0-90a1eea9be7e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:23.597955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a5bb4-1082-4935-afe0-90a1eea9be7e None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:23.599697 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56064e75-33df-4a4d-a9ba-00cc7490a6a8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:23.600395 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 209/419] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:23.601457 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a5bb4-1082-4935-afe0-90a1eea9be7e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:23.637829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a85dd-4299-405d-ba44-f4885c4929b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:23.638884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a85dd-4299-405d-ba44-f4885c4929b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:23.639267 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a85dd-4299-405d-ba44-f4885c4929b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:23.639641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a85dd-4299-405d-ba44-f4885c4929b7 None admin] PATH_INFO: `/v3/projects/e1140dfc0b9a4b21aa549fc69cc6961b/groups/ab872b86497143f89c1681c8e9c5675a/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:23.642104 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a85dd-4299-405d-ba44-f4885c4929b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1140dfc0b9a4b21aa549fc69cc6961b, group_id=ab872b86497143f89c1681c8e9c5675a, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:23.644417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a85dd-4299-405d-ba44-f4885c4929b7 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:23.668889 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 211/420] 10.222.0.59 () {58 vars in 1442 bytes} [Thu Jun 30 10:27:23 2022] PUT /identity/v3/projects/e1140dfc0b9a4b21aa549fc69cc6961b/groups/ab872b86497143f89c1681c8e9c5675a/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:27:23.668889 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035282bb-9e1f-43f1-970b-c332ea396158 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:23.668889 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035282bb-9e1f-43f1-970b-c332ea396158 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:23.668889 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035282bb-9e1f-43f1-970b-c332ea396158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:23.702638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-035282bb-9e1f-43f1-970b-c332ea396158 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:23.703909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-035282bb-9e1f-43f1-970b-c332ea396158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:23.793974 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a5bb4-1082-4935-afe0-90a1eea9be7e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:23.822501 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 212/421] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:23.849709 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035282bb-9e1f-43f1-970b-c332ea396158 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:23.853668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32650008-6b8a-4dcc-8738-831f11476521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:23.854656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32650008-6b8a-4dcc-8738-831f11476521 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:23.855192 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32650008-6b8a-4dcc-8738-831f11476521 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:23.855687 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32650008-6b8a-4dcc-8738-831f11476521 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:23.890512 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:23.929965 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:23.940325 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32650008-6b8a-4dcc-8738-831f11476521 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:23.941972 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32650008-6b8a-4dcc-8738-831f11476521 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:23.973324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035282bb-9e1f-43f1-970b-c332ea396158 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:24.029208 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdaffb7-3372-49e2-aeea-8f6341b2de93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:24.030003 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdaffb7-3372-49e2-aeea-8f6341b2de93 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:24.030279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdaffb7-3372-49e2-aeea-8f6341b2de93 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:24.030549 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdaffb7-3372-49e2-aeea-8f6341b2de93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:24.046566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdaffb7-3372-49e2-aeea-8f6341b2de93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:24.055743 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-ffdaffb7-3372-49e2-aeea-8f6341b2de93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:27:24.055743 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:24.055743 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:24.055743 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:24.055743 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:24.055743 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:24.055743 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:24.055743 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:24.055743 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:24.055743 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:24.055743 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:24.055743 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:24.055743 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:24.055743 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:24.055743 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:24.055743 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:24.056653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:24.056653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:24.056653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:24.056653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:24.056653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:24.056653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:24.056653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:24.056653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:24.056653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:24.056653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:24.056653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:24.056653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:24.056653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:24.056653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:24.056653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:24.056653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:24.057489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:24.057489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:24.057489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:24.057489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:24.057489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:24.057489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:24.057489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:24.057489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:24.057489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:24.057489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:24.057489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:27:24.057489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:24.057489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 213/422] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:24.064057 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdaffb7-3372-49e2-aeea-8f6341b2de93 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:24.107936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 210/423] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:27:24.113705 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32650008-6b8a-4dcc-8738-831f11476521 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:24.177135 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:24.185105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdaffb7-3372-49e2-aeea-8f6341b2de93 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:24.214037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:24.221192 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32650008-6b8a-4dcc-8738-831f11476521 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:24.258349 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5bfd8-adcd-4669-b409-5cd129e8c080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:24.259484 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5bfd8-adcd-4669-b409-5cd129e8c080 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:24.259973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5bfd8-adcd-4669-b409-5cd129e8c080 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:24.260448 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5bfd8-adcd-4669-b409-5cd129e8c080 None admin] PATH_INFO: `/v3/projects/0796b54c77a1493db97cdbe3488fc82b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:24.261900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5bfd8-adcd-4669-b409-5cd129e8c080 None admin] RBAC: Authorizing `identity:get_project(project_id=0796b54c77a1493db97cdbe3488fc82b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:24.264152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5bfd8-adcd-4669-b409-5cd129e8c080 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:24.266765 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 211/424] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:27:24 2022] GET /identity/v3/projects/0796b54c77a1493db97cdbe3488fc82b => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:24.272646 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5bfd8-adcd-4669-b409-5cd129e8c080 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:24.278239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed6678-609b-4bc1-bd17-88b47892cba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:24.278975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed6678-609b-4bc1-bd17-88b47892cba4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:24.279262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed6678-609b-4bc1-bd17-88b47892cba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:24.279540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed6678-609b-4bc1-bd17-88b47892cba4 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:24.280292 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed6678-609b-4bc1-bd17-88b47892cba4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:24.280763 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed6678-609b-4bc1-bd17-88b47892cba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:24.282925 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed6678-609b-4bc1-bd17-88b47892cba4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:24.312254 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 214/425] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:27:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:24.321522 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed6678-609b-4bc1-bd17-88b47892cba4 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:24.379775 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5bfd8-adcd-4669-b409-5cd129e8c080 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:24.414470 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b63af4-c9be-42ad-8e4e-09532b22b1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:24.415789 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b63af4-c9be-42ad-8e4e-09532b22b1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:24.416286 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b63af4-c9be-42ad-8e4e-09532b22b1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:24.416804 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b63af4-c9be-42ad-8e4e-09532b22b1c8 None admin] PATH_INFO: `/v3/groups/1aedfc2f0f344be8a264e13c70093465` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:24.418162 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b63af4-c9be-42ad-8e4e-09532b22b1c8 None admin] RBAC: Authorizing `identity:get_group(group_id=1aedfc2f0f344be8a264e13c70093465)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:24.420327 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b63af4-c9be-42ad-8e4e-09532b22b1c8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:24.422482 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 212/426] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 30 10:27:24 2022] GET /identity/v3/groups/1aedfc2f0f344be8a264e13c70093465 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:24.428223 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b63af4-c9be-42ad-8e4e-09532b22b1c8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:24.459839 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:24.531885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b63af4-c9be-42ad-8e4e-09532b22b1c8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:24.532556 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed6678-609b-4bc1-bd17-88b47892cba4 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:24.568936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f25c58-4fc2-41b4-88c1-74c64d47984a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:24.569282 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595be07-ef17-4482-8681-b8b2e980c46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:24.569902 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595be07-ef17-4482-8681-b8b2e980c46b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:24.570187 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595be07-ef17-4482-8681-b8b2e980c46b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:24.570472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595be07-ef17-4482-8681-b8b2e980c46b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:24.570810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f25c58-4fc2-41b4-88c1-74c64d47984a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:24.571366 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f25c58-4fc2-41b4-88c1-74c64d47984a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:24.571885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f25c58-4fc2-41b4-88c1-74c64d47984a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:24.573084 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f25c58-4fc2-41b4-88c1-74c64d47984a None admin] RBAC: Adding query filter params (group.id=1aedfc2f0f344be8a264e13c70093465, role.id=c68f9f9f32ac40dba0d180dd3f5582bb, scope.project.id=0796b54c77a1493db97cdbe3488fc82b) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:24.573615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f25c58-4fc2-41b4-88c1-74c64d47984a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:24.575328 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f25c58-4fc2-41b4-88c1-74c64d47984a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:24.582326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 213/427] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 30 10:27:24 2022] GET /identity/v3/role_assignments?group.id=1aedfc2f0f344be8a264e13c70093465&scope.project.id=0796b54c77a1493db97cdbe3488fc82b&role.id=c68f9f9f32ac40dba0d180dd3f5582bb => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:24.592533 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb32374-2903-464f-9b22-b63aa832e6ab None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:24.593428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb32374-2903-464f-9b22-b63aa832e6ab None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:24.593936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb32374-2903-464f-9b22-b63aa832e6ab None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:24.595960 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 214/428] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:24 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:24.602239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aff177-43d9-4632-949d-86468caf9d45 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:24.602865 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aff177-43d9-4632-949d-86468caf9d45 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:24.603372 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aff177-43d9-4632-949d-86468caf9d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:24.626119 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:24.630783 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-98aff177-43d9-4632-949d-86468caf9d45 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:24.632241 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-98aff177-43d9-4632-949d-86468caf9d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:24.654668 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595be07-ef17-4482-8681-b8b2e980c46b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:24.656121 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595be07-ef17-4482-8681-b8b2e980c46b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:24.761732 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 215/429] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:27:24.763486 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 215/430] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:24.769625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595be07-ef17-4482-8681-b8b2e980c46b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:24.788839 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aff177-43d9-4632-949d-86468caf9d45 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:24.846438 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:24.879473 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:24.927650 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595be07-ef17-4482-8681-b8b2e980c46b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:24.957172 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aff177-43d9-4632-949d-86468caf9d45 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:24.971105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1b2ab-fa9b-4085-b70a-0c6bbbc77c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:24.973281 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1b2ab-fa9b-4085-b70a-0c6bbbc77c9f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:24.974028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1b2ab-fa9b-4085-b70a-0c6bbbc77c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:24.974511 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1b2ab-fa9b-4085-b70a-0c6bbbc77c9f None admin] PATH_INFO: `/v3/projects/0a89ccc08f1b4490a6206c230a1720ff` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:24.975908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1b2ab-fa9b-4085-b70a-0c6bbbc77c9f None admin] RBAC: Authorizing `identity:get_project(project_id=0a89ccc08f1b4490a6206c230a1720ff)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:24.977629 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1b2ab-fa9b-4085-b70a-0c6bbbc77c9f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:24.979832 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 216/431] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:27:24 2022] GET /identity/v3/projects/0a89ccc08f1b4490a6206c230a1720ff => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:24.985711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1b2ab-fa9b-4085-b70a-0c6bbbc77c9f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:25.000916 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ac2e4-97d4-4094-952f-1f0b91335da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:25.002178 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ac2e4-97d4-4094-952f-1f0b91335da3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:25.002485 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ac2e4-97d4-4094-952f-1f0b91335da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:25.002773 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ac2e4-97d4-4094-952f-1f0b91335da3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:25.022500 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ac2e4-97d4-4094-952f-1f0b91335da3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:25.033539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-f13ac2e4-97d4-4094-952f-1f0b91335da3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:27:25.033539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:25.033539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:25.033539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:25.033539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:25.033539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:25.033539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:25.033539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:25.033539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:25.033539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:25.033539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:25.033539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:25.033539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:25.033539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:25.033539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:25.033539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:25.034434 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:25.034434 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:25.034434 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:25.034434 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:25.034434 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:25.034434 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:25.034434 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:25.034434 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:25.034434 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:25.034434 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:25.034434 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:25.034434 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:25.034434 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:25.034434 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:25.034434 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:25.034434 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:25.035219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:25.035219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:25.035219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:25.035219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:25.035219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:25.035219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:25.035219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:25.035219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:25.035219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:25.035219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:25.035219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:27:25.035219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:25.038389 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 216/432] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 30 10:27:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:25.044541 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ac2e4-97d4-4094-952f-1f0b91335da3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:25.115458 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1b2ab-fa9b-4085-b70a-0c6bbbc77c9f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:25.142275 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:25.148541 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:25.152575 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a604e-cb28-4cdc-b3d5-49458da5004c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:25.156597 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a604e-cb28-4cdc-b3d5-49458da5004c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:25.156597 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a604e-cb28-4cdc-b3d5-49458da5004c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:25.156597 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a604e-cb28-4cdc-b3d5-49458da5004c None admin] PATH_INFO: `/v3/groups/1aedfc2f0f344be8a264e13c70093465` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:25.157357 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a604e-cb28-4cdc-b3d5-49458da5004c None admin] RBAC: Authorizing `identity:get_group(group_id=1aedfc2f0f344be8a264e13c70093465)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:25.158822 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a604e-cb28-4cdc-b3d5-49458da5004c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:25.164662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 217/433] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 30 10:27:24 2022] GET /identity/v3/groups/1aedfc2f0f344be8a264e13c70093465 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:25.166510 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a604e-cb28-4cdc-b3d5-49458da5004c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:25.171879 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ac2e4-97d4-4094-952f-1f0b91335da3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:25.217222 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef64f11-94fb-4f8d-ae4b-81bc70fb214d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:25.218263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef64f11-94fb-4f8d-ae4b-81bc70fb214d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:25.218771 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef64f11-94fb-4f8d-ae4b-81bc70fb214d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:25.219241 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef64f11-94fb-4f8d-ae4b-81bc70fb214d None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:25.220174 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef64f11-94fb-4f8d-ae4b-81bc70fb214d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:25.220694 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef64f11-94fb-4f8d-ae4b-81bc70fb214d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:25.222285 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef64f11-94fb-4f8d-ae4b-81bc70fb214d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:25.232342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 217/434] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:27:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:25.237846 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef64f11-94fb-4f8d-ae4b-81bc70fb214d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:25.288228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a604e-cb28-4cdc-b3d5-49458da5004c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:25.335197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7cc05-e7d1-44df-b191-458e5fd13b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:25.335864 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7cc05-e7d1-44df-b191-458e5fd13b23 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:25.336148 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7cc05-e7d1-44df-b191-458e5fd13b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:25.337213 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7cc05-e7d1-44df-b191-458e5fd13b23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:25.338074 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7cc05-e7d1-44df-b191-458e5fd13b23 None admin] RBAC: Adding query filter params (group.id=1aedfc2f0f344be8a264e13c70093465, role.id=c68f9f9f32ac40dba0d180dd3f5582bb, scope.project.id=0a89ccc08f1b4490a6206c230a1720ff) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:25.338393 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7cc05-e7d1-44df-b191-458e5fd13b23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:25.339825 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7cc05-e7d1-44df-b191-458e5fd13b23 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:25.348031 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 218/435] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 30 10:27:25 2022] GET /identity/v3/role_assignments?group.id=1aedfc2f0f344be8a264e13c70093465&scope.project.id=0a89ccc08f1b4490a6206c230a1720ff&role.id=c68f9f9f32ac40dba0d180dd3f5582bb => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:25.349904 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c76c52-8552-4e5b-bfd1-ee960d51f0a5 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:25.350399 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c76c52-8552-4e5b-bfd1-ee960d51f0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:25.350729 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c76c52-8552-4e5b-bfd1-ee960d51f0a5 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:25.352021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 219/436] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:25.360980 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c6bcf-c804-461d-a228-63aa700dac9b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:25.361285 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c6bcf-c804-461d-a228-63aa700dac9b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:25.361534 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c6bcf-c804-461d-a228-63aa700dac9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:25.389175 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef64f11-94fb-4f8d-ae4b-81bc70fb214d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:25.389677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-da4c6bcf-c804-461d-a228-63aa700dac9b None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:25.391466 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-da4c6bcf-c804-461d-a228-63aa700dac9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:25.441513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab53d8-8548-4531-ab80-7a84c23e43c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:25.442177 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab53d8-8548-4531-ab80-7a84c23e43c7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:25.442461 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab53d8-8548-4531-ab80-7a84c23e43c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:25.442741 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab53d8-8548-4531-ab80-7a84c23e43c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:25.468462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:25.470667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:25.492532 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 220/437] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:25.517386 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c6bcf-c804-461d-a228-63aa700dac9b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:25.537979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaab53d8-8548-4531-ab80-7a84c23e43c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:25.539646 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaab53d8-8548-4531-ab80-7a84c23e43c7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:25.636423 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c6bcf-c804-461d-a228-63aa700dac9b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:25.663904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 218/438] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 10:27:25.669754 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab53d8-8548-4531-ab80-7a84c23e43c7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:25.677091 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a179d-988f-4354-90b3-5eb1822b1190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:25.678322 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a179d-988f-4354-90b3-5eb1822b1190 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:25.678606 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a179d-988f-4354-90b3-5eb1822b1190 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:25.678879 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a179d-988f-4354-90b3-5eb1822b1190 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:25.691323 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a179d-988f-4354-90b3-5eb1822b1190 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:25.699428 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-5b7a179d-988f-4354-90b3-5eb1822b1190 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:27:25.699428 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:25.699428 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:25.699428 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:25.699428 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:25.699428 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:25.699428 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:25.699428 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:25.699428 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:25.699428 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:25.699428 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:25.699428 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:25.699428 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:25.699428 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:25.699428 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:25.699428 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:25.700917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:25.700917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:25.700917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:25.700917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:25.700917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:25.700917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:25.700917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:25.700917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:25.700917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:25.700917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:25.700917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:25.700917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:25.700917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:25.700917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:25.700917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:25.700917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:25.701712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:25.701712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:25.701712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:25.701712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:25.701712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:25.701712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:25.701712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:25.701712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:25.701712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:25.701712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:25.701712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:27:25.701712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:25.713975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 221/439] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 30 10:27:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:27:25.713975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a179d-988f-4354-90b3-5eb1822b1190 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:25.734420 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:25.768630 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:25.795642 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab53d8-8548-4531-ab80-7a84c23e43c7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:25.822294 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a179d-988f-4354-90b3-5eb1822b1190 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:25.830582 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073975e4-6d31-4285-afc6-54adba29ca1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:25.831422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073975e4-6d31-4285-afc6-54adba29ca1d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:25.831705 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073975e4-6d31-4285-afc6-54adba29ca1d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:25.831981 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073975e4-6d31-4285-afc6-54adba29ca1d None admin] PATH_INFO: `/v3/projects/0796b54c77a1493db97cdbe3488fc82b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:25.833160 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073975e4-6d31-4285-afc6-54adba29ca1d None admin] RBAC: Authorizing `identity:get_project(project_id=0796b54c77a1493db97cdbe3488fc82b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:25.834602 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073975e4-6d31-4285-afc6-54adba29ca1d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:25.836449 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 219/440] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:27:25 2022] GET /identity/v3/projects/0796b54c77a1493db97cdbe3488fc82b => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:25.841827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073975e4-6d31-4285-afc6-54adba29ca1d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:25.856352 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbed22f-4964-43bf-a89c-8790cade0a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:25.857038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbed22f-4964-43bf-a89c-8790cade0a74 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:25.857332 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbed22f-4964-43bf-a89c-8790cade0a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:25.857596 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbed22f-4964-43bf-a89c-8790cade0a74 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:25.858338 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbed22f-4964-43bf-a89c-8790cade0a74 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:25.858649 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbed22f-4964-43bf-a89c-8790cade0a74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:25.860013 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbed22f-4964-43bf-a89c-8790cade0a74 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:25.868018 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 222/441] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:27:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:25.873974 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbed22f-4964-43bf-a89c-8790cade0a74 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:25.946798 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073975e4-6d31-4285-afc6-54adba29ca1d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:25.963198 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:25.980529 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbed22f-4964-43bf-a89c-8790cade0a74 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:25.982823 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0a102-976d-406d-86ca-82a0f62c4db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:25.983681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0a102-976d-406d-86ca-82a0f62c4db0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:25.983963 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0a102-976d-406d-86ca-82a0f62c4db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:25.984240 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0a102-976d-406d-86ca-82a0f62c4db0 None admin] PATH_INFO: `/v3/groups/1aedfc2f0f344be8a264e13c70093465` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:25.985436 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0a102-976d-406d-86ca-82a0f62c4db0 None admin] RBAC: Authorizing `identity:get_group(group_id=1aedfc2f0f344be8a264e13c70093465)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:25.986877 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0a102-976d-406d-86ca-82a0f62c4db0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:25.988489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 220/442] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 30 10:27:25 2022] GET /identity/v3/groups/1aedfc2f0f344be8a264e13c70093465 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:25.994124 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0a102-976d-406d-86ca-82a0f62c4db0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:25.999114 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:26.026015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a11c34-d079-4870-8141-fa5c2db6b95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:26.026583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a11c34-d079-4870-8141-fa5c2db6b95d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:26.026864 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a11c34-d079-4870-8141-fa5c2db6b95d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:26.027305 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a11c34-d079-4870-8141-fa5c2db6b95d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:26.096899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a11c34-d079-4870-8141-fa5c2db6b95d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:26.097091 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0a102-976d-406d-86ca-82a0f62c4db0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:26.098266 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a11c34-d079-4870-8141-fa5c2db6b95d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:26.130730 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd7760-7260-4d4c-9e97-aceaa3bc726d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:26.131379 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd7760-7260-4d4c-9e97-aceaa3bc726d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:26.131666 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd7760-7260-4d4c-9e97-aceaa3bc726d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:26.131947 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd7760-7260-4d4c-9e97-aceaa3bc726d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:26.132809 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd7760-7260-4d4c-9e97-aceaa3bc726d None admin] RBAC: Adding query filter params (group.id=1aedfc2f0f344be8a264e13c70093465, role.id=2d85fe2aee9740f984e944e0d5c80ec5, scope.project.id=0796b54c77a1493db97cdbe3488fc82b) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:26.133119 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd7760-7260-4d4c-9e97-aceaa3bc726d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:26.134563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd7760-7260-4d4c-9e97-aceaa3bc726d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:26.140262 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 221/443] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 30 10:27:25 2022] GET /identity/v3/role_assignments?group.id=1aedfc2f0f344be8a264e13c70093465&scope.project.id=0796b54c77a1493db97cdbe3488fc82b&role.id=2d85fe2aee9740f984e944e0d5c80ec5 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:26.141496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba109f5c-c0a4-4f1d-a3a0-9f0bfd9d9b8e None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:26.141785 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba109f5c-c0a4-4f1d-a3a0-9f0bfd9d9b8e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:26.142087 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba109f5c-c0a4-4f1d-a3a0-9f0bfd9d9b8e None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:26.143570 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 222/444] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:26.149078 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1a522-db40-4d54-a47c-26716b4df680 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:26.149407 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1a522-db40-4d54-a47c-26716b4df680 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:26.149642 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1a522-db40-4d54-a47c-26716b4df680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:26.168030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b1b1a522-db40-4d54-a47c-26716b4df680 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:26.169904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b1b1a522-db40-4d54-a47c-26716b4df680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:26.204595 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 223/445] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 10:27:26.210324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a11c34-d079-4870-8141-fa5c2db6b95d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:26.222220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:26.225917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:26.265157 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 223/446] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:26.278145 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1a522-db40-4d54-a47c-26716b4df680 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:26.333134 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a11c34-d079-4870-8141-fa5c2db6b95d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:26.372560 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7064f97-e9c6-470d-b1cd-cfcb89a56bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:26.373357 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7064f97-e9c6-470d-b1cd-cfcb89a56bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:26.374081 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7064f97-e9c6-470d-b1cd-cfcb89a56bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:26.374081 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7064f97-e9c6-470d-b1cd-cfcb89a56bd0 None admin] PATH_INFO: `/v3/projects/0a89ccc08f1b4490a6206c230a1720ff` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:26.375078 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7064f97-e9c6-470d-b1cd-cfcb89a56bd0 None admin] RBAC: Authorizing `identity:get_project(project_id=0a89ccc08f1b4490a6206c230a1720ff)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:26.376797 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7064f97-e9c6-470d-b1cd-cfcb89a56bd0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:26.378531 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 224/447] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:27:26 2022] GET /identity/v3/projects/0a89ccc08f1b4490a6206c230a1720ff => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:26.383876 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7064f97-e9c6-470d-b1cd-cfcb89a56bd0 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:26.402389 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1a522-db40-4d54-a47c-26716b4df680 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:26.447654 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32ee97-b192-41d0-a130-a357c059b9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:26.449219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32ee97-b192-41d0-a130-a357c059b9d1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:26.449219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32ee97-b192-41d0-a130-a357c059b9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:26.449219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32ee97-b192-41d0-a130-a357c059b9d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:26.460334 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32ee97-b192-41d0-a130-a357c059b9d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:26.468610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-8d32ee97-b192-41d0-a130-a357c059b9d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:27:26.468610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:26.468610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:26.468610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:26.468610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:26.468610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:26.468610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:26.468610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:26.468610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:26.468610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:26.468610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:26.468610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:26.468610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:26.468610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:26.468610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:26.468610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:26.469517 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:26.469517 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:26.469517 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:26.469517 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:26.469517 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:26.469517 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:26.469517 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:26.469517 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:26.469517 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:26.469517 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:26.469517 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:26.469517 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:26.469517 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:26.469517 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:26.469517 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:26.469517 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:26.470317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:26.470317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:26.470317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:26.470317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:26.470317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:26.470317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:26.470317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:26.470317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:26.470317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:26.470317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:26.470317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:27:26.470317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:26.470317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 224/448] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:27:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:26.476034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32ee97-b192-41d0-a130-a357c059b9d1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:26.479971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:26.507481 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7064f97-e9c6-470d-b1cd-cfcb89a56bd0 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:26.526616 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:26.547505 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e43da4-1afe-4763-9afc-ea3d1a743e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:26.548368 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e43da4-1afe-4763-9afc-ea3d1a743e82 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:26.548686 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e43da4-1afe-4763-9afc-ea3d1a743e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:26.548963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e43da4-1afe-4763-9afc-ea3d1a743e82 None admin] PATH_INFO: `/v3/groups/1aedfc2f0f344be8a264e13c70093465` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:26.550139 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e43da4-1afe-4763-9afc-ea3d1a743e82 None admin] RBAC: Authorizing `identity:get_group(group_id=1aedfc2f0f344be8a264e13c70093465)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:26.551565 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e43da4-1afe-4763-9afc-ea3d1a743e82 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:26.553464 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 225/449] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 30 10:27:26 2022] GET /identity/v3/groups/1aedfc2f0f344be8a264e13c70093465 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:26.560381 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e43da4-1afe-4763-9afc-ea3d1a743e82 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:26.603417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32ee97-b192-41d0-a130-a357c059b9d1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:26.651551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2233b-6bb3-457d-8e7d-63263720199b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:26.652219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2233b-6bb3-457d-8e7d-63263720199b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:26.652741 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2233b-6bb3-457d-8e7d-63263720199b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:26.653365 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2233b-6bb3-457d-8e7d-63263720199b None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:26.654130 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2233b-6bb3-457d-8e7d-63263720199b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:26.654445 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2233b-6bb3-457d-8e7d-63263720199b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:26.656546 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2233b-6bb3-457d-8e7d-63263720199b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:26.664781 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 225/450] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:26.670595 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e43da4-1afe-4763-9afc-ea3d1a743e82 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:26.671012 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2233b-6bb3-457d-8e7d-63263720199b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:26.704419 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097ac00-60f9-4c24-b9e8-9f2e05f84469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:26.705098 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097ac00-60f9-4c24-b9e8-9f2e05f84469 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:26.705381 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097ac00-60f9-4c24-b9e8-9f2e05f84469 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:26.705658 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097ac00-60f9-4c24-b9e8-9f2e05f84469 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:26.706471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097ac00-60f9-4c24-b9e8-9f2e05f84469 None admin] RBAC: Adding query filter params (group.id=1aedfc2f0f344be8a264e13c70093465, role.id=2d85fe2aee9740f984e944e0d5c80ec5, scope.project.id=0a89ccc08f1b4490a6206c230a1720ff) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:26.706781 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097ac00-60f9-4c24-b9e8-9f2e05f84469 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:26.708208 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097ac00-60f9-4c24-b9e8-9f2e05f84469 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:26.713905 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 226/451] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 30 10:27:26 2022] GET /identity/v3/role_assignments?group.id=1aedfc2f0f344be8a264e13c70093465&scope.project.id=0a89ccc08f1b4490a6206c230a1720ff&role.id=2d85fe2aee9740f984e944e0d5c80ec5 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:26.773787 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:26.777111 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2233b-6bb3-457d-8e7d-63263720199b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:26.813296 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090acfa7-3001-4882-8777-cefd18bc5e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:26.813953 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090acfa7-3001-4882-8777-cefd18bc5e7c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:26.814237 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090acfa7-3001-4882-8777-cefd18bc5e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:26.814514 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090acfa7-3001-4882-8777-cefd18bc5e7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:26.885616 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090acfa7-3001-4882-8777-cefd18bc5e7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:26.887639 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090acfa7-3001-4882-8777-cefd18bc5e7c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:26.997266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:27.007292 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 226/452] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:27:27.008832 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097ac00-60f9-4c24-b9e8-9f2e05f84469 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:27.022872 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:27.112240 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097ac00-60f9-4c24-b9e8-9f2e05f84469 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:27.144483 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97088ff4-95f3-45c8-961f-aa866091c701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:27.145346 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97088ff4-95f3-45c8-961f-aa866091c701 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:27.145621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97088ff4-95f3-45c8-961f-aa866091c701 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:27.145889 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97088ff4-95f3-45c8-961f-aa866091c701 None admin] PATH_INFO: `/v3/projects/e1140dfc0b9a4b21aa549fc69cc6961b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:27.147045 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97088ff4-95f3-45c8-961f-aa866091c701 None admin] RBAC: Authorizing `identity:get_project(project_id=e1140dfc0b9a4b21aa549fc69cc6961b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:27.148478 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97088ff4-95f3-45c8-961f-aa866091c701 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:27.150160 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 227/453] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:27:27 2022] GET /identity/v3/projects/e1140dfc0b9a4b21aa549fc69cc6961b => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:27.155655 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090acfa7-3001-4882-8777-cefd18bc5e7c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:27.252986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090acfa7-3001-4882-8777-cefd18bc5e7c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:27.286430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aff0bd-6aab-4e91-b8df-5279974f7ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:27.287304 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aff0bd-6aab-4e91-b8df-5279974f7ead None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:27.287593 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aff0bd-6aab-4e91-b8df-5279974f7ead None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:27.287871 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aff0bd-6aab-4e91-b8df-5279974f7ead None admin] PATH_INFO: `/v3/groups/ab872b86497143f89c1681c8e9c5675a` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:27.289151 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aff0bd-6aab-4e91-b8df-5279974f7ead None admin] RBAC: Authorizing `identity:get_group(group_id=ab872b86497143f89c1681c8e9c5675a)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:27.290621 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aff0bd-6aab-4e91-b8df-5279974f7ead None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:27.292280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 227/454] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 30 10:27:27 2022] GET /identity/v3/groups/ab872b86497143f89c1681c8e9c5675a => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:27.299402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97088ff4-95f3-45c8-961f-aa866091c701 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:27.378845 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:27.399080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97088ff4-95f3-45c8-961f-aa866091c701 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:27.430500 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162bc776-53ca-4b05-b666-f008021b1e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:27.431131 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bc776-53ca-4b05-b666-f008021b1e74 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:27.431409 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bc776-53ca-4b05-b666-f008021b1e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:27.431684 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bc776-53ca-4b05-b666-f008021b1e74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:27.432484 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162bc776-53ca-4b05-b666-f008021b1e74 None admin] RBAC: Adding query filter params (group.id=ab872b86497143f89c1681c8e9c5675a, role.id=ab64ea6d0475430195af26a049485569, scope.project.id=e1140dfc0b9a4b21aa549fc69cc6961b) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:27.432824 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162bc776-53ca-4b05-b666-f008021b1e74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:27.435237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162bc776-53ca-4b05-b666-f008021b1e74 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:27.440786 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 228/455] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 30 10:27:27 2022] GET /identity/v3/role_assignments?group.id=ab872b86497143f89c1681c8e9c5675a&scope.project.id=e1140dfc0b9a4b21aa549fc69cc6961b&role.id=ab64ea6d0475430195af26a049485569 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:30.020840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e06ad2-8da9-43af-8342-44f550937fa0 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:30.021375 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e06ad2-8da9-43af-8342-44f550937fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:30.021375 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e06ad2-8da9-43af-8342-44f550937fa0 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:30.022996 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 228/456] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:30.028633 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb96f4-47ce-4b1e-bfc2-45385b1d4298 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:30.028894 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6d48e-61b3-4907-8e7a-2468f7368521 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:30.029347 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb96f4-47ce-4b1e-bfc2-45385b1d4298 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:30.029347 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb96f4-47ce-4b1e-bfc2-45385b1d4298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:30.029936 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6d48e-61b3-4907-8e7a-2468f7368521 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:30.030414 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6d48e-61b3-4907-8e7a-2468f7368521 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:30.032353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 229/457] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:30.037928 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640fc31-3029-4cee-baeb-dfdaa02a7fc6 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:30.038559 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640fc31-3029-4cee-baeb-dfdaa02a7fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:30.039041 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640fc31-3029-4cee-baeb-dfdaa02a7fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:30.062700 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c5fb96f4-47ce-4b1e-bfc2-45385b1d4298 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:30.065296 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c5fb96f4-47ce-4b1e-bfc2-45385b1d4298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:30.073053 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-7640fc31-3029-4cee-baeb-dfdaa02a7fc6 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:30.075207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7640fc31-3029-4cee-baeb-dfdaa02a7fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:30.160494 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:30.167976 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 229/458] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:27:30.169659 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370545a1-fadc-4ddd-a0ce-4b37db732139 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:30.170188 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370545a1-fadc-4ddd-a0ce-4b37db732139 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:30.170675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370545a1-fadc-4ddd-a0ce-4b37db732139 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:30.172370 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 230/459] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:30.182266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bf4ec-9927-4895-907a-f4b2ef1a1c8b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:30.183094 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bf4ec-9927-4895-907a-f4b2ef1a1c8b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:30.185557 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 230/460] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:30.186020 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bf4ec-9927-4895-907a-f4b2ef1a1c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:30.198990 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640fc31-3029-4cee-baeb-dfdaa02a7fc6 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:30.209892 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ee0bf4ec-9927-4895-907a-f4b2ef1a1c8b None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:30.211337 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ee0bf4ec-9927-4895-907a-f4b2ef1a1c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:30.298634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:30.323799 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 231/461] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:27:30.328771 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bf4ec-9927-4895-907a-f4b2ef1a1c8b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:30.341812 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640fc31-3029-4cee-baeb-dfdaa02a7fc6 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:30.381995 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab989e37-89ab-4690-beb0-48b89bf82903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:30.383152 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab989e37-89ab-4690-beb0-48b89bf82903 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:30.383669 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab989e37-89ab-4690-beb0-48b89bf82903 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:30.384146 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab989e37-89ab-4690-beb0-48b89bf82903 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:30.395177 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab989e37-89ab-4690-beb0-48b89bf82903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:30.397014 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab989e37-89ab-4690-beb0-48b89bf82903 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:30.415562 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-ab989e37-89ab-4690-beb0-48b89bf82903 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:30.415562 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:30.415562 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:30.415562 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:30.415562 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:30.415562 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:30.415562 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:30.415562 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:30.415562 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:30.415562 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:30.415562 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:30.415562 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:30.415562 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:30.415562 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:30.415562 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:30.416432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:30.416432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:30.416432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:30.416432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:30.416432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:30.416432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:30.416432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:30.416432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:30.416432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:30.416432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:30.416432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:30.416432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:30.416432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:30.416432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:30.416432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:30.416432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:30.416432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:30.417318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:30.417318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:30.417318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:30.417318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:30.420006 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 231/462] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:27:30.425800 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab989e37-89ab-4690-beb0-48b89bf82903 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:30.462674 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bf4ec-9927-4895-907a-f4b2ef1a1c8b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:30.492557 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:30.503422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103eaaa-39cc-4f57-833a-7ed3503d26ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:30.504413 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103eaaa-39cc-4f57-833a-7ed3503d26ed None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:30.504875 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103eaaa-39cc-4f57-833a-7ed3503d26ed None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:30.505299 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103eaaa-39cc-4f57-833a-7ed3503d26ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:30.516748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103eaaa-39cc-4f57-833a-7ed3503d26ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:30.518499 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103eaaa-39cc-4f57-833a-7ed3503d26ed None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:30.532628 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab989e37-89ab-4690-beb0-48b89bf82903 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:30.537934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-a103eaaa-39cc-4f57-833a-7ed3503d26ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:30.537934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:30.537934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:30.537934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:30.537934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:30.537934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:30.537934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:30.537934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:30.537934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:30.537934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:30.537934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:30.537934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:30.537934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:30.537934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:30.537934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:30.538795 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:30.538795 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:30.538795 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:30.538795 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:30.538795 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:30.538795 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:30.538795 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:30.538795 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:30.538795 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:30.538795 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:30.538795 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:30.538795 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:30.538795 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:30.538795 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:30.538795 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:30.538795 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:30.538795 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:30.539634 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:30.539634 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:30.539634 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:30.539634 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:30.546980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 232/463] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:30.548124 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103eaaa-39cc-4f57-833a-7ed3503d26ed None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:30.558182 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:30.569803 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39273bc4-ca84-414a-b59c-091b9a2a947d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:30.570600 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39273bc4-ca84-414a-b59c-091b9a2a947d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:30.570882 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39273bc4-ca84-414a-b59c-091b9a2a947d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:30.571157 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39273bc4-ca84-414a-b59c-091b9a2a947d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:30.581774 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39273bc4-ca84-414a-b59c-091b9a2a947d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:30.583223 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39273bc4-ca84-414a-b59c-091b9a2a947d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:30.601518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-39273bc4-ca84-414a-b59c-091b9a2a947d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:30.601518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:30.601518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:30.601518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:30.601518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:30.601518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:30.601518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:30.601518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:30.601518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:30.601518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:30.601518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:30.601518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:30.601518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:30.601518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:30.601518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:30.602477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:30.602477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:30.602477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:30.602477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:30.602477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:30.602477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:30.602477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:30.602477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:30.602477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:30.602477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:30.602477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:30.602477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:30.602477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:30.602477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:30.602477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:30.602477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:30.602477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:30.603314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:30.603314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:30.603314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:30.603314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:30.603314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 232/464] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:30.603570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39273bc4-ca84-414a-b59c-091b9a2a947d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:30.662001 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103eaaa-39cc-4f57-833a-7ed3503d26ed None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:30.697935 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531b872-d89b-494f-b15b-d3ba3ca7d15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:30.698577 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531b872-d89b-494f-b15b-d3ba3ca7d15d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:30.698858 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531b872-d89b-494f-b15b-d3ba3ca7d15d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:30.699129 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531b872-d89b-494f-b15b-d3ba3ca7d15d None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:30.699830 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531b872-d89b-494f-b15b-d3ba3ca7d15d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:30.700134 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531b872-d89b-494f-b15b-d3ba3ca7d15d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:30.701632 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531b872-d89b-494f-b15b-d3ba3ca7d15d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:30.711375 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39273bc4-ca84-414a-b59c-091b9a2a947d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:30.714154 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 233/465] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:30.714404 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531b872-d89b-494f-b15b-d3ba3ca7d15d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:30.751566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f76ed5-49dc-4d56-b7ce-e24b74e4d40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:30.752211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f76ed5-49dc-4d56-b7ce-e24b74e4d40e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:30.752488 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f76ed5-49dc-4d56-b7ce-e24b74e4d40e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:30.752784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f76ed5-49dc-4d56-b7ce-e24b74e4d40e None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:30.753489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f76ed5-49dc-4d56-b7ce-e24b74e4d40e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:30.753792 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f76ed5-49dc-4d56-b7ce-e24b74e4d40e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:30.755148 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f76ed5-49dc-4d56-b7ce-e24b74e4d40e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:30.759877 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:30.766724 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 233/466] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:30.767934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd478b69-9f3d-40a0-8504-8096b4c022c2 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:30.768218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd478b69-9f3d-40a0-8504-8096b4c022c2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:30.768492 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd478b69-9f3d-40a0-8504-8096b4c022c2 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:30.769877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 234/467] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:30.774271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd478b69-9f3d-40a0-8504-8096b4c022c2 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:30.810219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:30.831619 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531b872-d89b-494f-b15b-d3ba3ca7d15d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:30.867875 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14600406-a546-4aed-8086-5f19fbd8f4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:30.868660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14600406-a546-4aed-8086-5f19fbd8f4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:30.868947 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14600406-a546-4aed-8086-5f19fbd8f4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:30.869223 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14600406-a546-4aed-8086-5f19fbd8f4b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:30.869934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14600406-a546-4aed-8086-5f19fbd8f4b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:30.870241 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14600406-a546-4aed-8086-5f19fbd8f4b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:30.871905 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14600406-a546-4aed-8086-5f19fbd8f4b8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:30.874897 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd478b69-9f3d-40a0-8504-8096b4c022c2 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:30.888427 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 234/468] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:30.888427 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14600406-a546-4aed-8086-5f19fbd8f4b8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:30.915297 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca3240-ac48-4491-be77-f2c2217711b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:30.915958 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca3240-ac48-4491-be77-f2c2217711b5 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:30.916239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca3240-ac48-4491-be77-f2c2217711b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:30.916537 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca3240-ac48-4491-be77-f2c2217711b5 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:30.917271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca3240-ac48-4491-be77-f2c2217711b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:30.919301 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca3240-ac48-4491-be77-f2c2217711b5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:30.939603 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 235/469] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 30 10:27:30 2022] POST /identity/v3/users => generated 248 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:27:30.941200 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610eb41-4741-47be-ada2-629d6ef3002d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:30.941709 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610eb41-4741-47be-ada2-629d6ef3002d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:30.941989 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610eb41-4741-47be-ada2-629d6ef3002d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:30.964397 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-4610eb41-4741-47be-ada2-629d6ef3002d None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:30.966560 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4610eb41-4741-47be-ada2-629d6ef3002d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:31.005376 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:31.011231 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14600406-a546-4aed-8086-5f19fbd8f4b8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:31.063169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902b4d8-6ab0-453a-92cf-6ec73ade6f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:31.063838 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902b4d8-6ab0-453a-92cf-6ec73ade6f37 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:31.064283 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902b4d8-6ab0-453a-92cf-6ec73ade6f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:31.064781 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902b4d8-6ab0-453a-92cf-6ec73ade6f37 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:31.065889 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902b4d8-6ab0-453a-92cf-6ec73ade6f37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:31.068295 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902b4d8-6ab0-453a-92cf-6ec73ade6f37 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:31.078237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 236/470] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:31.079816 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610eb41-4741-47be-ada2-629d6ef3002d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:31.108266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 235/471] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 30 10:27:30 2022] POST /identity/v3/users => generated 246 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:27:31.109301 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902b4d8-6ab0-453a-92cf-6ec73ade6f37 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:31.117869 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:31.236739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610eb41-4741-47be-ada2-629d6ef3002d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:31.270100 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902b4d8-6ab0-453a-92cf-6ec73ade6f37 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:31.285325 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fa97e-78b8-4933-ac45-5fa840b64732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:31.285691 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fa97e-78b8-4933-ac45-5fa840b64732 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:31.285953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fa97e-78b8-4933-ac45-5fa840b64732 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:31.286557 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fa97e-78b8-4933-ac45-5fa840b64732 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:31.287445 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fa97e-78b8-4933-ac45-5fa840b64732 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:31.289303 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fa97e-78b8-4933-ac45-5fa840b64732 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:31.316104 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 237/472] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 30 10:27:31 2022] POST /identity/v3/users => generated 248 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:27:31.329410 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77633a-f8cc-42c1-ae59-f80f8d8db060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:31.330256 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77633a-f8cc-42c1-ae59-f80f8d8db060 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:31.330544 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77633a-f8cc-42c1-ae59-f80f8d8db060 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:31.330848 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77633a-f8cc-42c1-ae59-f80f8d8db060 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:31.344339 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77633a-f8cc-42c1-ae59-f80f8d8db060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:31.345938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77633a-f8cc-42c1-ae59-f80f8d8db060 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:31.365069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-cc77633a-f8cc-42c1-ae59-f80f8d8db060 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:31.365069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:31.365069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:31.365069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:31.365069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:31.365069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:31.365069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:31.365069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:31.365069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:31.365069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:31.365069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:31.365069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:31.365069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:31.365069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:31.365069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:31.365968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:31.365968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:31.365968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:31.365968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:31.365968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:31.365968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:31.365968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:31.365968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:31.365968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:31.365968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:31.365968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:31.365968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:31.365968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:31.365968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:31.365968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:31.365968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:31.365968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:31.366799 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:31.366799 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:31.366799 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:31.366799 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:31.366799 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 236/473] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:31.373741 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fa97e-78b8-4933-ac45-5fa840b64732 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:31.438118 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a92101-d447-4104-a3ff-6d37765558e7 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:31.438437 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a92101-d447-4104-a3ff-6d37765558e7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:31.438683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a92101-d447-4104-a3ff-6d37765558e7 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:31.440231 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 237/474] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:27:31.447125 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158f8f1-7863-4af9-b9c9-39ccc6b1c00d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:31.447425 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158f8f1-7863-4af9-b9c9-39ccc6b1c00d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:31.447697 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158f8f1-7863-4af9-b9c9-39ccc6b1c00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:31.473197 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8158f8f1-7863-4af9-b9c9-39ccc6b1c00d None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:31.474123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:31.474682 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8158f8f1-7863-4af9-b9c9-39ccc6b1c00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:31.477761 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:31.487069 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fa97e-78b8-4933-ac45-5fa840b64732 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:31.535582 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86312f36-9efc-4c24-b982-9ccec7e223fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:31.536693 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86312f36-9efc-4c24-b982-9ccec7e223fa None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:31.537217 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86312f36-9efc-4c24-b982-9ccec7e223fa None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:31.537767 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86312f36-9efc-4c24-b982-9ccec7e223fa None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:31.538963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86312f36-9efc-4c24-b982-9ccec7e223fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:31.539465 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86312f36-9efc-4c24-b982-9ccec7e223fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:31.541080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86312f36-9efc-4c24-b982-9ccec7e223fa None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:31.557406 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 238/475] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:31.561184 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 238/476] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:31.566514 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158f8f1-7863-4af9-b9c9-39ccc6b1c00d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:31.585086 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86312f36-9efc-4c24-b982-9ccec7e223fa None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:31.677587 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158f8f1-7863-4af9-b9c9-39ccc6b1c00d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:31.708483 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86312f36-9efc-4c24-b982-9ccec7e223fa None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:31.715447 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0366eff-0901-47de-82c4-fcd0bc2ab45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:31.716215 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0366eff-0901-47de-82c4-fcd0bc2ab45e None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:31.716528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0366eff-0901-47de-82c4-fcd0bc2ab45e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:31.716946 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0366eff-0901-47de-82c4-fcd0bc2ab45e None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:31.717668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0366eff-0901-47de-82c4-fcd0bc2ab45e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:31.719126 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0366eff-0901-47de-82c4-fcd0bc2ab45e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:31.732936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:31.741610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 239/477] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 30 10:27:31 2022] POST /identity/v3/users => generated 249 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:27:31.782386 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a18e4-8fd9-4aa6-8fd9-dc750252eab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:31.783126 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a18e4-8fd9-4aa6-8fd9-dc750252eab9 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:31.783411 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a18e4-8fd9-4aa6-8fd9-dc750252eab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:31.783781 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a18e4-8fd9-4aa6-8fd9-dc750252eab9 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:31.784625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a18e4-8fd9-4aa6-8fd9-dc750252eab9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:31.786031 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a18e4-8fd9-4aa6-8fd9-dc750252eab9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:31.797935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.sql.core [None req-bd8a18e4-8fd9-4aa6-8fd9-dc750252eab9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 30 10:27:31.797935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 30 10:27:31.797935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [parameters: {'id': 'b66e2d2a200449fe91cf1ec5a382f886', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 30 10:27:31.797935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80263) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 30 10:27:31.822608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-bd8a18e4-8fd9-4aa6-8fd9-dc750252eab9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 30 10:27:31.822608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:31.822608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 10:27:31.822608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 10:27:31.822608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 10:27:31.822608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 10:27:31.822608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 10:27:31.822608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 10:27:31.822608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 10:27:31.822608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application conn.query(q) Jun 30 10:27:31.822608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 10:27:31.822608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 10:27:31.822608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 10:27:31.822608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application result.read() Jun 30 10:27:31.822608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 10:27:31.823588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 10:27:31.823588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 10:27:31.823588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 10:27:31.823588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 10:27:31.823588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 10:27:31.823588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 10:27:31.823588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 10:27:31.823588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 30 10:27:31.823588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:31.823588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 30 10:27:31.823588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:31.823588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:31.823588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 30 10:27:31.823588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 30 10:27:31.823588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 30 10:27:31.823588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return ref.to_dict() Jun 30 10:27:31.823588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 10:27:31.823588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application next(self.gen) Jun 30 10:27:31.824526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 30 10:27:31.824526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application yield resource Jun 30 10:27:31.824526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 10:27:31.824526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application next(self.gen) Jun 30 10:27:31.824526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 30 10:27:31.824526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self.session.rollback() Jun 30 10:27:31.824526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 30 10:27:31.824526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self.force_reraise() Jun 30 10:27:31.824526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 30 10:27:31.824526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise self.value Jun 30 10:27:31.824526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 30 10:27:31.824526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 30 10:27:31.824526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 30 10:27:31.824526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application session.commit() Jun 30 10:27:31.824526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 30 10:27:31.824526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 30 10:27:31.824526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 30 10:27:31.825377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._prepare_impl() Jun 30 10:27:31.825377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 30 10:27:31.825377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self.session.flush() Jun 30 10:27:31.825377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 30 10:27:31.825377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._flush(objects) Jun 30 10:27:31.825377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 30 10:27:31.825377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 30 10:27:31.825377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 30 10:27:31.825377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application compat.raise_( Jun 30 10:27:31.825377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 10:27:31.825377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception Jun 30 10:27:31.825377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 30 10:27:31.825377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application flush_context.execute() Jun 30 10:27:31.825377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 30 10:27:31.825377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rec.execute(self) Jun 30 10:27:31.825377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 30 10:27:31.825377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 30 10:27:31.826310 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 30 10:27:31.826310 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 30 10:27:31.826310 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 30 10:27:31.826310 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 30 10:27:31.826310 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 30 10:27:31.826310 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 30 10:27:31.826310 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 30 10:27:31.826310 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 30 10:27:31.826310 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 30 10:27:31.826310 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 30 10:27:31.826310 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 30 10:27:31.826310 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 30 10:27:31.826310 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 30 10:27:31.826310 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 30 10:27:31.826310 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 10:27:31.826310 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception Jun 30 10:27:31.828097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 10:27:31.828097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 10:27:31.828097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 10:27:31.828097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 10:27:31.828097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 10:27:31.828097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 10:27:31.828097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 10:27:31.828097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application conn.query(q) Jun 30 10:27:31.828097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 10:27:31.828097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 10:27:31.828097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 10:27:31.828097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application result.read() Jun 30 10:27:31.828097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 10:27:31.828097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 10:27:31.828097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 10:27:31.828097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 10:27:31.830024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 10:27:31.830024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 10:27:31.830024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 10:27:31.830024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 10:27:31.830024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 30 10:27:31.830024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 30 10:27:31.830024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [parameters: {'id': 'b66e2d2a200449fe91cf1ec5a382f886', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 30 10:27:31.830024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 30 10:27:31.830024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:31.830024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:27:31.830024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:31.830024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:31.830024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:31.830024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:31.830024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:31.830024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:31.832211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:31.832211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:31.832211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:31.832211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:31.832211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:31.832211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:31.832211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 30 10:27:31.832211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 30 10:27:31.832211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:31.832211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:31.832211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 30 10:27:31.832211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 30 10:27:31.832211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 30 10:27:31.832211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 30 10:27:31.832211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 30 10:27:31.832211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:31.834295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 239/478] 10.222.0.59 () {60 vars in 1131 bytes} [Thu Jun 30 10:27:31 2022] POST /identity/v3/roles => generated 144 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:31.840559 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0366eff-0901-47de-82c4-fcd0bc2ab45e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:31.980447 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0366eff-0901-47de-82c4-fcd0bc2ab45e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:32.022589 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0788b09-b965-47e6-b817-76e3b861333e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:32.023408 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0788b09-b965-47e6-b817-76e3b861333e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:32.023695 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0788b09-b965-47e6-b817-76e3b861333e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:32.023976 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0788b09-b965-47e6-b817-76e3b861333e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:32.037520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0788b09-b965-47e6-b817-76e3b861333e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:32.046313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-b0788b09-b965-47e6-b817-76e3b861333e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:27:32.046313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:32.046313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:32.046313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:32.046313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:32.046313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:32.046313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:32.046313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:32.046313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:32.046313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:32.046313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:32.046313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:32.046313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:32.046313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:32.046313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:32.046313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:32.047194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:32.047194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:32.047194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:32.047194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:32.047194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:32.047194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:32.047194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:32.047194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:32.047194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:32.047194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:32.047194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:32.047194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:32.047194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:32.047194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:32.047194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:32.047194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:32.047983 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:32.047983 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:32.047983 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:32.047983 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:32.047983 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:32.047983 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:32.047983 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:32.047983 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:32.047983 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:32.047983 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:32.047983 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:27:32.047983 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:32.047983 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 240/479] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 30 10:27:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:32.053293 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a18e4-8fd9-4aa6-8fd9-dc750252eab9 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:32.056972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:32.171369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a18e4-8fd9-4aa6-8fd9-dc750252eab9 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:32.208960 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db0df5-919c-4f95-939c-f72ad50aa786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:32.209628 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db0df5-919c-4f95-939c-f72ad50aa786 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:32.209912 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db0df5-919c-4f95-939c-f72ad50aa786 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:32.210194 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db0df5-919c-4f95-939c-f72ad50aa786 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:32.210934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db0df5-919c-4f95-939c-f72ad50aa786 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:32.211245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db0df5-919c-4f95-939c-f72ad50aa786 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:32.212629 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db0df5-919c-4f95-939c-f72ad50aa786 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:32.221830 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 240/480] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:27:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:33.546412 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e0749-7179-4d5f-8b56-0066c5ec077b None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:33.546914 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e0749-7179-4d5f-8b56-0066c5ec077b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:33.546914 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e0749-7179-4d5f-8b56-0066c5ec077b None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:33.548579 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 241/481] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:33.573550 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8b2cb-044d-497c-9b3e-1d173e22e1f1 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:33.574039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8b2cb-044d-497c-9b3e-1d173e22e1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:33.574142 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8b2cb-044d-497c-9b3e-1d173e22e1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:33.593496 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-6cc8b2cb-044d-497c-9b3e-1d173e22e1f1 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:33.594678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6cc8b2cb-044d-497c-9b3e-1d173e22e1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:33.663746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:33.673889 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 241/482] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:33.719070 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e0749-7179-4d5f-8b56-0066c5ec077b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:33.739495 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731f505-d9f8-44da-872d-cd83fffa3733 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:33.739768 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731f505-d9f8-44da-872d-cd83fffa3733 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:33.740042 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731f505-d9f8-44da-872d-cd83fffa3733 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:33.741692 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 242/483] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:27:33.746812 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f5a0d-969d-40aa-aa50-24ecafdaeb2d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:33.747095 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f5a0d-969d-40aa-aa50-24ecafdaeb2d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:33.747367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f5a0d-969d-40aa-aa50-24ecafdaeb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:33.783164 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-5e4f5a0d-969d-40aa-aa50-24ecafdaeb2d None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:33.784511 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-5e4f5a0d-969d-40aa-aa50-24ecafdaeb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:33.811927 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:33.897595 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 243/484] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 30 10:27:33.900939 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e0749-7179-4d5f-8b56-0066c5ec077b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:33.928739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f5a0d-969d-40aa-aa50-24ecafdaeb2d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:33.947983 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613f847-cdbe-4c34-a5dc-4d63c180daff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:33.948819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613f847-cdbe-4c34-a5dc-4d63c180daff None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:33.949103 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613f847-cdbe-4c34-a5dc-4d63c180daff None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:33.949451 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613f847-cdbe-4c34-a5dc-4d63c180daff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:33.973996 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613f847-cdbe-4c34-a5dc-4d63c180daff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:33.981781 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-1613f847-cdbe-4c34-a5dc-4d63c180daff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:33.981781 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:33.981781 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:33.981781 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:33.981781 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:33.981781 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:33.981781 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:33.981781 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:33.981781 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:33.981781 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:33.981781 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:33.981781 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:33.981781 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:33.981781 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:33.981781 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:33.981781 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:33.985108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:33.985108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:33.985108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:33.985108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:33.985108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:33.985108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:33.985108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:33.985108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:33.985108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:33.985108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:33.985108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:33.985108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:33.985108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:33.985108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:33.985108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:33.985108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:33.987478 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:33.987478 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:33.987478 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:33.987478 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:33.987478 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:33.987478 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:33.987478 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:33.987478 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:33.987478 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:33.987478 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:33.987478 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:33.987478 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:33.987478 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 242/485] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 30 10:27:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:33.988750 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6326e-881f-4d63-8483-190a9742f61a None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:33.989046 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6326e-881f-4d63-8483-190a9742f61a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:33.989329 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6326e-881f-4d63-8483-190a9742f61a None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:33.991428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 243/486] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:27:33.992648 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6326e-881f-4d63-8483-190a9742f61a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:34.053173 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f5a0d-969d-40aa-aa50-24ecafdaeb2d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:34.090079 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33875b-3b41-49cd-9601-5f19f3c3a818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:34.091436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33875b-3b41-49cd-9601-5f19f3c3a818 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:34.091682 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33875b-3b41-49cd-9601-5f19f3c3a818 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:34.092017 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33875b-3b41-49cd-9601-5f19f3c3a818 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:34.093030 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:34.103753 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33875b-3b41-49cd-9601-5f19f3c3a818 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:34.111688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-6b33875b-3b41-49cd-9601-5f19f3c3a818 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:34.111688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:34.111688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:34.111688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:34.111688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:34.111688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:34.111688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:34.111688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:34.111688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:34.111688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:34.111688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:34.111688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:34.111688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:34.111688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:34.111688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:34.111688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:34.112638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:34.112638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:34.112638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:34.112638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:34.112638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:34.112638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:34.112638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:34.112638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:34.112638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:34.112638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:34.112638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:34.112638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:34.112638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:34.112638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:34.112638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:34.112638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:34.113417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:34.113417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:34.113417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:34.113417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:34.113417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:34.113417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:34.113417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:34.113417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:34.113417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:34.113417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:34.113417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:34.113417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:34.113417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 244/487] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 30 10:27:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:27:34.114602 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23512bc-40d7-4776-aac2-a795b8ac50ac None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:34.114841 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23512bc-40d7-4776-aac2-a795b8ac50ac None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:34.115215 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23512bc-40d7-4776-aac2-a795b8ac50ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:34.124764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6326e-881f-4d63-8483-190a9742f61a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:34.132966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d23512bc-40d7-4776-aac2-a795b8ac50ac None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:34.134089 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d23512bc-40d7-4776-aac2-a795b8ac50ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:34.141206 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:34.163791 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ada019-99f4-419b-9803-81f2587cec54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:34.164823 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ada019-99f4-419b-9803-81f2587cec54 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:34.165309 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ada019-99f4-419b-9803-81f2587cec54 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:34.165802 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ada019-99f4-419b-9803-81f2587cec54 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:34.166768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ada019-99f4-419b-9803-81f2587cec54 None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:34.167327 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ada019-99f4-419b-9803-81f2587cec54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:34.169252 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ada019-99f4-419b-9803-81f2587cec54 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:34.178534 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 244/488] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 30 10:27:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:34.179620 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ada019-99f4-419b-9803-81f2587cec54 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:34.209531 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 245/489] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:34.210456 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23512bc-40d7-4776-aac2-a795b8ac50ac None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:34.291271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ada019-99f4-419b-9803-81f2587cec54 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:34.324814 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23512bc-40d7-4776-aac2-a795b8ac50ac None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:34.328896 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1774e41-77b9-4379-b2f9-ae48065ed25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:34.329820 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1774e41-77b9-4379-b2f9-ae48065ed25f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:34.330298 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1774e41-77b9-4379-b2f9-ae48065ed25f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:34.330767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1774e41-77b9-4379-b2f9-ae48065ed25f None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:34.332096 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1774e41-77b9-4379-b2f9-ae48065ed25f None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:34.333037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1774e41-77b9-4379-b2f9-ae48065ed25f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:34.335987 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1774e41-77b9-4379-b2f9-ae48065ed25f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:34.340463 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:34.350733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 245/490] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 30 10:27:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:34.351987 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1774e41-77b9-4379-b2f9-ae48065ed25f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:34.362567 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d3822-cf87-4223-b212-d5ab1618f58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:34.363410 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d3822-cf87-4223-b212-d5ab1618f58d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:34.363631 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d3822-cf87-4223-b212-d5ab1618f58d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:34.363909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d3822-cf87-4223-b212-d5ab1618f58d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:34.375055 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d3822-cf87-4223-b212-d5ab1618f58d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:34.376493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d3822-cf87-4223-b212-d5ab1618f58d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:34.394989 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-435d3822-cf87-4223-b212-d5ab1618f58d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:34.394989 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:34.394989 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:34.394989 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:34.394989 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:34.394989 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:34.394989 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:34.394989 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:34.394989 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:34.394989 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:34.394989 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:34.394989 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:34.394989 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:34.394989 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:34.394989 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:34.396004 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:34.396004 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:34.396004 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:34.396004 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:34.396004 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:34.396004 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:34.396004 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:34.396004 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:34.396004 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:34.396004 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:34.396004 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:34.396004 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:34.396004 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:34.396004 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:34.396004 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:34.396004 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:34.396004 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:34.397089 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:34.397089 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:34.397089 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:34.397089 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:34.399921 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:34.400591 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 246/491] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:34.401583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d3822-cf87-4223-b212-d5ab1618f58d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:34.464332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1774e41-77b9-4379-b2f9-ae48065ed25f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:34.499896 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9afb4f9-12a3-4698-be3e-9fa82c0d6701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:34.500709 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afb4f9-12a3-4698-be3e-9fa82c0d6701 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:34.500990 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afb4f9-12a3-4698-be3e-9fa82c0d6701 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:34.501266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afb4f9-12a3-4698-be3e-9fa82c0d6701 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:34.507475 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d3822-cf87-4223-b212-d5ab1618f58d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:34.511285 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9afb4f9-12a3-4698-be3e-9fa82c0d6701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:34.518864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-c9afb4f9-12a3-4698-be3e-9fa82c0d6701 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:34.518864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:34.518864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:34.518864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:34.518864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:34.518864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:34.518864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:34.518864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:34.518864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:34.518864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:34.518864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:34.518864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:34.518864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:34.518864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:34.518864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:34.518864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:34.519764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:34.519764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:34.519764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:34.519764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:34.519764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:34.519764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:34.519764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:34.519764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:34.519764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:34.519764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:34.519764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:34.519764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:34.519764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:34.519764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:34.519764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:34.519764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:34.520598 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:34.520598 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:34.520598 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:34.520598 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:34.520598 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:34.520598 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:34.520598 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:34.520598 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:34.520598 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:34.520598 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:34.520598 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:34.520598 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:34.520598 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 246/492] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 30 10:27:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:34.521258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ec82f-addc-4480-b1ed-e722452e749e None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:34.521816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ec82f-addc-4480-b1ed-e722452e749e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:34.521816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ec82f-addc-4480-b1ed-e722452e749e None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:34.526993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 247/493] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:34.526993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ec82f-addc-4480-b1ed-e722452e749e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:34.552168 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d65df-4188-4b9e-88ff-53c3985a60f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:34.553315 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d65df-4188-4b9e-88ff-53c3985a60f2 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:34.553604 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d65df-4188-4b9e-88ff-53c3985a60f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:34.553880 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d65df-4188-4b9e-88ff-53c3985a60f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:34.564546 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d65df-4188-4b9e-88ff-53c3985a60f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:34.566018 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d65df-4188-4b9e-88ff-53c3985a60f2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:34.583248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-794d65df-4188-4b9e-88ff-53c3985a60f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:34.583248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:34.583248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:34.583248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:34.583248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:34.583248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:34.583248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:34.583248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:34.583248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:34.583248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:34.583248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:34.583248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:34.583248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:34.583248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:34.583248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:34.585230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:34.585230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:34.585230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:34.585230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:34.585230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:34.585230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:34.585230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:34.585230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:34.585230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:34.585230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:34.585230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:34.585230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:34.585230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:34.585230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:34.585230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:34.585230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:34.585230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:34.586072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:34.586072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:34.586072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:34.586072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:34.586072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 247/494] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:34.586072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d65df-4188-4b9e-88ff-53c3985a60f2 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:34.607321 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:34.640470 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:34.646570 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ec82f-addc-4480-b1ed-e722452e749e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:34.682692 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6218e8c-8bc0-42dc-82aa-38f73cff71da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:34.683359 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6218e8c-8bc0-42dc-82aa-38f73cff71da None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:34.683652 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6218e8c-8bc0-42dc-82aa-38f73cff71da None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:34.684210 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6218e8c-8bc0-42dc-82aa-38f73cff71da None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:34.684742 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6218e8c-8bc0-42dc-82aa-38f73cff71da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:34.685139 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6218e8c-8bc0-42dc-82aa-38f73cff71da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:34.686468 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6218e8c-8bc0-42dc-82aa-38f73cff71da None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:34.694099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d65df-4188-4b9e-88ff-53c3985a60f2 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:34.698052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 248/495] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:34.702516 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7046a3-3657-4567-bcf0-4d15c9b490c5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:34.702882 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7046a3-3657-4567-bcf0-4d15c9b490c5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:34.703249 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7046a3-3657-4567-bcf0-4d15c9b490c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:34.724361 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8a7046a3-3657-4567-bcf0-4d15c9b490c5 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:34.725772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8a7046a3-3657-4567-bcf0-4d15c9b490c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:34.731886 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d8e41-b5d7-4ca0-9d39-a6b8c2859a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:34.732574 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d8e41-b5d7-4ca0-9d39-a6b8c2859a95 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:34.732855 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d8e41-b5d7-4ca0-9d39-a6b8c2859a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:34.733124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d8e41-b5d7-4ca0-9d39-a6b8c2859a95 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:34.734282 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d8e41-b5d7-4ca0-9d39-a6b8c2859a95 None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:34.734591 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d8e41-b5d7-4ca0-9d39-a6b8c2859a95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:34.736324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d8e41-b5d7-4ca0-9d39-a6b8c2859a95 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:34.749740 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 248/496] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 30 10:27:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:34.749740 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d8e41-b5d7-4ca0-9d39-a6b8c2859a95 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:34.799922 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 249/497] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:34.800783 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7046a3-3657-4567-bcf0-4d15c9b490c5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:34.843769 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:34.864180 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d8e41-b5d7-4ca0-9d39-a6b8c2859a95 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:34.894777 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:34.899601 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50341c-54f4-4f23-9481-e7796f19b24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:34.900267 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50341c-54f4-4f23-9481-e7796f19b24c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:34.900578 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50341c-54f4-4f23-9481-e7796f19b24c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:34.900858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50341c-54f4-4f23-9481-e7796f19b24c None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:34.901568 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50341c-54f4-4f23-9481-e7796f19b24c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:34.901879 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50341c-54f4-4f23-9481-e7796f19b24c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:34.903281 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50341c-54f4-4f23-9481-e7796f19b24c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:34.907901 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7046a3-3657-4567-bcf0-4d15c9b490c5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:34.916118 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 249/498] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:34.916899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50341c-54f4-4f23-9481-e7796f19b24c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:34.948355 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f91b0d-a6b4-4dea-b42b-292422c39184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:34.949181 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f91b0d-a6b4-4dea-b42b-292422c39184 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:34.949501 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f91b0d-a6b4-4dea-b42b-292422c39184 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:34.949939 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f91b0d-a6b4-4dea-b42b-292422c39184 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:34.957416 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f91b0d-a6b4-4dea-b42b-292422c39184 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:34.958865 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f91b0d-a6b4-4dea-b42b-292422c39184 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:34.975034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-f5f91b0d-a6b4-4dea-b42b-292422c39184 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 30 10:27:34.975034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:34.975034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:34.975034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:34.975034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:34.975034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:34.975034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:34.975034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:34.975034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:34.975034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:34.975034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:34.975034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:34.975034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:27:34.975034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:27:34.975034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:27:34.975034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:27:34.975936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:34.975936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:34.975936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:27:34.975936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:34.975936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:27:34.975936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:34.975936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:34.975936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:34.975936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:34.975936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:34.975936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:34.975936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:34.975936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:34.975936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:34.975936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:34.975936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:34.975936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:34.975936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:34.977408 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:34.977408 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:34.977408 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:27:34.977408 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:27:34.977408 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:27:34.977408 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:27:34.977408 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:27:34.977408 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:27:34.977408 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 30 10:27:34.977408 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:34.977408 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 250/499] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:34.977408 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f91b0d-a6b4-4dea-b42b-292422c39184 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:35.035721 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50341c-54f4-4f23-9481-e7796f19b24c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:35.071041 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3d12f-2fe8-4d1f-b38a-f0ce162e75f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:35.071825 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3d12f-2fe8-4d1f-b38a-f0ce162e75f5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:35.072110 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3d12f-2fe8-4d1f-b38a-f0ce162e75f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:35.072390 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3d12f-2fe8-4d1f-b38a-f0ce162e75f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:35.081098 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:35.083226 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f91b0d-a6b4-4dea-b42b-292422c39184 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:35.083408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3d12f-2fe8-4d1f-b38a-f0ce162e75f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:35.085483 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3d12f-2fe8-4d1f-b38a-f0ce162e75f5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:35.103634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-81d3d12f-2fe8-4d1f-b38a-f0ce162e75f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:35.103634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:35.103634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:35.103634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:35.103634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:35.103634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:35.103634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:35.103634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:35.103634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:35.103634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:35.103634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:35.103634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:35.103634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:35.103634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:35.103634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:35.104665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:35.104665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:35.104665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:35.104665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:35.104665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:35.104665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:35.104665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:35.104665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:35.104665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:35.104665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:35.104665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:35.104665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:35.104665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:35.104665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:35.104665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:35.104665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:35.104665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:35.105732 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:35.105732 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:35.105732 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:35.105732 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:35.105732 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 250/500] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:35.105732 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3d12f-2fe8-4d1f-b38a-f0ce162e75f5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:35.121830 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4efe2-dd8d-4da3-84a9-506ec1348cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:35.122551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4efe2-dd8d-4da3-84a9-506ec1348cbc None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:35.122893 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4efe2-dd8d-4da3-84a9-506ec1348cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:35.123167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4efe2-dd8d-4da3-84a9-506ec1348cbc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:35.133538 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4efe2-dd8d-4da3-84a9-506ec1348cbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:35.141668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-48c4efe2-dd8d-4da3-84a9-506ec1348cbc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:35.141668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:35.141668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:35.141668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:35.141668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:35.141668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:35.141668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:35.141668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:35.141668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:35.141668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:35.141668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:35.141668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:35.141668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:35.141668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:35.141668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:35.141668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:35.142690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:35.142690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:35.142690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:35.142690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:35.142690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:35.142690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:35.142690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:35.142690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:35.142690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:35.142690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:35.142690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:35.142690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:35.142690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:35.142690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:35.142690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:35.142690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:35.143526 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:35.143526 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:35.143526 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:35.143526 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:35.143526 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:35.143526 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:35.143526 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:35.143526 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:35.143526 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:35.143526 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:35.143526 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:35.143526 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:35.143526 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 251/501] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 30 10:27:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:35.144546 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4efe2-dd8d-4da3-84a9-506ec1348cbc None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:35.158662 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:35.204167 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3d12f-2fe8-4d1f-b38a-f0ce162e75f5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:35.237316 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438a3fa-e62b-4bdc-99da-e6ecf50317a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:35.238093 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438a3fa-e62b-4bdc-99da-e6ecf50317a0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:35.238375 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438a3fa-e62b-4bdc-99da-e6ecf50317a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:35.238650 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438a3fa-e62b-4bdc-99da-e6ecf50317a0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:35.245902 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438a3fa-e62b-4bdc-99da-e6ecf50317a0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:35.247860 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438a3fa-e62b-4bdc-99da-e6ecf50317a0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:35.248489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4efe2-dd8d-4da3-84a9-506ec1348cbc None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:35.263935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-7438a3fa-e62b-4bdc-99da-e6ecf50317a0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:27:35.263935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:35.263935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:35.263935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:35.263935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:35.263935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:35.263935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:35.263935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:35.263935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:35.263935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:35.263935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:35.263935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:35.263935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:27:35.263935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:27:35.263935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:27:35.263935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:27:35.265043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:35.265043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:35.265043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:27:35.265043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:35.265043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:27:35.265043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:35.265043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:35.265043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:35.265043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:35.265043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:35.265043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:35.265043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:35.265043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:35.265043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:35.265043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:35.265043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:35.265043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:35.265043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:35.265943 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:35.265943 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:35.265943 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:27:35.265943 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:27:35.265943 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:27:35.265943 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:27:35.265943 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:27:35.265943 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:27:35.265943 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:27:35.265943 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:35.265943 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 251/502] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Jun 30 10:27:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:35.266971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50902680-e4fc-4a15-966d-529db752a141 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:35.266971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50902680-e4fc-4a15-966d-529db752a141 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:35.267151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50902680-e4fc-4a15-966d-529db752a141 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:35.268390 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 252/503] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:35.269101 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50902680-e4fc-4a15-966d-529db752a141 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:35.289194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa3929-ded3-4d2d-9f79-34aad2e92f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:35.290071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa3929-ded3-4d2d-9f79-34aad2e92f35 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:35.290525 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa3929-ded3-4d2d-9f79-34aad2e92f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:35.290901 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa3929-ded3-4d2d-9f79-34aad2e92f35 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:35.291734 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa3929-ded3-4d2d-9f79-34aad2e92f35 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:35.292045 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa3929-ded3-4d2d-9f79-34aad2e92f35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:35.293539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa3929-ded3-4d2d-9f79-34aad2e92f35 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:35.323634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:35.330591 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 252/504] 10.222.0.59 () {56 vars in 1137 bytes} [Thu Jun 30 10:27:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:35.331421 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa3929-ded3-4d2d-9f79-34aad2e92f35 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:35.372886 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50902680-e4fc-4a15-966d-529db752a141 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:35.394303 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:35.406336 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e08ba-4d1e-4b8c-b7e3-b8feb81e131c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:35.406986 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e08ba-4d1e-4b8c-b7e3-b8feb81e131c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:35.407270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e08ba-4d1e-4b8c-b7e3-b8feb81e131c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:35.407548 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e08ba-4d1e-4b8c-b7e3-b8feb81e131c None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:35.408258 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e08ba-4d1e-4b8c-b7e3-b8feb81e131c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:35.408586 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e08ba-4d1e-4b8c-b7e3-b8feb81e131c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:35.409954 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e08ba-4d1e-4b8c-b7e3-b8feb81e131c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:35.420894 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 253/505] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:35.422173 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ec502-7a56-4ec8-9439-5ef500f3328b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:35.422459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ec502-7a56-4ec8-9439-5ef500f3328b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:35.422734 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ec502-7a56-4ec8-9439-5ef500f3328b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:35.429346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa3929-ded3-4d2d-9f79-34aad2e92f35 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:35.438534 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-362ec502-7a56-4ec8-9439-5ef500f3328b None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:35.439694 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-362ec502-7a56-4ec8-9439-5ef500f3328b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:35.464101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe1cbc-3bc8-4e46-ab7a-f2f9dcc38de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:35.464796 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe1cbc-3bc8-4e46-ab7a-f2f9dcc38de8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:35.465080 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe1cbc-3bc8-4e46-ab7a-f2f9dcc38de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:35.465354 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe1cbc-3bc8-4e46-ab7a-f2f9dcc38de8 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:35.466094 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe1cbc-3bc8-4e46-ab7a-f2f9dcc38de8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:35.466425 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe1cbc-3bc8-4e46-ab7a-f2f9dcc38de8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:35.467804 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe1cbc-3bc8-4e46-ab7a-f2f9dcc38de8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:35.475706 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 253/506] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 30 10:27:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:35.476473 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe1cbc-3bc8-4e46-ab7a-f2f9dcc38de8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:35.505454 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 254/507] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:35.506354 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ec502-7a56-4ec8-9439-5ef500f3328b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:35.550124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:35.582051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe1cbc-3bc8-4e46-ab7a-f2f9dcc38de8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:35.607570 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:35.607704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ec502-7a56-4ec8-9439-5ef500f3328b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:35.615744 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043118e0-2445-4504-973c-cc5c3952bdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:35.616401 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043118e0-2445-4504-973c-cc5c3952bdfa None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:35.616732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043118e0-2445-4504-973c-cc5c3952bdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:35.617012 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043118e0-2445-4504-973c-cc5c3952bdfa None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:35.617837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043118e0-2445-4504-973c-cc5c3952bdfa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:35.618157 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043118e0-2445-4504-973c-cc5c3952bdfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:35.619606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043118e0-2445-4504-973c-cc5c3952bdfa None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:35.637021 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 254/508] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Jun 30 10:27:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:35.637809 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043118e0-2445-4504-973c-cc5c3952bdfa None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:35.640554 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a718a13-bbd0-43ee-b2c3-4a4881bcba82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:35.641206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a718a13-bbd0-43ee-b2c3-4a4881bcba82 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:35.641491 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a718a13-bbd0-43ee-b2c3-4a4881bcba82 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:35.641769 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a718a13-bbd0-43ee-b2c3-4a4881bcba82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:35.707051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a718a13-bbd0-43ee-b2c3-4a4881bcba82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:35.708489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a718a13-bbd0-43ee-b2c3-4a4881bcba82 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:35.735174 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043118e0-2445-4504-973c-cc5c3952bdfa None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:35.748382 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:35.768927 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431d8a6-59be-4b49-bb4f-0bd1b12e34f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:35.769706 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431d8a6-59be-4b49-bb4f-0bd1b12e34f2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:35.769992 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431d8a6-59be-4b49-bb4f-0bd1b12e34f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:35.770271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431d8a6-59be-4b49-bb4f-0bd1b12e34f2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:35.777271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d431d8a6-59be-4b49-bb4f-0bd1b12e34f2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:35.779273 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d431d8a6-59be-4b49-bb4f-0bd1b12e34f2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:35.793518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-d431d8a6-59be-4b49-bb4f-0bd1b12e34f2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 10:27:35.793518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:35.793518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:35.793518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:35.793518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:35.793518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:35.793518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:35.793518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:35.793518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:35.793518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:35.793518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:35.793518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:35.793518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:27:35.793518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:27:35.793518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:27:35.793518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:27:35.794396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:35.794396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:35.794396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:27:35.794396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:35.794396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:27:35.794396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:35.794396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:35.794396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:35.794396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:35.794396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:35.794396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:35.794396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:35.794396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:35.794396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:35.794396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:35.794396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:35.794396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:35.794396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:35.795293 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:35.795293 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:35.795293 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:27:35.795293 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:27:35.795293 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:27:35.795293 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:27:35.795293 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:27:35.795293 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:27:35.795293 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 10:27:35.795293 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:35.795293 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 255/509] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:35.795854 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431d8a6-59be-4b49-bb4f-0bd1b12e34f2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:35.806142 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 255/510] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:27:35.806959 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a718a13-bbd0-43ee-b2c3-4a4881bcba82 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:35.845384 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:35.898352 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431d8a6-59be-4b49-bb4f-0bd1b12e34f2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:35.904738 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a718a13-bbd0-43ee-b2c3-4a4881bcba82 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:35.930775 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d56647-437a-493d-81c3-414198f5c474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:35.931554 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d56647-437a-493d-81c3-414198f5c474 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:35.931839 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d56647-437a-493d-81c3-414198f5c474 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:35.932112 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d56647-437a-493d-81c3-414198f5c474 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:35.937368 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032d644-cd89-49bc-9f78-b50417834617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:35.938140 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032d644-cd89-49bc-9f78-b50417834617 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:35.938421 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032d644-cd89-49bc-9f78-b50417834617 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:35.938692 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032d644-cd89-49bc-9f78-b50417834617 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:35.943097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d56647-437a-493d-81c3-414198f5c474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:35.944597 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d56647-437a-493d-81c3-414198f5c474 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:35.948438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032d644-cd89-49bc-9f78-b50417834617 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:35.950527 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032d644-cd89-49bc-9f78-b50417834617 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:35.952446 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:35.961949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-d8d56647-437a-493d-81c3-414198f5c474 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:35.961949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:35.961949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:35.961949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:35.961949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:35.961949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:35.961949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:35.961949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:35.961949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:35.961949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:35.961949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:35.961949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:35.961949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:35.961949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:35.961949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:35.962824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:35.962824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:35.962824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:35.962824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:35.962824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:35.962824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:35.962824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:35.962824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:35.962824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:35.962824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:35.962824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:35.962824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:35.962824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:35.962824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:35.962824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:35.962824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:35.962824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:35.963696 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:35.963696 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:35.963696 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:35.963696 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:35.963696 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 256/511] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:35.964292 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d56647-437a-493d-81c3-414198f5c474 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:35.968402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-6032d644-cd89-49bc-9f78-b50417834617 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:35.968402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:35.968402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:35.968402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:35.968402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:35.968402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:35.968402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:35.968402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:35.968402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:35.968402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:35.968402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:35.968402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:35.968402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:35.968402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:35.968402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:35.969420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:35.969420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:35.969420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:35.969420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:35.969420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:35.969420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:35.969420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:35.969420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:35.969420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:35.969420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:35.969420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:35.969420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:35.969420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:35.969420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:35.969420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:35.969420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:35.969420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:35.970373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:35.970373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:35.970373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:35.970373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:35.970373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 256/512] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:35.971419 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032d644-cd89-49bc-9f78-b50417834617 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:36.061167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:36.065151 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d56647-437a-493d-81c3-414198f5c474 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:36.072335 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032d644-cd89-49bc-9f78-b50417834617 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:36.099026 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776b42a-43aa-45e2-9ea2-de4fb785e1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:36.099662 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776b42a-43aa-45e2-9ea2-de4fb785e1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:36.099952 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776b42a-43aa-45e2-9ea2-de4fb785e1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:36.100231 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776b42a-43aa-45e2-9ea2-de4fb785e1f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:36.104940 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9715f6b-44af-4c12-9fa6-5c1fff19f172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:36.105605 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9715f6b-44af-4c12-9fa6-5c1fff19f172 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:36.105885 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9715f6b-44af-4c12-9fa6-5c1fff19f172 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:36.106157 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9715f6b-44af-4c12-9fa6-5c1fff19f172 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:36.106974 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9715f6b-44af-4c12-9fa6-5c1fff19f172 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:36.107281 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9715f6b-44af-4c12-9fa6-5c1fff19f172 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:36.108750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9715f6b-44af-4c12-9fa6-5c1fff19f172 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:36.145269 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 257/513] 10.222.0.59 () {56 vars in 1137 bytes} [Thu Jun 30 10:27:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:36.145975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9715f6b-44af-4c12-9fa6-5c1fff19f172 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:36.167751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776b42a-43aa-45e2-9ea2-de4fb785e1f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:36.169197 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776b42a-43aa-45e2-9ea2-de4fb785e1f6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:36.196518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:36.242814 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9715f6b-44af-4c12-9fa6-5c1fff19f172 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:36.263586 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:36.272425 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 257/514] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:27:36.273193 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776b42a-43aa-45e2-9ea2-de4fb785e1f6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:36.278503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9a9e5-d437-4ee5-a325-b3c030cf44d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:36.279290 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9a9e5-d437-4ee5-a325-b3c030cf44d4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:36.279569 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9a9e5-d437-4ee5-a325-b3c030cf44d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:36.279839 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9a9e5-d437-4ee5-a325-b3c030cf44d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:36.289645 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9a9e5-d437-4ee5-a325-b3c030cf44d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:36.291078 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9a9e5-d437-4ee5-a325-b3c030cf44d4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:36.308472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-04d9a9e5-d437-4ee5-a325-b3c030cf44d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:36.308472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:36.308472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:36.308472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:36.308472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:36.308472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:36.308472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:36.308472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:36.308472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:36.308472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:36.308472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:36.308472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:36.308472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:36.308472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:36.308472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:36.309966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:36.309966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:36.309966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:36.309966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:36.309966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:36.309966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:36.309966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:36.309966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:36.309966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:36.309966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:36.309966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:36.309966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:36.309966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:36.309966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:36.309966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:36.309966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:36.309966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:36.310802 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:36.310802 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:36.310802 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:36.310802 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:36.310802 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 258/515] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:36.311058 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9a9e5-d437-4ee5-a325-b3c030cf44d4 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:36.369129 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776b42a-43aa-45e2-9ea2-de4fb785e1f6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:36.401889 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3880e-ff68-4d95-9b27-d1050974ab79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:36.402560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3880e-ff68-4d95-9b27-d1050974ab79 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:36.402835 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3880e-ff68-4d95-9b27-d1050974ab79 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:36.403109 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3880e-ff68-4d95-9b27-d1050974ab79 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:36.403809 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3880e-ff68-4d95-9b27-d1050974ab79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:36.404109 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3880e-ff68-4d95-9b27-d1050974ab79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:36.405544 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3880e-ff68-4d95-9b27-d1050974ab79 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:36.410599 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9a9e5-d437-4ee5-a325-b3c030cf44d4 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:36.413632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:36.416774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 258/516] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:36.418818 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3880e-ff68-4d95-9b27-d1050974ab79 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:36.446547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e63c4-aa69-404f-85d7-4fa899de2776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:36.447196 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e63c4-aa69-404f-85d7-4fa899de2776 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:36.447481 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e63c4-aa69-404f-85d7-4fa899de2776 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:36.447761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e63c4-aa69-404f-85d7-4fa899de2776 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:36.448478 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e63c4-aa69-404f-85d7-4fa899de2776 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:36.448814 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e63c4-aa69-404f-85d7-4fa899de2776 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:36.450198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e63c4-aa69-404f-85d7-4fa899de2776 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:36.461266 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 259/517] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:36.461870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e63c4-aa69-404f-85d7-4fa899de2776 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:36.481210 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:36.522968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3880e-ff68-4d95-9b27-d1050974ab79 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:36.556296 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae327353-e7fa-4492-91a1-9eb7e81bc5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:36.556972 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae327353-e7fa-4492-91a1-9eb7e81bc5fb None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:36.557254 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae327353-e7fa-4492-91a1-9eb7e81bc5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:36.557556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae327353-e7fa-4492-91a1-9eb7e81bc5fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:36.560174 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e63c4-aa69-404f-85d7-4fa899de2776 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:36.591476 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216bcd1-8ab8-474a-bdf9-75427a39f80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:36.592247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216bcd1-8ab8-474a-bdf9-75427a39f80f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:36.592550 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216bcd1-8ab8-474a-bdf9-75427a39f80f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:36.592829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216bcd1-8ab8-474a-bdf9-75427a39f80f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:36.603176 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216bcd1-8ab8-474a-bdf9-75427a39f80f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:36.604627 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216bcd1-8ab8-474a-bdf9-75427a39f80f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:36.621921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-b216bcd1-8ab8-474a-bdf9-75427a39f80f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:36.621921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:36.621921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:36.621921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:36.621921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:36.621921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:36.621921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:36.621921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:36.621921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:36.621921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:36.621921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:36.621921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:36.621921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:36.621921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:36.621921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:36.623195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:36.623195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:36.623195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:36.623195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:36.623195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:36.623195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:36.623195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:36.623195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:36.623195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:36.623195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:36.623195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:36.623195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:36.623195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:36.623195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:36.623195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:36.623195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:36.623195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:36.624044 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:36.624044 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:36.624044 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:36.624044 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:36.624044 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 260/518] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:36.624044 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216bcd1-8ab8-474a-bdf9-75427a39f80f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:36.628898 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae327353-e7fa-4492-91a1-9eb7e81bc5fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:36.630355 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae327353-e7fa-4492-91a1-9eb7e81bc5fb None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:36.641395 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:36.687233 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:36.721848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216bcd1-8ab8-474a-bdf9-75427a39f80f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:36.729586 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 259/519] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:27:36.730551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae327353-e7fa-4492-91a1-9eb7e81bc5fb None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:36.759268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d6e87-cf67-4b40-b135-87fc4048898a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:36.759916 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d6e87-cf67-4b40-b135-87fc4048898a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:36.760204 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d6e87-cf67-4b40-b135-87fc4048898a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:36.760480 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d6e87-cf67-4b40-b135-87fc4048898a None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:36.761214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d6e87-cf67-4b40-b135-87fc4048898a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:36.761521 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d6e87-cf67-4b40-b135-87fc4048898a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:36.762908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d6e87-cf67-4b40-b135-87fc4048898a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:36.774204 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 261/520] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:36.774957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d6e87-cf67-4b40-b135-87fc4048898a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:36.827839 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae327353-e7fa-4492-91a1-9eb7e81bc5fb None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:36.850773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:36.861861 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ed793-684f-4d5e-8a16-8823be663d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:36.862645 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ed793-684f-4d5e-8a16-8823be663d38 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:36.862924 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ed793-684f-4d5e-8a16-8823be663d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:36.863197 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ed793-684f-4d5e-8a16-8823be663d38 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:36.870041 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ed793-684f-4d5e-8a16-8823be663d38 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:36.871516 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ed793-684f-4d5e-8a16-8823be663d38 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:36.873958 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d6e87-cf67-4b40-b135-87fc4048898a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:36.885660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-634ed793-684f-4d5e-8a16-8823be663d38 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 10:27:36.885660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:36.885660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:36.885660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:36.885660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:36.885660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:36.885660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:36.885660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:36.885660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:36.885660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:36.885660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:36.885660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:36.885660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:27:36.885660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:27:36.885660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:27:36.885660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:27:36.886768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:36.886768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:36.886768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:27:36.886768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:36.886768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:27:36.886768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:36.886768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:36.886768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:36.886768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:36.886768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:36.886768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:36.886768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:36.886768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:36.886768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:36.886768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:36.886768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:36.886768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:36.886768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:36.887875 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:36.887875 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:36.887875 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:27:36.887875 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:27:36.887875 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:27:36.887875 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:27:36.887875 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:27:36.887875 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:27:36.887875 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 10:27:36.887875 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:36.887875 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 260/521] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 30 10:27:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:36.888769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ed793-684f-4d5e-8a16-8823be663d38 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:36.906008 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:36.910851 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adfc39-a722-4ea4-a154-f4f6c3304704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:36.911517 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adfc39-a722-4ea4-a154-f4f6c3304704 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:36.911799 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adfc39-a722-4ea4-a154-f4f6c3304704 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:36.912071 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adfc39-a722-4ea4-a154-f4f6c3304704 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:36.912801 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66adfc39-a722-4ea4-a154-f4f6c3304704 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:36.914232 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66adfc39-a722-4ea4-a154-f4f6c3304704 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:36.933225 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 262/522] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 30 10:27:36 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:27:36.934037 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adfc39-a722-4ea4-a154-f4f6c3304704 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:37.016971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ed793-684f-4d5e-8a16-8823be663d38 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:37.057326 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adfc39-a722-4ea4-a154-f4f6c3304704 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:37.058395 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af5e1c-74a9-4af3-a0c7-4324bb747fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:37.059105 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af5e1c-74a9-4af3-a0c7-4324bb747fee None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:37.059388 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af5e1c-74a9-4af3-a0c7-4324bb747fee None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:37.060485 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af5e1c-74a9-4af3-a0c7-4324bb747fee None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:37.060485 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af5e1c-74a9-4af3-a0c7-4324bb747fee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:37.060743 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af5e1c-74a9-4af3-a0c7-4324bb747fee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:37.062152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af5e1c-74a9-4af3-a0c7-4324bb747fee None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:37.075823 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 261/523] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:37.076782 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af5e1c-74a9-4af3-a0c7-4324bb747fee None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:37.091802 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:37.100987 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5b3b6-acdf-4471-95ec-d06d2ff4da2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:37.101522 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5b3b6-acdf-4471-95ec-d06d2ff4da2a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:37.101809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5b3b6-acdf-4471-95ec-d06d2ff4da2a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:37.102089 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5b3b6-acdf-4471-95ec-d06d2ff4da2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:37.114635 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5b3b6-acdf-4471-95ec-d06d2ff4da2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:37.116089 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5b3b6-acdf-4471-95ec-d06d2ff4da2a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:37.135348 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-27a5b3b6-acdf-4471-95ec-d06d2ff4da2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:37.135348 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:37.135348 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:37.135348 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:37.135348 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:37.135348 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:37.135348 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:37.135348 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:37.135348 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:37.135348 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:37.135348 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:37.135348 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:37.135348 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:37.135348 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:37.135348 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:37.136270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:37.136270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:37.136270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:37.136270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:37.136270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:37.136270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:37.136270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:37.136270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:37.136270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:37.136270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:37.136270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:37.136270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:37.136270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:37.136270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:37.136270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:37.136270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:37.136270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:37.137865 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:37.137865 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:37.137865 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:37.137865 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:37.137865 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 263/524] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:37.138158 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5b3b6-acdf-4471-95ec-d06d2ff4da2a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:37.168426 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:37.190487 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af5e1c-74a9-4af3-a0c7-4324bb747fee None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:37.229929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c5d73-fc6c-4c58-9264-2c3d818b9140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:37.230832 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c5d73-fc6c-4c58-9264-2c3d818b9140 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:37.231113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c5d73-fc6c-4c58-9264-2c3d818b9140 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:37.231541 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c5d73-fc6c-4c58-9264-2c3d818b9140 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:37.238247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c5d73-fc6c-4c58-9264-2c3d818b9140 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:37.239712 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c5d73-fc6c-4c58-9264-2c3d818b9140 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:37.246851 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5b3b6-acdf-4471-95ec-d06d2ff4da2a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:37.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-f65c5d73-fc6c-4c58-9264-2c3d818b9140 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:37.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:37.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:37.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:37.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:37.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:37.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:37.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:37.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:37.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:37.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:37.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:37.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:27:37.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:27:37.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:27:37.257228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:27:37.257228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:37.257228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:37.257228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:37.257228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:37.257228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:37.257228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:37.257228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:37.257228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:37.257228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:37.257228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:37.257228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:37.257228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:37.257228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:37.257228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:37.257228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:37.257228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:37.258117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:27:37.258117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:27:37.258117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:27:37.258117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:27:37.258117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:27:37.258117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:27:37.258117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:37.258117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:37.258117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 262/525] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:27:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:37.258117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c5d73-fc6c-4c58-9264-2c3d818b9140 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:37.289529 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5638dd9-3867-4e91-a6aa-72616ac190c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:37.290284 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5638dd9-3867-4e91-a6aa-72616ac190c1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:37.290632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5638dd9-3867-4e91-a6aa-72616ac190c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:37.290982 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5638dd9-3867-4e91-a6aa-72616ac190c1 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:37.291889 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5638dd9-3867-4e91-a6aa-72616ac190c1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:37.292320 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5638dd9-3867-4e91-a6aa-72616ac190c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:37.293846 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5638dd9-3867-4e91-a6aa-72616ac190c1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:37.316834 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 264/526] 10.222.0.59 () {56 vars in 1139 bytes} [Thu Jun 30 10:27:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:37.316834 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5638dd9-3867-4e91-a6aa-72616ac190c1 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:37.360191 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:37.375819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c5d73-fc6c-4c58-9264-2c3d818b9140 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:37.413189 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721497f5-95ae-4f5c-bd9a-013f8cde31d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:37.413976 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721497f5-95ae-4f5c-bd9a-013f8cde31d5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:37.414271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721497f5-95ae-4f5c-bd9a-013f8cde31d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:37.414551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721497f5-95ae-4f5c-bd9a-013f8cde31d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:37.421590 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5638dd9-3867-4e91-a6aa-72616ac190c1 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:37.421715 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721497f5-95ae-4f5c-bd9a-013f8cde31d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:37.423161 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721497f5-95ae-4f5c-bd9a-013f8cde31d5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:37.425154 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:37.438599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-721497f5-95ae-4f5c-bd9a-013f8cde31d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:37.438599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:37.438599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:37.438599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:37.438599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:37.438599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:37.438599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:37.438599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:37.438599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:37.438599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:37.438599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:37.438599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:37.438599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:27:37.438599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:27:37.438599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:27:37.439683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:27:37.439683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:37.439683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:37.439683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:37.439683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:37.439683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:37.439683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:37.439683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:37.439683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:37.439683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:37.439683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:37.439683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:37.439683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:37.439683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:37.439683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:37.439683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:37.439683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:37.440735 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:27:37.440735 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:27:37.440735 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:27:37.440735 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:27:37.440735 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:27:37.440735 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:27:37.440735 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:37.440735 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:37.444593 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 263/527] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:27:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:37.445480 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721497f5-95ae-4f5c-bd9a-013f8cde31d5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:37.462255 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bd2f0-0e0b-410f-b009-ff26826e8d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:37.462917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bd2f0-0e0b-410f-b009-ff26826e8d51 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:37.463230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bd2f0-0e0b-410f-b009-ff26826e8d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:37.463526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bd2f0-0e0b-410f-b009-ff26826e8d51 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:37.464221 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38bd2f0-0e0b-410f-b009-ff26826e8d51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:37.464551 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38bd2f0-0e0b-410f-b009-ff26826e8d51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:37.466521 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38bd2f0-0e0b-410f-b009-ff26826e8d51 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:37.478846 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 265/528] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:37.479666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bd2f0-0e0b-410f-b009-ff26826e8d51 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:37.560247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721497f5-95ae-4f5c-bd9a-013f8cde31d5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:37.586106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bd2f0-0e0b-410f-b009-ff26826e8d51 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:37.587864 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:37.598408 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc9176-6a8a-4eee-8183-7524ceebbbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:37.599368 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc9176-6a8a-4eee-8183-7524ceebbbd3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:37.599685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc9176-6a8a-4eee-8183-7524ceebbbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:37.599992 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc9176-6a8a-4eee-8183-7524ceebbbd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:37.600858 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc9176-6a8a-4eee-8183-7524ceebbbd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:37.601172 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc9176-6a8a-4eee-8183-7524ceebbbd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:37.602775 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc9176-6a8a-4eee-8183-7524ceebbbd3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:37.625361 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 264/529] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:27:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:37.625361 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc9176-6a8a-4eee-8183-7524ceebbbd3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:37.627377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07778bb-c6b0-470a-9b37-ebd49b92ec42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:37.628154 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07778bb-c6b0-470a-9b37-ebd49b92ec42 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:37.628445 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07778bb-c6b0-470a-9b37-ebd49b92ec42 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:37.628749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07778bb-c6b0-470a-9b37-ebd49b92ec42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:37.690969 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:37.698697 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07778bb-c6b0-470a-9b37-ebd49b92ec42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:37.700721 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07778bb-c6b0-470a-9b37-ebd49b92ec42 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:37.736813 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc9176-6a8a-4eee-8183-7524ceebbbd3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:37.773441 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8366e-d477-4bc2-95cf-47f80879ec79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:37.774101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8366e-d477-4bc2-95cf-47f80879ec79 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:37.774386 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8366e-d477-4bc2-95cf-47f80879ec79 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:37.774667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8366e-d477-4bc2-95cf-47f80879ec79 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:37.775939 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8366e-d477-4bc2-95cf-47f80879ec79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:37.776293 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8366e-d477-4bc2-95cf-47f80879ec79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:37.780233 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8366e-d477-4bc2-95cf-47f80879ec79 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:37.797531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 265/530] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:27:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:37.797531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8366e-d477-4bc2-95cf-47f80879ec79 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:37.806835 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 266/531] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:27:37.811818 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07778bb-c6b0-470a-9b37-ebd49b92ec42 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:37.811818 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:37.908390 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07778bb-c6b0-470a-9b37-ebd49b92ec42 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:37.920458 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8366e-d477-4bc2-95cf-47f80879ec79 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:37.937440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:37.943988 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907744d7-579d-4142-b81e-dfe01ae6ae00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:37.944670 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907744d7-579d-4142-b81e-dfe01ae6ae00 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:37.944960 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907744d7-579d-4142-b81e-dfe01ae6ae00 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:37.945230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907744d7-579d-4142-b81e-dfe01ae6ae00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:37.946053 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907744d7-579d-4142-b81e-dfe01ae6ae00 None admin] RBAC: Adding query filter params (role.id=1c667697d38a434fbb99c61bc846c4a5, scope.project.id=423854cc8f524ecb8d740d1cb0053856, user.id=2522b8560d224aa1a973207a79ce6a99) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:37.946369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907744d7-579d-4142-b81e-dfe01ae6ae00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:37.947803 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907744d7-579d-4142-b81e-dfe01ae6ae00 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:37.953572 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 267/532] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:27:37 2022] GET /identity/v3/role_assignments?user.id=2522b8560d224aa1a973207a79ce6a99&scope.project.id=423854cc8f524ecb8d740d1cb0053856&role.id=1c667697d38a434fbb99c61bc846c4a5 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:37.954126 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907744d7-579d-4142-b81e-dfe01ae6ae00 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:37.971561 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fae957-fd3d-4d73-a09d-ca7e04dac3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:37.972127 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fae957-fd3d-4d73-a09d-ca7e04dac3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:37.972411 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fae957-fd3d-4d73-a09d-ca7e04dac3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:37.972724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fae957-fd3d-4d73-a09d-ca7e04dac3e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:37.981740 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fae957-fd3d-4d73-a09d-ca7e04dac3e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:37.983342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fae957-fd3d-4d73-a09d-ca7e04dac3e9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:37.999243 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-79fae957-fd3d-4d73-a09d-ca7e04dac3e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:37.999243 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:37.999243 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:37.999243 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:37.999243 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:37.999243 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:37.999243 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:37.999243 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:37.999243 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:37.999243 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:37.999243 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:37.999243 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:37.999243 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:27:37.999243 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:27:37.999243 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:27:38.000194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:27:38.000194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:38.000194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:38.000194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:38.000194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:38.000194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:38.000194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:38.000194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:38.000194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:38.000194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:38.000194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:38.000194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:38.000194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:38.000194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:38.000194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:38.000194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:38.000194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:38.001675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:27:38.001675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:27:38.001675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:27:38.001675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:27:38.001675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:27:38.001675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:27:38.001675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:38.001675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:38.001675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 266/533] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:27:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:38.002414 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fae957-fd3d-4d73-a09d-ca7e04dac3e9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:38.055392 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:38.097392 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907744d7-579d-4142-b81e-dfe01ae6ae00 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:38.122675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fae957-fd3d-4d73-a09d-ca7e04dac3e9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:38.136632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7937e92-427a-4a3f-bdbf-90e591b23145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:38.137330 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7937e92-427a-4a3f-bdbf-90e591b23145 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:38.137613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7937e92-427a-4a3f-bdbf-90e591b23145 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:38.137888 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7937e92-427a-4a3f-bdbf-90e591b23145 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:38.138712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7937e92-427a-4a3f-bdbf-90e591b23145 None admin] RBAC: Adding query filter params (role.id=1c667697d38a434fbb99c61bc846c4a5, scope.project.id=423854cc8f524ecb8d740d1cb0053856, user.id=1bfd036d747241d9bc314b60bf8648b6) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:38.139030 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7937e92-427a-4a3f-bdbf-90e591b23145 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:38.140455 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7937e92-427a-4a3f-bdbf-90e591b23145 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:38.146083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 268/534] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:27:37 2022] GET /identity/v3/role_assignments?user.id=1bfd036d747241d9bc314b60bf8648b6&scope.project.id=423854cc8f524ecb8d740d1cb0053856&role.id=1c667697d38a434fbb99c61bc846c4a5 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:38.150309 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7937e92-427a-4a3f-bdbf-90e591b23145 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:38.163037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e14c4-c94b-432d-8844-58de1585417b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:38.164224 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e14c4-c94b-432d-8844-58de1585417b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:38.164690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e14c4-c94b-432d-8844-58de1585417b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:38.165118 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e14c4-c94b-432d-8844-58de1585417b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:38.180023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e14c4-c94b-432d-8844-58de1585417b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:38.181832 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e14c4-c94b-432d-8844-58de1585417b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:38.201665 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-e74e14c4-c94b-432d-8844-58de1585417b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:38.201665 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:38.201665 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:38.201665 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:38.201665 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:38.201665 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:38.201665 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:38.201665 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:38.201665 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:38.201665 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:38.201665 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:38.201665 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:38.201665 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:38.201665 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:38.201665 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:38.202749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:38.202749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:38.202749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:38.202749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:38.202749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:38.202749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:38.202749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:38.202749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:38.202749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:38.202749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:38.202749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:38.202749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:38.202749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:38.202749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:38.202749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:38.202749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:38.202749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:38.203815 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:38.203815 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:38.203815 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:38.203815 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:38.205704 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 267/535] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:38.213666 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e14c4-c94b-432d-8844-58de1585417b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:38.283631 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7937e92-427a-4a3f-bdbf-90e591b23145 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:38.285752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:38.320932 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:38.329309 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad2ce5-588d-4c61-b226-091203db447e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:38.330360 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad2ce5-588d-4c61-b226-091203db447e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:38.330850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad2ce5-588d-4c61-b226-091203db447e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:38.331336 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad2ce5-588d-4c61-b226-091203db447e None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:38.332519 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad2ce5-588d-4c61-b226-091203db447e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:38.333255 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad2ce5-588d-4c61-b226-091203db447e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:38.335086 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad2ce5-588d-4c61-b226-091203db447e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:38.363066 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 269/536] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:27:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:38.369993 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad2ce5-588d-4c61-b226-091203db447e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:38.450189 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e14c4-c94b-432d-8844-58de1585417b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:38.512904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfa3c3-33fb-42dc-8772-84c47db1d086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:38.513573 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfa3c3-33fb-42dc-8772-84c47db1d086 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:38.513906 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfa3c3-33fb-42dc-8772-84c47db1d086 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:38.514186 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfa3c3-33fb-42dc-8772-84c47db1d086 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:38.514912 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfa3c3-33fb-42dc-8772-84c47db1d086 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:38.515222 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfa3c3-33fb-42dc-8772-84c47db1d086 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:38.516642 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfa3c3-33fb-42dc-8772-84c47db1d086 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:38.548956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 268/537] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:38.550343 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfa3c3-33fb-42dc-8772-84c47db1d086 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:38.556487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad2ce5-588d-4c61-b226-091203db447e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:38.633561 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acad44-aebf-4d36-a0b3-ff186e0d3f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:38.634593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acad44-aebf-4d36-a0b3-ff186e0d3f26 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:38.634884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acad44-aebf-4d36-a0b3-ff186e0d3f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:38.635159 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acad44-aebf-4d36-a0b3-ff186e0d3f26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:38.636278 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acad44-aebf-4d36-a0b3-ff186e0d3f26 None admin] RBAC: Adding query filter params (role.id=1c667697d38a434fbb99c61bc846c4a5, scope.project.id=423854cc8f524ecb8d740d1cb0053856, user.id=afb7ea0cfb9c423799848b912724cd75) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:38.636617 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acad44-aebf-4d36-a0b3-ff186e0d3f26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:38.638264 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acad44-aebf-4d36-a0b3-ff186e0d3f26 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:38.645659 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 270/538] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:27:38 2022] GET /identity/v3/role_assignments?user.id=afb7ea0cfb9c423799848b912724cd75&scope.project.id=423854cc8f524ecb8d740d1cb0053856&role.id=1c667697d38a434fbb99c61bc846c4a5 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:38.679330 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:38.692239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfa3c3-33fb-42dc-8772-84c47db1d086 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:38.733598 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e43e9-1a07-4707-8616-4bc584e6536e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:38.734798 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e43e9-1a07-4707-8616-4bc584e6536e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:38.735302 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e43e9-1a07-4707-8616-4bc584e6536e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:38.735790 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e43e9-1a07-4707-8616-4bc584e6536e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:38.744165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e43e9-1a07-4707-8616-4bc584e6536e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:38.746283 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e43e9-1a07-4707-8616-4bc584e6536e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:38.761971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-e29e43e9-1a07-4707-8616-4bc584e6536e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:38.761971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:38.761971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:38.761971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:38.761971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:38.761971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:38.761971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:38.761971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:38.761971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:38.761971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:38.761971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:38.761971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:38.761971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:27:38.761971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:27:38.761971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:27:38.762882 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:27:38.762882 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:38.762882 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:38.762882 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:38.762882 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:38.762882 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:38.762882 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:38.762882 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:38.762882 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:38.762882 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:38.762882 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:38.762882 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:38.762882 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:38.762882 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:38.762882 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:38.762882 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:38.762882 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:38.763734 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:27:38.763734 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:27:38.763734 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:27:38.763734 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:27:38.763734 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:27:38.763734 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:27:38.763734 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:38.763734 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:38.766374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 269/539] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:27:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:27:38.773665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acad44-aebf-4d36-a0b3-ff186e0d3f26 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:38.878387 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:38.938996 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acad44-aebf-4d36-a0b3-ff186e0d3f26 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:38.986798 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861f343-e1fb-455b-bd48-fbeaa6b22df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:38.987471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861f343-e1fb-455b-bd48-fbeaa6b22df2 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:38.987755 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861f343-e1fb-455b-bd48-fbeaa6b22df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:38.988029 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861f343-e1fb-455b-bd48-fbeaa6b22df2 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:38.988840 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861f343-e1fb-455b-bd48-fbeaa6b22df2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:38.989148 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861f343-e1fb-455b-bd48-fbeaa6b22df2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:38.990583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861f343-e1fb-455b-bd48-fbeaa6b22df2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:39.011640 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 271/540] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:27:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:39.017421 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e43e9-1a07-4707-8616-4bc584e6536e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:39.180822 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e43e9-1a07-4707-8616-4bc584e6536e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:39.220495 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adf412-36ef-44b6-861b-4e482485bbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:39.221142 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adf412-36ef-44b6-861b-4e482485bbec None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:39.221431 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adf412-36ef-44b6-861b-4e482485bbec None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:39.221706 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adf412-36ef-44b6-861b-4e482485bbec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:39.222527 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52adf412-36ef-44b6-861b-4e482485bbec None admin] RBAC: Adding query filter params (role.id=1c667697d38a434fbb99c61bc846c4a5, scope.project.id=423854cc8f524ecb8d740d1cb0053856, user.id=fa8cb52425ba42d9ae3576e6fb18dc88) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:39.222836 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52adf412-36ef-44b6-861b-4e482485bbec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:39.224554 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52adf412-36ef-44b6-861b-4e482485bbec None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:39.231236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 270/541] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:27:39 2022] GET /identity/v3/role_assignments?user.id=fa8cb52425ba42d9ae3576e6fb18dc88&scope.project.id=423854cc8f524ecb8d740d1cb0053856&role.id=1c667697d38a434fbb99c61bc846c4a5 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:39.241093 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f408bc-3e9c-486f-ae73-83836bc8e841 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:39.241412 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f408bc-3e9c-486f-ae73-83836bc8e841 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:39.241657 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f408bc-3e9c-486f-ae73-83836bc8e841 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:39.243296 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 272/542] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:39.250581 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59a091-9862-48e0-a258-54dfd68de47b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:39.251270 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59a091-9862-48e0-a258-54dfd68de47b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:39.251755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59a091-9862-48e0-a258-54dfd68de47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:39.281843 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9a59a091-9862-48e0-a258-54dfd68de47b None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:39.283105 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9a59a091-9862-48e0-a258-54dfd68de47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:39.302174 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:39.391411 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 271/543] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:39.431523 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f408bc-3e9c-486f-ae73-83836bc8e841 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:39.541151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f408bc-3e9c-486f-ae73-83836bc8e841 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:39.563485 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:39.587024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359748a4-3f4b-4f81-9391-d6e43280e1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:39.587814 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359748a4-3f4b-4f81-9391-d6e43280e1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:39.588142 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359748a4-3f4b-4f81-9391-d6e43280e1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:39.588419 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359748a4-3f4b-4f81-9391-d6e43280e1b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:39.599607 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359748a4-3f4b-4f81-9391-d6e43280e1b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:39.607981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-359748a4-3f4b-4f81-9391-d6e43280e1b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:39.607981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:39.607981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:39.607981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:39.607981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:39.607981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:39.607981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:39.607981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:39.607981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:39.607981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:39.607981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:39.607981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:39.607981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:39.607981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:39.607981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:39.607981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:39.608909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:39.608909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:39.608909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:39.608909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:39.608909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:39.608909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:39.608909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:39.608909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:39.608909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:39.608909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:39.608909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:39.608909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:39.608909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:39.608909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:39.608909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:39.608909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:39.609724 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:39.609724 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:39.609724 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:39.609724 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:39.609724 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:39.609724 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:39.609724 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:39.609724 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:39.609724 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:39.609724 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:39.609724 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:39.609724 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:39.609724 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 273/544] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 30 10:27:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:39.615646 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59a091-9862-48e0-a258-54dfd68de47b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:39.765412 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59a091-9862-48e0-a258-54dfd68de47b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:39.814464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80251951-1aa2-4424-a14c-131104381bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:39.815491 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80251951-1aa2-4424-a14c-131104381bbf None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:39.815977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80251951-1aa2-4424-a14c-131104381bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:39.816450 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80251951-1aa2-4424-a14c-131104381bbf None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:39.817435 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80251951-1aa2-4424-a14c-131104381bbf None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:39.817941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80251951-1aa2-4424-a14c-131104381bbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:39.819532 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80251951-1aa2-4424-a14c-131104381bbf None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:39.832194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 272/545] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 30 10:27:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:39.837950 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359748a4-3f4b-4f81-9391-d6e43280e1b6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:40.006014 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359748a4-3f4b-4f81-9391-d6e43280e1b6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:40.054349 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8d91b-685f-46bf-ac67-9a1d92356809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:40.055147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8d91b-685f-46bf-ac67-9a1d92356809 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:40.055425 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8d91b-685f-46bf-ac67-9a1d92356809 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:40.055693 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8d91b-685f-46bf-ac67-9a1d92356809 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:40.067641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8d91b-685f-46bf-ac67-9a1d92356809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:40.069064 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8d91b-685f-46bf-ac67-9a1d92356809 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:40.102700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-fcd8d91b-685f-46bf-ac67-9a1d92356809 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:40.102700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:40.102700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:40.102700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:40.102700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:40.102700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:40.102700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:40.102700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:40.102700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:40.102700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:40.102700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:40.102700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:40.102700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:40.102700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:40.102700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:40.103616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:40.103616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:40.103616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:40.103616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:40.103616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:40.103616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:40.103616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:40.103616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:40.103616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:40.103616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:40.103616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:40.103616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:40.103616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:40.103616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:40.103616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:40.103616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:40.103616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:40.104445 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:40.104445 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:40.104445 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:40.104445 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:40.104445 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 274/546] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:40.110227 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80251951-1aa2-4424-a14c-131104381bbf None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:40.133437 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:40.283620 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80251951-1aa2-4424-a14c-131104381bbf None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:40.329724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43898f8e-2f93-49ee-abc1-9b071262d7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:40.330314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43898f8e-2f93-49ee-abc1-9b071262d7ae None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:40.330601 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43898f8e-2f93-49ee-abc1-9b071262d7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:40.330878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43898f8e-2f93-49ee-abc1-9b071262d7ae None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:40.331597 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43898f8e-2f93-49ee-abc1-9b071262d7ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:40.331905 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43898f8e-2f93-49ee-abc1-9b071262d7ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:40.333301 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43898f8e-2f93-49ee-abc1-9b071262d7ae None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:40.354069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 273/547] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:40.359290 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8d91b-685f-46bf-ac67-9a1d92356809 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:40.408747 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:40.499864 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8d91b-685f-46bf-ac67-9a1d92356809 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:40.523930 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece19b4-a22a-409f-b772-580a50fde9fe None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:40.524230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece19b4-a22a-409f-b772-580a50fde9fe None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:40.524492 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece19b4-a22a-409f-b772-580a50fde9fe None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:40.526155 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 274/548] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:40.533800 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad556ca7-585b-4daa-be0d-97f902ca7092 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:40.534364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad556ca7-585b-4daa-be0d-97f902ca7092 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:40.534846 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad556ca7-585b-4daa-be0d-97f902ca7092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:40.540539 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fac865-c19c-44c7-9229-c39c488dd4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:40.540539 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fac865-c19c-44c7-9229-c39c488dd4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:40.540539 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fac865-c19c-44c7-9229-c39c488dd4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:40.540539 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fac865-c19c-44c7-9229-c39c488dd4a9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:40.547859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fac865-c19c-44c7-9229-c39c488dd4a9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:40.549348 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fac865-c19c-44c7-9229-c39c488dd4a9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:40.571022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-44fac865-c19c-44c7-9229-c39c488dd4a9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:27:40.571022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:40.571022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:40.571022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:40.571022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:40.571022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:40.571022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:40.571022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:40.571022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:40.571022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:40.571022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:40.571022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:40.571022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:27:40.571022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:27:40.571022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:27:40.571022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:27:40.571947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:40.571947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:40.571947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:27:40.571947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:40.571947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:27:40.571947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:40.571947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:40.571947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:40.571947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:40.571947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:40.571947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:40.571947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:40.571947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:40.571947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:40.571947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:40.571947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:40.571947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:40.571947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:40.573524 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:40.573524 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:40.573524 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:27:40.573524 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:27:40.573524 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:27:40.573524 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:27:40.573524 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:27:40.573524 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:27:40.573524 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:27:40.573524 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:40.577007 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ad556ca7-585b-4daa-be0d-97f902ca7092 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:40.578182 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ad556ca7-585b-4daa-be0d-97f902ca7092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:40.580256 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 275/549] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:27:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:40.581067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fac865-c19c-44c7-9229-c39c488dd4a9 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:40.685220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:40.689106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:40.699759 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 275/550] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:40.701359 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d3b27-b65f-495d-974d-98a5a740f4bd None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:40.701856 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d3b27-b65f-495d-974d-98a5a740f4bd None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:40.702369 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d3b27-b65f-495d-974d-98a5a740f4bd None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:40.708179 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 276/551] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:40.709968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e097fb-e030-4f67-8322-7e4fd5215664 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:40.710467 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e097fb-e030-4f67-8322-7e4fd5215664 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:40.710968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e097fb-e030-4f67-8322-7e4fd5215664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:40.718404 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fac865-c19c-44c7-9229-c39c488dd4a9 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:40.730226 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-78e097fb-e030-4f67-8322-7e4fd5215664 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:40.732843 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-78e097fb-e030-4f67-8322-7e4fd5215664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:40.769895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ddb9f-fb73-4158-ab06-89a7f345bc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:40.770567 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ddb9f-fb73-4158-ab06-89a7f345bc1d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:40.770846 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ddb9f-fb73-4158-ab06-89a7f345bc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:40.771123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ddb9f-fb73-4158-ab06-89a7f345bc1d None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:40.771952 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ddb9f-fb73-4158-ab06-89a7f345bc1d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:40.772258 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ddb9f-fb73-4158-ab06-89a7f345bc1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:40.773760 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ddb9f-fb73-4158-ab06-89a7f345bc1d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:40.797311 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 276/552] 10.222.0.59 () {56 vars in 1135 bytes} [Thu Jun 30 10:27:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:40.798567 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ddb9f-fb73-4158-ab06-89a7f345bc1d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:40.824543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 277/553] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:40.824543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e097fb-e030-4f67-8322-7e4fd5215664 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:40.934777 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e097fb-e030-4f67-8322-7e4fd5215664 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:40.936851 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ddb9f-fb73-4158-ab06-89a7f345bc1d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:40.967060 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:40.977236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2405b16-b9f7-4e1a-bb64-709be76bc344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:40.977548 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9e935-d1d5-4ba9-90da-95dbf2f61d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:40.977879 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2405b16-b9f7-4e1a-bb64-709be76bc344 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:40.978161 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2405b16-b9f7-4e1a-bb64-709be76bc344 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:40.978436 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2405b16-b9f7-4e1a-bb64-709be76bc344 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:40.979241 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9e935-d1d5-4ba9-90da-95dbf2f61d5e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:40.979718 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9e935-d1d5-4ba9-90da-95dbf2f61d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:40.980184 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9e935-d1d5-4ba9-90da-95dbf2f61d5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:40.991537 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9e935-d1d5-4ba9-90da-95dbf2f61d5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:41.000487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-16b9e935-d1d5-4ba9-90da-95dbf2f61d5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:41.000487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:41.000487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:41.000487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:41.000487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:41.000487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:41.000487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:41.000487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:41.000487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:41.000487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:41.000487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:41.000487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:41.000487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:41.000487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:41.000487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:41.000487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:41.001515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:41.001515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:41.001515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:41.001515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:41.001515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:41.001515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:41.001515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:41.001515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:41.001515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:41.001515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:41.001515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:41.001515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:41.001515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:41.001515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:41.001515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:41.001515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:41.002545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:41.002545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:41.002545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:41.002545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:41.002545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:41.002545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:41.002545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:41.002545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:41.002545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:41.002545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:41.002545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:41.002545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:41.005791 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 277/554] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 30 10:27:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:41.006803 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9e935-d1d5-4ba9-90da-95dbf2f61d5e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:41.011616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:41.062902 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2405b16-b9f7-4e1a-bb64-709be76bc344 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:41.064699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2405b16-b9f7-4e1a-bb64-709be76bc344 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:41.117495 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9e935-d1d5-4ba9-90da-95dbf2f61d5e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:41.153951 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701763dd-9b44-421d-9082-b52c8b552ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:41.155127 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701763dd-9b44-421d-9082-b52c8b552ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:41.155409 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701763dd-9b44-421d-9082-b52c8b552ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:41.155640 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701763dd-9b44-421d-9082-b52c8b552ce3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:41.166007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701763dd-9b44-421d-9082-b52c8b552ce3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:41.178560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 278/555] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:27:41.179063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-701763dd-9b44-421d-9082-b52c8b552ce3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:41.179063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:41.179063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:41.179063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:41.179063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:41.179063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:41.179063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:41.179063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:41.179063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:41.179063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:41.179063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:41.179063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:41.179063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:41.179063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:41.179063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:41.179063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:41.180060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:41.180060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:41.180060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:41.180060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:41.180060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:41.180060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:41.180060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:41.180060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:41.180060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:41.180060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:41.180060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:41.180060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:41.180060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:41.180060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:41.180060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:41.180060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:41.180988 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:41.180988 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:41.180988 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:41.180988 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:41.180988 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:41.180988 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:41.180988 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:41.180988 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:41.180988 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:41.180988 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:41.180988 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:41.180988 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:41.181597 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2405b16-b9f7-4e1a-bb64-709be76bc344 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:41.181665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 278/556] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 30 10:27:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:41.181665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54428ec4-c814-48fe-926f-f3e69f9ff5b5 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:41.182427 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54428ec4-c814-48fe-926f-f3e69f9ff5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:41.182427 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54428ec4-c814-48fe-926f-f3e69f9ff5b5 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:41.184310 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 279/557] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:41.185092 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54428ec4-c814-48fe-926f-f3e69f9ff5b5 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:41.212099 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:41.259452 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:41.298943 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54428ec4-c814-48fe-926f-f3e69f9ff5b5 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:41.302090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2405b16-b9f7-4e1a-bb64-709be76bc344 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:41.337506 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe610ace-7520-4712-8f7b-4ed62874c960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:41.338330 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe610ace-7520-4712-8f7b-4ed62874c960 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:41.338614 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe610ace-7520-4712-8f7b-4ed62874c960 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:41.338991 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe610ace-7520-4712-8f7b-4ed62874c960 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:41.339368 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a0f00-7c7a-47af-ba11-d3995a378065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:41.340186 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a0f00-7c7a-47af-ba11-d3995a378065 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:41.340470 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a0f00-7c7a-47af-ba11-d3995a378065 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:41.340767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a0f00-7c7a-47af-ba11-d3995a378065 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:41.341505 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a0f00-7c7a-47af-ba11-d3995a378065 None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:41.341810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a0f00-7c7a-47af-ba11-d3995a378065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:41.343219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a0f00-7c7a-47af-ba11-d3995a378065 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:41.351249 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe610ace-7520-4712-8f7b-4ed62874c960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:41.352788 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe610ace-7520-4712-8f7b-4ed62874c960 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:41.356543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 279/558] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 30 10:27:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:41.357410 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a0f00-7c7a-47af-ba11-d3995a378065 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:41.372117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-fe610ace-7520-4712-8f7b-4ed62874c960 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:41.372117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:41.372117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:41.372117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:41.372117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:41.372117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:41.372117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:41.372117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:41.372117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:41.372117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:41.372117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:41.372117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:41.372117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:41.372117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:41.372117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:41.373564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:41.373564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:41.373564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:41.373564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:41.373564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:41.373564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:41.373564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:41.373564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:41.373564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:41.373564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:41.373564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:41.373564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:41.373564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:41.373564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:41.373564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:41.373564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:41.373564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:41.374456 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:41.374456 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:41.374456 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:41.374456 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:41.374456 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 280/559] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:41.374735 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be7cea-5175-4318-9c60-f0f5e8eabf70 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:41.374801 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be7cea-5175-4318-9c60-f0f5e8eabf70 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:41.375310 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be7cea-5175-4318-9c60-f0f5e8eabf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:41.393057 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-58be7cea-5175-4318-9c60-f0f5e8eabf70 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:41.394291 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-58be7cea-5175-4318-9c60-f0f5e8eabf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:41.451803 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:41.468678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 281/560] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:41.468678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be7cea-5175-4318-9c60-f0f5e8eabf70 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:41.468937 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a0f00-7c7a-47af-ba11-d3995a378065 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:41.503377 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419d169-156e-44ad-b76e-6852e05a72b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:41.504050 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419d169-156e-44ad-b76e-6852e05a72b9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:41.504338 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419d169-156e-44ad-b76e-6852e05a72b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:41.504650 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419d169-156e-44ad-b76e-6852e05a72b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:41.505388 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419d169-156e-44ad-b76e-6852e05a72b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:41.505701 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419d169-156e-44ad-b76e-6852e05a72b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:41.507078 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419d169-156e-44ad-b76e-6852e05a72b9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:41.515340 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 280/561] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 30 10:27:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:41.516128 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419d169-156e-44ad-b76e-6852e05a72b9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:41.527887 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:41.586291 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be7cea-5175-4318-9c60-f0f5e8eabf70 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:41.621662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351407c3-30ae-4f12-bada-b1cde2ee891b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:41.622561 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351407c3-30ae-4f12-bada-b1cde2ee891b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:41.622957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351407c3-30ae-4f12-bada-b1cde2ee891b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:41.623230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351407c3-30ae-4f12-bada-b1cde2ee891b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:41.629019 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419d169-156e-44ad-b76e-6852e05a72b9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:41.633378 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351407c3-30ae-4f12-bada-b1cde2ee891b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:41.634820 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351407c3-30ae-4f12-bada-b1cde2ee891b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:41.653408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-351407c3-30ae-4f12-bada-b1cde2ee891b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:41.653408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:41.653408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:41.653408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:41.653408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:41.653408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:41.653408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:41.653408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:41.653408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:41.653408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:41.653408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:41.653408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:41.653408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:41.653408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:41.653408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:41.654544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:41.654544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:41.654544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:41.654544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:41.654544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:41.654544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:41.654544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:41.654544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:41.654544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:41.654544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:41.654544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:41.654544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:41.654544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:41.654544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:41.654544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:41.654544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:41.654544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:41.655427 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:41.655427 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:41.655427 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:41.655427 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:41.655427 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 282/562] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:41.655427 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351407c3-30ae-4f12-bada-b1cde2ee891b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:41.671386 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e7c16-151c-4127-8a28-2d1ada8c242a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:41.672038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e7c16-151c-4127-8a28-2d1ada8c242a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:41.672474 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e7c16-151c-4127-8a28-2d1ada8c242a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:41.672782 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e7c16-151c-4127-8a28-2d1ada8c242a None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:41.673488 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e7c16-151c-4127-8a28-2d1ada8c242a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:41.673795 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e7c16-151c-4127-8a28-2d1ada8c242a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:41.675255 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e7c16-151c-4127-8a28-2d1ada8c242a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:41.692333 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 281/563] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:41.692333 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e7c16-151c-4127-8a28-2d1ada8c242a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:41.706389 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:41.763825 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:41.767720 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351407c3-30ae-4f12-bada-b1cde2ee891b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:41.799049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e7c16-151c-4127-8a28-2d1ada8c242a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:41.801311 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf2817-6f1a-4ac0-839a-2b91da5dc1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:41.802092 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf2817-6f1a-4ac0-839a-2b91da5dc1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:41.802371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf2817-6f1a-4ac0-839a-2b91da5dc1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:41.802642 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf2817-6f1a-4ac0-839a-2b91da5dc1a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:41.812468 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf2817-6f1a-4ac0-839a-2b91da5dc1a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:41.820063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-4baf2817-6f1a-4ac0-839a-2b91da5dc1a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:41.820063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:41.820063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:41.820063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:41.820063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:41.820063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:41.820063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:41.820063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:41.820063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:41.820063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:41.820063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:41.820063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:41.820063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:41.820063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:41.820063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:41.820063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:41.821203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:41.821203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:41.821203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:41.821203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:41.821203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:41.821203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:41.821203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:41.821203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:41.821203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:41.821203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:41.821203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:41.821203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:41.821203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:41.821203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:41.821203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:41.821203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:41.822046 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:41.822046 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:41.822046 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:41.822046 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:41.822046 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:41.822046 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:41.822046 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:41.822046 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:41.822046 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:41.822046 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:41.822046 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:41.822046 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:41.822046 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 283/564] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 30 10:27:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:41.822712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf2817-6f1a-4ac0-839a-2b91da5dc1a0 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:41.836625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3408c8-e40f-4bca-8a61-39d4544ccbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:41.837411 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3408c8-e40f-4bca-8a61-39d4544ccbfa None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:41.837695 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3408c8-e40f-4bca-8a61-39d4544ccbfa None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:41.837981 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3408c8-e40f-4bca-8a61-39d4544ccbfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:41.849574 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3408c8-e40f-4bca-8a61-39d4544ccbfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:41.851032 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3408c8-e40f-4bca-8a61-39d4544ccbfa None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:41.868912 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-ee3408c8-e40f-4bca-8a61-39d4544ccbfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:41.868912 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:41.868912 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:41.868912 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:41.868912 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:41.868912 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:41.868912 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:41.868912 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:41.868912 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:41.868912 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:41.868912 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:41.868912 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:41.868912 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:41.868912 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:41.868912 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:41.869816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:41.869816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:41.869816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:41.869816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:41.869816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:41.869816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:41.869816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:41.869816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:41.869816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:41.869816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:41.869816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:41.869816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:41.869816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:41.869816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:41.869816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:41.869816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:41.869816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:41.870719 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:41.870719 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:41.870719 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:41.870719 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:41.870719 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 282/565] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:41.870986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3408c8-e40f-4bca-8a61-39d4544ccbfa None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:41.936497 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf2817-6f1a-4ac0-839a-2b91da5dc1a0 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:41.939404 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:41.969993 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1884eb-f68c-47bb-a036-a6016a274bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:41.970579 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1884eb-f68c-47bb-a036-a6016a274bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:41.970859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1884eb-f68c-47bb-a036-a6016a274bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:41.971136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1884eb-f68c-47bb-a036-a6016a274bc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:41.971841 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1884eb-f68c-47bb-a036-a6016a274bc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:41.972156 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1884eb-f68c-47bb-a036-a6016a274bc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:41.973558 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1884eb-f68c-47bb-a036-a6016a274bc9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:41.979450 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3408c8-e40f-4bca-8a61-39d4544ccbfa None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:41.985332 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 284/566] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:41.986649 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024834c-3ec9-4d66-88cf-effb8e419949 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:41.986941 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024834c-3ec9-4d66-88cf-effb8e419949 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:41.987218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024834c-3ec9-4d66-88cf-effb8e419949 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:41.988620 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 285/567] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:41.993340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024834c-3ec9-4d66-88cf-effb8e419949 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:42.013165 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:42.014000 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b782a3-5edd-44a2-a1e8-76a7c84b881f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:42.014854 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b782a3-5edd-44a2-a1e8-76a7c84b881f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:42.015164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b782a3-5edd-44a2-a1e8-76a7c84b881f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:42.015436 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b782a3-5edd-44a2-a1e8-76a7c84b881f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:42.022872 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b782a3-5edd-44a2-a1e8-76a7c84b881f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:42.024355 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b782a3-5edd-44a2-a1e8-76a7c84b881f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:42.039840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-b4b782a3-5edd-44a2-a1e8-76a7c84b881f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:42.039840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:42.039840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:42.039840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:42.039840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:42.039840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:42.039840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:42.039840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:42.039840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:42.039840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:42.039840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:42.039840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:42.039840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:27:42.039840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:27:42.039840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:27:42.040767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:27:42.040767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:42.040767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:42.040767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:42.040767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:42.040767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:42.040767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:42.040767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:42.040767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:42.040767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:42.040767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:42.040767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:42.040767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:42.040767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:42.040767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:42.040767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:42.040767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:42.041676 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:27:42.041676 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:27:42.041676 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:27:42.041676 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:27:42.041676 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:27:42.041676 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:27:42.041676 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:42.041676 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:42.041676 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 283/568] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:27:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:42.042393 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b782a3-5edd-44a2-a1e8-76a7c84b881f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:42.101831 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024834c-3ec9-4d66-88cf-effb8e419949 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:42.134429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888bb07-82f2-4c8d-9c98-d6b636278202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:42.135090 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888bb07-82f2-4c8d-9c98-d6b636278202 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:42.135378 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888bb07-82f2-4c8d-9c98-d6b636278202 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:42.135650 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888bb07-82f2-4c8d-9c98-d6b636278202 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:42.136380 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888bb07-82f2-4c8d-9c98-d6b636278202 None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:42.137229 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888bb07-82f2-4c8d-9c98-d6b636278202 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:42.138594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888bb07-82f2-4c8d-9c98-d6b636278202 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:42.141715 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b782a3-5edd-44a2-a1e8-76a7c84b881f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:42.146354 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 286/569] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 30 10:27:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:42.147144 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888bb07-82f2-4c8d-9c98-d6b636278202 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:42.167797 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:42.179822 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde7183-dfd9-4b37-834f-e83527d79e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:42.180481 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde7183-dfd9-4b37-834f-e83527d79e76 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:42.180799 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde7183-dfd9-4b37-834f-e83527d79e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:42.181078 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde7183-dfd9-4b37-834f-e83527d79e76 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:42.181804 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde7183-dfd9-4b37-834f-e83527d79e76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:42.182115 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde7183-dfd9-4b37-834f-e83527d79e76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:42.183505 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde7183-dfd9-4b37-834f-e83527d79e76 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:42.194674 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 284/570] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:42.195986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebfc98-0b91-4514-951d-d57664c2a4f7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:42.196276 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebfc98-0b91-4514-951d-d57664c2a4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:42.196674 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebfc98-0b91-4514-951d-d57664c2a4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:42.212790 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-cfebfc98-0b91-4514-951d-d57664c2a4f7 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:42.213955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cfebfc98-0b91-4514-951d-d57664c2a4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:42.227684 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:42.246456 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888bb07-82f2-4c8d-9c98-d6b636278202 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:42.283784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a468a2-cd83-45ca-8ab2-860329ffefed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:42.284613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a468a2-cd83-45ca-8ab2-860329ffefed None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:42.284852 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 285/571] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:42.284961 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a468a2-cd83-45ca-8ab2-860329ffefed None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:42.285161 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a468a2-cd83-45ca-8ab2-860329ffefed None admin] PATH_INFO: `/v3/users/glance` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:42.285695 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebfc98-0b91-4514-951d-d57664c2a4f7 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:42.293552 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a468a2-cd83-45ca-8ab2-860329ffefed None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:42.295159 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a468a2-cd83-45ca-8ab2-860329ffefed None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:42.310039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-91a468a2-cd83-45ca-8ab2-860329ffefed None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 30 10:27:42.310039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:42.310039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:42.310039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:42.310039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:42.310039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:42.310039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:42.310039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:42.310039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:42.310039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:42.310039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:42.310039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:42.310039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:27:42.310039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:27:42.310039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:27:42.310039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:27:42.311021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:42.311021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:42.311021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:27:42.311021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:42.311021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:27:42.311021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:42.311021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:42.311021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:42.311021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:42.311021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:42.311021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:42.311021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:42.311021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:42.311021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:42.311021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:42.311021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:42.311021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:42.311021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:42.311962 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:42.311962 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:42.311962 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:27:42.311962 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:27:42.311962 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:27:42.311962 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:27:42.311962 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:27:42.311962 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:27:42.311962 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 30 10:27:42.311962 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:42.311962 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 287/572] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:42.311962 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a468a2-cd83-45ca-8ab2-860329ffefed None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:42.392532 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebfc98-0b91-4514-951d-d57664c2a4f7 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:42.405441 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:42.420695 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a468a2-cd83-45ca-8ab2-860329ffefed None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:42.426789 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707f345-f213-4ca7-b7ca-dc896094f969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:42.427443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707f345-f213-4ca7-b7ca-dc896094f969 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:42.427730 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707f345-f213-4ca7-b7ca-dc896094f969 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:42.428006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707f345-f213-4ca7-b7ca-dc896094f969 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:42.428817 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707f345-f213-4ca7-b7ca-dc896094f969 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:42.429130 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707f345-f213-4ca7-b7ca-dc896094f969 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:42.430559 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707f345-f213-4ca7-b7ca-dc896094f969 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:42.442763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 286/573] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:27:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:42.443551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707f345-f213-4ca7-b7ca-dc896094f969 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:42.459109 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665eaab-c460-419d-a14d-e0f51b15b243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:42.459893 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665eaab-c460-419d-a14d-e0f51b15b243 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:42.460176 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665eaab-c460-419d-a14d-e0f51b15b243 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:42.460577 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665eaab-c460-419d-a14d-e0f51b15b243 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:42.469710 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:42.471602 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665eaab-c460-419d-a14d-e0f51b15b243 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:42.473127 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665eaab-c460-419d-a14d-e0f51b15b243 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:42.492207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-a665eaab-c460-419d-a14d-e0f51b15b243 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:42.492207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:42.492207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:42.492207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:42.492207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:42.492207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:42.492207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:42.492207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:42.492207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:42.492207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:42.492207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:42.492207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:42.492207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:42.492207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:42.492207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:42.493295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:42.493295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:42.493295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:42.493295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:42.493295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:42.493295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:42.493295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:42.493295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:42.493295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:42.493295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:42.493295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:42.493295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:42.493295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:42.493295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:42.493295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:42.493295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:42.493295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:42.494354 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:42.494354 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:42.494354 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:42.494354 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:42.494354 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 288/574] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:42.494354 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665eaab-c460-419d-a14d-e0f51b15b243 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:42.552582 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707f345-f213-4ca7-b7ca-dc896094f969 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:42.585909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a76ec-2e92-44a0-8ed7-3a272c6aeecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:42.586680 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a76ec-2e92-44a0-8ed7-3a272c6aeecc None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:42.586959 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a76ec-2e92-44a0-8ed7-3a272c6aeecc None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:42.587239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a76ec-2e92-44a0-8ed7-3a272c6aeecc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:42.595083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a76ec-2e92-44a0-8ed7-3a272c6aeecc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:42.596549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a76ec-2e92-44a0-8ed7-3a272c6aeecc None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:42.599411 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665eaab-c460-419d-a14d-e0f51b15b243 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:42.611230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-bb4a76ec-2e92-44a0-8ed7-3a272c6aeecc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:27:42.611230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:42.611230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:42.611230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:42.611230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:42.611230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:42.611230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:42.611230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:42.611230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:42.611230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:42.611230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:42.611230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:42.611230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:27:42.611230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:27:42.611230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:27:42.611230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:27:42.612239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:42.612239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:42.612239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:27:42.612239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:42.612239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:27:42.612239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:42.612239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:42.612239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:42.612239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:42.612239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:42.612239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:42.612239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:42.612239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:42.612239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:42.612239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:42.612239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:42.612239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:42.612239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:42.613213 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:42.613213 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:42.613213 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:27:42.613213 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:27:42.613213 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:27:42.613213 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:27:42.613213 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:27:42.613213 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:27:42.613213 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:27:42.613213 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:42.613213 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 287/575] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Jun 30 10:27:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:42.613786 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a76ec-2e92-44a0-8ed7-3a272c6aeecc None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:42.639895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd8d6b-631a-4a6a-95d8-7db75dd0d81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:42.640723 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd8d6b-631a-4a6a-95d8-7db75dd0d81d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:42.641033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd8d6b-631a-4a6a-95d8-7db75dd0d81d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:42.641333 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd8d6b-631a-4a6a-95d8-7db75dd0d81d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:42.643996 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:42.651858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd8d6b-631a-4a6a-95d8-7db75dd0d81d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:42.659997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-0bfd8d6b-631a-4a6a-95d8-7db75dd0d81d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:42.659997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:42.659997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:42.659997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:42.659997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:42.659997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:42.659997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:42.659997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:42.659997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:42.659997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:42.659997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:42.659997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:42.659997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:42.659997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:42.659997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:42.659997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:42.660956 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:42.660956 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:42.660956 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:42.660956 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:42.660956 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:42.660956 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:42.660956 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:42.660956 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:42.660956 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:42.660956 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:42.660956 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:42.660956 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:42.660956 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:42.660956 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:42.660956 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:42.660956 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:42.661780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:42.661780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:42.661780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:42.661780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:42.661780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:42.661780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:42.661780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:42.661780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:42.661780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:42.661780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:42.661780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:42.661780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:42.661780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 289/576] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 30 10:27:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:42.662464 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd8d6b-631a-4a6a-95d8-7db75dd0d81d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:42.715584 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a76ec-2e92-44a0-8ed7-3a272c6aeecc None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:42.719070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:42.749163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537e40f-3106-4e09-bccf-60c6f9cf1d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:42.749740 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537e40f-3106-4e09-bccf-60c6f9cf1d4d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:42.750020 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537e40f-3106-4e09-bccf-60c6f9cf1d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:42.750289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537e40f-3106-4e09-bccf-60c6f9cf1d4d None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:42.751113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537e40f-3106-4e09-bccf-60c6f9cf1d4d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:42.751418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537e40f-3106-4e09-bccf-60c6f9cf1d4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:42.752866 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537e40f-3106-4e09-bccf-60c6f9cf1d4d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:42.766969 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd8d6b-631a-4a6a-95d8-7db75dd0d81d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:42.770670 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 288/577] 10.222.0.59 () {56 vars in 1137 bytes} [Thu Jun 30 10:27:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:42.771464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537e40f-3106-4e09-bccf-60c6f9cf1d4d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:42.802036 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb360faa-411f-4309-aac8-a03e6d2d661c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:42.802681 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb360faa-411f-4309-aac8-a03e6d2d661c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:42.802966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb360faa-411f-4309-aac8-a03e6d2d661c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:42.803237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb360faa-411f-4309-aac8-a03e6d2d661c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:42.804052 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb360faa-411f-4309-aac8-a03e6d2d661c None admin] RBAC: Adding query filter params (role.id=1c667697d38a434fbb99c61bc846c4a5, scope.project.id=423854cc8f524ecb8d740d1cb0053856, user.id=c15327c36c8c49ac87a3b3e9ab49eea7) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:42.804361 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb360faa-411f-4309-aac8-a03e6d2d661c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:42.805813 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb360faa-411f-4309-aac8-a03e6d2d661c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:42.811168 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 290/578] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:27:42 2022] GET /identity/v3/role_assignments?user.id=c15327c36c8c49ac87a3b3e9ab49eea7&scope.project.id=423854cc8f524ecb8d740d1cb0053856&role.id=1c667697d38a434fbb99c61bc846c4a5 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:42.811936 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb360faa-411f-4309-aac8-a03e6d2d661c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:42.867477 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:42.878582 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537e40f-3106-4e09-bccf-60c6f9cf1d4d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:42.919095 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9036d09-4de1-4459-a3e5-36fd5b74425f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:42.919770 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9036d09-4de1-4459-a3e5-36fd5b74425f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:42.920050 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9036d09-4de1-4459-a3e5-36fd5b74425f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:42.920329 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9036d09-4de1-4459-a3e5-36fd5b74425f None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:42.921097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9036d09-4de1-4459-a3e5-36fd5b74425f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:42.921393 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9036d09-4de1-4459-a3e5-36fd5b74425f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:42.922803 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9036d09-4de1-4459-a3e5-36fd5b74425f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:42.940264 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 289/579] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:42.941655 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9036d09-4de1-4459-a3e5-36fd5b74425f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:42.950117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb360faa-411f-4309-aac8-a03e6d2d661c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:42.968733 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:42.993679 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6eefd-e284-4430-b06e-85bba2f61547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:42.994468 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6eefd-e284-4430-b06e-85bba2f61547 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:42.994764 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6eefd-e284-4430-b06e-85bba2f61547 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:42.995367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6eefd-e284-4430-b06e-85bba2f61547 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:42.996299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6eefd-e284-4430-b06e-85bba2f61547 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:42.996655 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6eefd-e284-4430-b06e-85bba2f61547 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:42.998093 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6eefd-e284-4430-b06e-85bba2f61547 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:43.018480 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 291/580] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Jun 30 10:27:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:43.019305 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6eefd-e284-4430-b06e-85bba2f61547 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:43.063226 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9036d09-4de1-4459-a3e5-36fd5b74425f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:43.098468 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2d9c0-d96d-419e-8a07-7ddce5e5ed97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:43.099385 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2d9c0-d96d-419e-8a07-7ddce5e5ed97 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:43.099667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2d9c0-d96d-419e-8a07-7ddce5e5ed97 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:43.099960 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2d9c0-d96d-419e-8a07-7ddce5e5ed97 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:43.101343 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2d9c0-d96d-419e-8a07-7ddce5e5ed97 None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:43.101343 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2d9c0-d96d-419e-8a07-7ddce5e5ed97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:43.102389 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2d9c0-d96d-419e-8a07-7ddce5e5ed97 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:43.111215 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 290/581] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 30 10:27:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:43.111860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2d9c0-d96d-419e-8a07-7ddce5e5ed97 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:43.127678 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:43.138698 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6eefd-e284-4430-b06e-85bba2f61547 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:43.174159 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dc54b-d0d6-418b-b50c-61e324ca3799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:43.175292 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dc54b-d0d6-418b-b50c-61e324ca3799 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:43.175292 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dc54b-d0d6-418b-b50c-61e324ca3799 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:43.175520 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dc54b-d0d6-418b-b50c-61e324ca3799 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:43.186400 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357dc54b-d0d6-418b-b50c-61e324ca3799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:43.187842 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357dc54b-d0d6-418b-b50c-61e324ca3799 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:43.206350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-357dc54b-d0d6-418b-b50c-61e324ca3799 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:43.206350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:43.206350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:43.206350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:43.206350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:43.206350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:43.206350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:43.206350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:43.206350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:43.206350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:43.206350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:43.206350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:43.206350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:43.206350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:43.206350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:43.207540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:43.207540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:43.207540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:43.207540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:43.207540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:43.207540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:43.207540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:43.207540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:43.207540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:43.207540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:43.207540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:43.207540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:43.207540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:43.207540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:43.207540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:43.207540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:43.207540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:43.208456 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:43.208456 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:43.208456 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:43.208456 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:43.208456 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 292/582] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:43.208761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dc54b-d0d6-418b-b50c-61e324ca3799 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:43.235934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2d9c0-d96d-419e-8a07-7ddce5e5ed97 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:43.237316 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:43.283119 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299f1f2-bdb3-4fba-bf43-c0d13de57f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:43.283952 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299f1f2-bdb3-4fba-bf43-c0d13de57f17 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:43.284307 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299f1f2-bdb3-4fba-bf43-c0d13de57f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:43.284691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299f1f2-bdb3-4fba-bf43-c0d13de57f17 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:43.293250 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299f1f2-bdb3-4fba-bf43-c0d13de57f17 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:43.294823 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299f1f2-bdb3-4fba-bf43-c0d13de57f17 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:43.309745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-a299f1f2-bdb3-4fba-bf43-c0d13de57f17 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 10:27:43.309745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:43.309745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:43.309745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:43.309745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:43.309745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:43.309745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:43.309745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:43.309745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:43.309745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:43.309745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:43.309745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:43.309745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:27:43.309745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:27:43.309745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:27:43.309745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:27:43.310742 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:43.310742 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:43.310742 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:27:43.310742 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:43.310742 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:27:43.310742 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:43.310742 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:43.310742 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:43.310742 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:43.310742 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:43.310742 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:43.310742 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:43.310742 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:43.310742 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:43.310742 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:43.310742 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:43.310742 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:43.310742 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:43.311674 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:43.311674 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:43.311674 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:27:43.311674 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:27:43.311674 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:27:43.311674 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:27:43.311674 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:27:43.311674 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:27:43.311674 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 10:27:43.311674 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:43.315699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 291/583] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:43.316421 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299f1f2-bdb3-4fba-bf43-c0d13de57f17 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:43.331011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dc54b-d0d6-418b-b50c-61e324ca3799 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:43.376458 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df167ab4-a6a2-46ec-9051-56096da98651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:43.377422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df167ab4-a6a2-46ec-9051-56096da98651 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:43.377718 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df167ab4-a6a2-46ec-9051-56096da98651 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:43.377999 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df167ab4-a6a2-46ec-9051-56096da98651 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:43.388832 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df167ab4-a6a2-46ec-9051-56096da98651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:43.390279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df167ab4-a6a2-46ec-9051-56096da98651 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:43.394283 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:43.408730 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-df167ab4-a6a2-46ec-9051-56096da98651 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:43.408730 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:43.408730 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:43.408730 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:43.408730 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:43.408730 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:43.408730 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:43.408730 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:43.408730 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:43.408730 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:43.408730 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:43.408730 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:43.408730 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:43.408730 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:43.408730 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:43.409651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:43.409651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:43.409651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:43.409651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:43.409651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:43.409651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:43.409651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:43.409651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:43.409651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:43.409651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:43.409651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:43.409651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:43.409651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:43.409651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:43.409651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:43.409651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:43.409651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:43.410548 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:43.410548 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:43.410548 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:43.410548 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:43.410548 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 293/584] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:43.411358 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df167ab4-a6a2-46ec-9051-56096da98651 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:43.433075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299f1f2-bdb3-4fba-bf43-c0d13de57f17 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:43.468599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91165767-0f20-4cdd-8b9e-71d92e689644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:43.469383 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91165767-0f20-4cdd-8b9e-71d92e689644 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:43.469671 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91165767-0f20-4cdd-8b9e-71d92e689644 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:43.469940 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91165767-0f20-4cdd-8b9e-71d92e689644 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:43.481863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91165767-0f20-4cdd-8b9e-71d92e689644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:43.483328 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91165767-0f20-4cdd-8b9e-71d92e689644 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:43.494086 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:43.504531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-91165767-0f20-4cdd-8b9e-71d92e689644 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:43.504531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:43.504531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:43.504531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:43.504531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:43.504531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:43.504531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:43.504531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:43.504531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:43.504531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:43.504531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:43.504531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:43.504531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:43.504531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:43.504531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:43.505402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:43.505402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:43.505402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:43.505402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:43.505402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:43.505402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:43.505402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:43.505402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:43.505402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:43.505402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:43.505402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:43.505402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:43.505402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:43.505402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:43.505402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:43.505402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:43.505402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:43.506304 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:43.506304 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:43.506304 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:43.506304 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:43.506304 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 292/585] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:43.506583 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91165767-0f20-4cdd-8b9e-71d92e689644 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:43.523342 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df167ab4-a6a2-46ec-9051-56096da98651 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:43.560028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc2d16-4eea-422a-94e5-59e68dc265e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:43.560644 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc2d16-4eea-422a-94e5-59e68dc265e0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:43.560933 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc2d16-4eea-422a-94e5-59e68dc265e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:43.561205 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc2d16-4eea-422a-94e5-59e68dc265e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:43.561912 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc2d16-4eea-422a-94e5-59e68dc265e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:43.562216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc2d16-4eea-422a-94e5-59e68dc265e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:43.563568 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc2d16-4eea-422a-94e5-59e68dc265e0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:43.575766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 294/586] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:43.576393 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc2d16-4eea-422a-94e5-59e68dc265e0 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:43.620002 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91165767-0f20-4cdd-8b9e-71d92e689644 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:43.649501 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:43.661775 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e0019-a142-49c6-af54-645c251b253c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:43.662683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e0019-a142-49c6-af54-645c251b253c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:43.662968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e0019-a142-49c6-af54-645c251b253c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:43.663243 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e0019-a142-49c6-af54-645c251b253c None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:43.664193 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e0019-a142-49c6-af54-645c251b253c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:43.664857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e0019-a142-49c6-af54-645c251b253c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:43.666081 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e0019-a142-49c6-af54-645c251b253c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:43.682879 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc2d16-4eea-422a-94e5-59e68dc265e0 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:43.686119 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 293/587] 10.222.0.59 () {56 vars in 1137 bytes} [Thu Jun 30 10:27:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:43.686904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e0019-a142-49c6-af54-645c251b253c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:43.721711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be094b93-50bd-4d13-b1af-c2c18c5354cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:43.722378 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be094b93-50bd-4d13-b1af-c2c18c5354cd None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:43.722662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be094b93-50bd-4d13-b1af-c2c18c5354cd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:43.722943 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be094b93-50bd-4d13-b1af-c2c18c5354cd None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:43.723903 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be094b93-50bd-4d13-b1af-c2c18c5354cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:43.724223 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be094b93-50bd-4d13-b1af-c2c18c5354cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:43.725608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be094b93-50bd-4d13-b1af-c2c18c5354cd None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:43.733815 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:43.743770 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 295/588] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:43.744590 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be094b93-50bd-4d13-b1af-c2c18c5354cd None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:43.792793 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e0019-a142-49c6-af54-645c251b253c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:43.827782 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24ef08-d914-4506-8a7a-8d3f9a9208c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:43.828380 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24ef08-d914-4506-8a7a-8d3f9a9208c8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:43.828696 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24ef08-d914-4506-8a7a-8d3f9a9208c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:43.828977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24ef08-d914-4506-8a7a-8d3f9a9208c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:43.829733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24ef08-d914-4506-8a7a-8d3f9a9208c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:43.830044 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24ef08-d914-4506-8a7a-8d3f9a9208c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:43.831539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24ef08-d914-4506-8a7a-8d3f9a9208c8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:43.843747 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 294/589] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:43.844579 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24ef08-d914-4506-8a7a-8d3f9a9208c8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:43.861164 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be094b93-50bd-4d13-b1af-c2c18c5354cd None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:43.897845 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e7c91-d112-42ac-9a62-96c6cc3e3536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:43.899083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e7c91-d112-42ac-9a62-96c6cc3e3536 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:43.899460 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e7c91-d112-42ac-9a62-96c6cc3e3536 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:43.899798 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e7c91-d112-42ac-9a62-96c6cc3e3536 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:43.900739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:43.908528 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e7c91-d112-42ac-9a62-96c6cc3e3536 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:43.909977 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e7c91-d112-42ac-9a62-96c6cc3e3536 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:43.925606 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-9a9e7c91-d112-42ac-9a62-96c6cc3e3536 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:43.925606 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:43.925606 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:43.925606 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:43.925606 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:43.925606 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:43.925606 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:43.925606 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:43.925606 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:43.925606 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:43.925606 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:43.925606 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:43.925606 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:27:43.925606 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:27:43.925606 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:27:43.926570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:27:43.926570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:43.926570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:43.926570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:43.926570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:43.926570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:43.926570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:43.926570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:43.926570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:43.926570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:43.926570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:43.926570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:43.926570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:43.926570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:43.926570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:43.926570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:43.926570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:43.927466 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:27:43.927466 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:27:43.927466 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:27:43.927466 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:27:43.927466 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:27:43.927466 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:27:43.927466 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:43.927466 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:43.927466 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 296/590] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:27:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:43.928532 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e7c91-d112-42ac-9a62-96c6cc3e3536 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:43.967808 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24ef08-d914-4506-8a7a-8d3f9a9208c8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:43.988980 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:44.003167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f029b-73fa-4226-8735-fcae033e7f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:44.004117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f029b-73fa-4226-8735-fcae033e7f3f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:44.004387 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f029b-73fa-4226-8735-fcae033e7f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:44.004738 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f029b-73fa-4226-8735-fcae033e7f3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:44.015302 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f029b-73fa-4226-8735-fcae033e7f3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:44.016820 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f029b-73fa-4226-8735-fcae033e7f3f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:44.034489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-ab3f029b-73fa-4226-8735-fcae033e7f3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:44.034489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:44.034489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:44.034489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:44.034489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:44.034489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:44.034489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:44.034489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:44.034489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:44.034489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:44.034489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:44.034489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:44.034489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:44.034489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:44.034489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:44.035371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:44.035371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:44.035371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:44.035371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:44.035371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:44.035371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:44.035371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:44.035371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:44.035371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:44.035371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:44.035371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:44.035371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:44.035371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:44.035371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:44.035371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:44.035371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:44.035371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:44.036283 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:44.036283 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:44.036283 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:44.036283 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:44.036532 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e7c91-d112-42ac-9a62-96c6cc3e3536 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:44.036944 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 295/591] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:44.037547 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f029b-73fa-4226-8735-fcae033e7f3f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:44.075000 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65f5c9-4760-42a5-b8a9-618d3f3edaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:44.075179 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65f5c9-4760-42a5-b8a9-618d3f3edaeb None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:44.075422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65f5c9-4760-42a5-b8a9-618d3f3edaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:44.075697 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65f5c9-4760-42a5-b8a9-618d3f3edaeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:44.082371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65f5c9-4760-42a5-b8a9-618d3f3edaeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:44.083745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65f5c9-4760-42a5-b8a9-618d3f3edaeb None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:44.098262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-4e65f5c9-4760-42a5-b8a9-618d3f3edaeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:44.098262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:44.098262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:44.098262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:44.098262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:44.098262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:44.098262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:44.098262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:44.098262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:44.098262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:44.098262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:44.098262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:44.098262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:27:44.098262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:27:44.098262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:27:44.099396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:27:44.099396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:44.099396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:44.099396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:44.099396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:44.099396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:44.099396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:44.099396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:44.099396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:44.099396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:44.099396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:44.099396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:44.099396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:44.099396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:44.099396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:44.099396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:44.099396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:44.100264 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:27:44.100264 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:27:44.100264 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:27:44.100264 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:27:44.100264 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:27:44.100264 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:27:44.100264 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:44.100264 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:44.100264 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 297/592] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:27:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:44.100769 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65f5c9-4760-42a5-b8a9-618d3f3edaeb None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:44.142348 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:44.150888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f029b-73fa-4226-8735-fcae033e7f3f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:44.185603 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ac78d-497d-49fb-b5cc-7057b45d89f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:44.186577 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ac78d-497d-49fb-b5cc-7057b45d89f4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:44.186688 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ac78d-497d-49fb-b5cc-7057b45d89f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:44.186933 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ac78d-497d-49fb-b5cc-7057b45d89f4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:44.194809 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ac78d-497d-49fb-b5cc-7057b45d89f4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:44.196874 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ac78d-497d-49fb-b5cc-7057b45d89f4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:44.205158 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65f5c9-4760-42a5-b8a9-618d3f3edaeb None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:44.211326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-692ac78d-497d-49fb-b5cc-7057b45d89f4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 10:27:44.211326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:44.211326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:44.211326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:44.211326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:44.211326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:44.211326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:44.211326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:44.211326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:44.211326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:44.211326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:44.211326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:44.211326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:27:44.211326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:27:44.211326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:27:44.211326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:27:44.212236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:44.212236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:44.212236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:27:44.212236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:44.212236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:27:44.212236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:44.212236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:44.212236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:44.212236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:44.212236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:44.212236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:44.212236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:44.212236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:44.212236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:44.212236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:44.212236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:44.212236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:44.212236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:44.213199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:44.213199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:44.213199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:27:44.213199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:27:44.213199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:27:44.213199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:27:44.213199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:27:44.213199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:27:44.213199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 10:27:44.213199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:44.213199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 296/593] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 30 10:27:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:44.213799 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ac78d-497d-49fb-b5cc-7057b45d89f4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:44.228898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:44.247538 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13cb4d-e267-41f1-a4ae-13f9897c3370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:44.248239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13cb4d-e267-41f1-a4ae-13f9897c3370 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:44.248474 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13cb4d-e267-41f1-a4ae-13f9897c3370 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:44.248775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13cb4d-e267-41f1-a4ae-13f9897c3370 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:44.249548 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13cb4d-e267-41f1-a4ae-13f9897c3370 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:44.249858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13cb4d-e267-41f1-a4ae-13f9897c3370 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:44.251298 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13cb4d-e267-41f1-a4ae-13f9897c3370 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:44.267955 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 298/594] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:27:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:44.268858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13cb4d-e267-41f1-a4ae-13f9897c3370 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:44.327554 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ac78d-497d-49fb-b5cc-7057b45d89f4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:44.364417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d4123-3924-415c-a45d-293cc87ccff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:44.365340 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d4123-3924-415c-a45d-293cc87ccff8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:44.365772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d4123-3924-415c-a45d-293cc87ccff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:44.366253 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d4123-3924-415c-a45d-293cc87ccff8 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:44.367214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d4123-3924-415c-a45d-293cc87ccff8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:44.367683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d4123-3924-415c-a45d-293cc87ccff8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:44.369348 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d4123-3924-415c-a45d-293cc87ccff8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:44.372957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13cb4d-e267-41f1-a4ae-13f9897c3370 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:44.384179 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 297/595] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:44.385030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d4123-3924-415c-a45d-293cc87ccff8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:44.403441 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:44.413596 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d297d7-2d53-4d84-bea1-c37daa2021d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:44.414254 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d297d7-2d53-4d84-bea1-c37daa2021d6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:44.414538 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d297d7-2d53-4d84-bea1-c37daa2021d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:44.414812 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d297d7-2d53-4d84-bea1-c37daa2021d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:44.415581 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d297d7-2d53-4d84-bea1-c37daa2021d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:44.415892 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d297d7-2d53-4d84-bea1-c37daa2021d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:44.417363 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d297d7-2d53-4d84-bea1-c37daa2021d6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:44.429913 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 299/596] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:27:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:44.430698 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d297d7-2d53-4d84-bea1-c37daa2021d6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:44.473590 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:44.498730 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d4123-3924-415c-a45d-293cc87ccff8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:44.533850 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb01efb-5c66-4572-bb18-2d3f6c27eed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:44.534623 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb01efb-5c66-4572-bb18-2d3f6c27eed4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:44.534910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb01efb-5c66-4572-bb18-2d3f6c27eed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:44.535198 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb01efb-5c66-4572-bb18-2d3f6c27eed4 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:44.536087 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb01efb-5c66-4572-bb18-2d3f6c27eed4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:44.536450 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb01efb-5c66-4572-bb18-2d3f6c27eed4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:44.537917 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb01efb-5c66-4572-bb18-2d3f6c27eed4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:44.538135 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d297d7-2d53-4d84-bea1-c37daa2021d6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:44.555772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 298/597] 10.222.0.59 () {56 vars in 1139 bytes} [Thu Jun 30 10:27:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:44.557380 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb01efb-5c66-4572-bb18-2d3f6c27eed4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:44.574223 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187965d5-2e93-4095-87e9-a474cda481c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:44.575114 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187965d5-2e93-4095-87e9-a474cda481c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:44.575392 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187965d5-2e93-4095-87e9-a474cda481c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:44.575976 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187965d5-2e93-4095-87e9-a474cda481c7 None admin] PATH_INFO: `/v3/projects/423854cc8f524ecb8d740d1cb0053856/users/2522b8560d224aa1a973207a79ce6a99/roles/1c667697d38a434fbb99c61bc846c4a5` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:44.591486 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187965d5-2e93-4095-87e9-a474cda481c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=423854cc8f524ecb8d740d1cb0053856, user_id=2522b8560d224aa1a973207a79ce6a99, role_id=1c667697d38a434fbb99c61bc846c4a5)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:44.592993 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187965d5-2e93-4095-87e9-a474cda481c7 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:44.616632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 300/598] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 30 10:27:44 2022] PUT /identity/v3/projects/423854cc8f524ecb8d740d1cb0053856/users/2522b8560d224aa1a973207a79ce6a99/roles/1c667697d38a434fbb99c61bc846c4a5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:27:44.616632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187965d5-2e93-4095-87e9-a474cda481c7 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:44.655852 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:44.700220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb01efb-5c66-4572-bb18-2d3f6c27eed4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:44.719529 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:44.738384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187965d5-2e93-4095-87e9-a474cda481c7 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:44.750805 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe6601-db11-4b54-a44b-90d65f984bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:44.751910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe6601-db11-4b54-a44b-90d65f984bcf None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:44.752338 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe6601-db11-4b54-a44b-90d65f984bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:44.752789 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe6601-db11-4b54-a44b-90d65f984bcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:44.761366 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe6601-db11-4b54-a44b-90d65f984bcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:44.763233 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe6601-db11-4b54-a44b-90d65f984bcf None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:44.776604 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c402a-ce5e-4305-9434-e033144cd282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:44.778213 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c402a-ce5e-4305-9434-e033144cd282 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:44.778612 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c402a-ce5e-4305-9434-e033144cd282 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:44.778957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c402a-ce5e-4305-9434-e033144cd282 None admin] PATH_INFO: `/v3/projects/423854cc8f524ecb8d740d1cb0053856/users/1bfd036d747241d9bc314b60bf8648b6/roles/1c667697d38a434fbb99c61bc846c4a5` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:44.782309 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-92fe6601-db11-4b54-a44b-90d65f984bcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:44.782309 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:44.782309 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:44.782309 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:44.782309 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:44.782309 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:44.782309 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:44.782309 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:44.782309 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:44.782309 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:44.782309 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:44.782309 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:44.782309 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:27:44.782309 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:27:44.782309 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:27:44.783214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:27:44.783214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:44.783214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:44.783214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:44.783214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:44.783214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:44.783214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:44.783214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:44.783214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:44.783214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:44.783214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:44.783214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:44.783214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:44.783214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:44.783214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:44.783214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:44.783214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:44.784089 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:27:44.784089 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:27:44.784089 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:27:44.784089 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:27:44.784089 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:27:44.784089 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:27:44.784089 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:44.784089 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:44.787260 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 299/599] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:27:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:44.788225 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe6601-db11-4b54-a44b-90d65f984bcf None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:44.797103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c402a-ce5e-4305-9434-e033144cd282 None admin] RBAC: Authorizing `identity:create_grant(project_id=423854cc8f524ecb8d740d1cb0053856, user_id=1bfd036d747241d9bc314b60bf8648b6, role_id=1c667697d38a434fbb99c61bc846c4a5)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:44.798159 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c402a-ce5e-4305-9434-e033144cd282 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:44.816472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 301/600] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 30 10:27:44 2022] PUT /identity/v3/projects/423854cc8f524ecb8d740d1cb0053856/users/1bfd036d747241d9bc314b60bf8648b6/roles/1c667697d38a434fbb99c61bc846c4a5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:27:44.817443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c402a-ce5e-4305-9434-e033144cd282 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:44.935723 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c402a-ce5e-4305-9434-e033144cd282 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:44.951011 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe6601-db11-4b54-a44b-90d65f984bcf None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:44.977994 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ae617-137b-4a96-8a46-1c6b4937c465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:44.978667 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ae617-137b-4a96-8a46-1c6b4937c465 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:44.979015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ae617-137b-4a96-8a46-1c6b4937c465 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:44.979705 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ae617-137b-4a96-8a46-1c6b4937c465 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:44.980096 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ae617-137b-4a96-8a46-1c6b4937c465 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:44.980947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ae617-137b-4a96-8a46-1c6b4937c465 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:44.982407 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ae617-137b-4a96-8a46-1c6b4937c465 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:44.990760 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:44.994278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:44.999762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 302/601] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:27:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:45.001682 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e08605-6999-4e37-aad1-f864047bfe01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:45.002791 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e08605-6999-4e37-aad1-f864047bfe01 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:45.003166 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538508fa-87a7-4885-9b20-b4bda128db71 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:45.003497 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e08605-6999-4e37-aad1-f864047bfe01 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:45.003808 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538508fa-87a7-4885-9b20-b4bda128db71 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:45.004229 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538508fa-87a7-4885-9b20-b4bda128db71 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:45.004523 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e08605-6999-4e37-aad1-f864047bfe01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:45.009637 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 303/602] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:45.009769 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538508fa-87a7-4885-9b20-b4bda128db71 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:45.020817 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e08605-6999-4e37-aad1-f864047bfe01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:45.022895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e08605-6999-4e37-aad1-f864047bfe01 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:45.050672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-f4e08605-6999-4e37-aad1-f864047bfe01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:45.050672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:45.050672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:45.050672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:45.050672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:45.050672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:45.050672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:45.050672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:45.050672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:45.050672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:45.050672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:45.050672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:45.050672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:45.050672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:45.050672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:45.051819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:45.051819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:45.051819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:45.051819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:45.051819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:45.051819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:45.051819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:45.051819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:45.051819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:45.051819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:45.051819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:45.051819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:45.051819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:45.051819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:45.051819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:45.051819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:45.051819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:45.056895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:45.056895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:45.056895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:45.056895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:45.056895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 300/603] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:45.056895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af6714-c223-4fe3-bed9-44bffc7d42ed None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:45.056895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af6714-c223-4fe3-bed9-44bffc7d42ed None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:45.056895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af6714-c223-4fe3-bed9-44bffc7d42ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:45.075672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-69af6714-c223-4fe3-bed9-44bffc7d42ed None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:45.077566 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-69af6714-c223-4fe3-bed9-44bffc7d42ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:45.133251 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538508fa-87a7-4885-9b20-b4bda128db71 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:45.170715 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9a78a-15fc-4da4-9ab8-031d9922b5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:45.171075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 301/604] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:45.171989 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af6714-c223-4fe3-bed9-44bffc7d42ed None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:45.172362 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9a78a-15fc-4da4-9ab8-031d9922b5f2 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:45.172868 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9a78a-15fc-4da4-9ab8-031d9922b5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:45.173288 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9a78a-15fc-4da4-9ab8-031d9922b5f2 None admin] PATH_INFO: `/v3/projects/423854cc8f524ecb8d740d1cb0053856/users/afb7ea0cfb9c423799848b912724cd75/roles/1c667697d38a434fbb99c61bc846c4a5` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:45.192172 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9a78a-15fc-4da4-9ab8-031d9922b5f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=423854cc8f524ecb8d740d1cb0053856, user_id=afb7ea0cfb9c423799848b912724cd75, role_id=1c667697d38a434fbb99c61bc846c4a5)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:45.193862 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9a78a-15fc-4da4-9ab8-031d9922b5f2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:45.208715 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 304/605] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 30 10:27:45 2022] PUT /identity/v3/projects/423854cc8f524ecb8d740d1cb0053856/users/afb7ea0cfb9c423799848b912724cd75/roles/1c667697d38a434fbb99c61bc846c4a5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:27:45.209604 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9a78a-15fc-4da4-9ab8-031d9922b5f2 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:45.286041 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:45.343200 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9a78a-15fc-4da4-9ab8-031d9922b5f2 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:45.387451 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5430d4c-26d9-4a1d-9e62-35c11651b112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:45.388274 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5430d4c-26d9-4a1d-9e62-35c11651b112 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:45.389514 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5430d4c-26d9-4a1d-9e62-35c11651b112 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:45.389786 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5430d4c-26d9-4a1d-9e62-35c11651b112 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:45.390883 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af6714-c223-4fe3-bed9-44bffc7d42ed None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:45.401718 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5430d4c-26d9-4a1d-9e62-35c11651b112 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:45.410621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-a5430d4c-26d9-4a1d-9e62-35c11651b112 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:45.410621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:45.410621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:45.410621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:45.410621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:45.410621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:45.410621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:45.410621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:45.410621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:45.410621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:45.410621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:45.410621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:45.410621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:45.410621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:45.410621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:45.410621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:45.411620 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:45.411620 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:45.411620 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:45.411620 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:45.411620 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:45.411620 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:45.411620 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:45.411620 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:45.411620 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:45.411620 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:45.411620 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:45.411620 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:45.411620 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:45.411620 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:45.411620 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:45.411620 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:45.412454 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:45.412454 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:45.412454 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:45.412454 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:45.412454 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:45.412454 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:45.412454 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:45.412454 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:45.412454 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:45.412454 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:45.412454 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:45.412454 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:45.412454 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 305/606] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 30 10:27:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:45.419278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:45.420394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5430d4c-26d9-4a1d-9e62-35c11651b112 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:45.455364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f4c83-c614-4b3d-aab7-1065fedf6579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:45.455953 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f4c83-c614-4b3d-aab7-1065fedf6579 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:45.456233 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f4c83-c614-4b3d-aab7-1065fedf6579 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:45.456527 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f4c83-c614-4b3d-aab7-1065fedf6579 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:45.457250 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f4c83-c614-4b3d-aab7-1065fedf6579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:45.457555 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f4c83-c614-4b3d-aab7-1065fedf6579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:45.458940 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f4c83-c614-4b3d-aab7-1065fedf6579 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:45.485615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 302/607] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:45.491757 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f4c83-c614-4b3d-aab7-1065fedf6579 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:45.573955 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5430d4c-26d9-4a1d-9e62-35c11651b112 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:45.588830 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:45.635265 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f4c83-c614-4b3d-aab7-1065fedf6579 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:45.646753 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e513ef-d73f-4068-a1b8-0b247eb26ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:45.647707 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e513ef-d73f-4068-a1b8-0b247eb26ffa None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:45.648217 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e513ef-d73f-4068-a1b8-0b247eb26ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:45.648726 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e513ef-d73f-4068-a1b8-0b247eb26ffa None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:45.649701 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e513ef-d73f-4068-a1b8-0b247eb26ffa None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:45.650229 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e513ef-d73f-4068-a1b8-0b247eb26ffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:45.651798 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e513ef-d73f-4068-a1b8-0b247eb26ffa None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:45.672897 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 306/608] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 30 10:27:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:45.679113 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e513ef-d73f-4068-a1b8-0b247eb26ffa None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:45.703203 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ea7d4-839d-467d-8eee-41600be5312b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:45.704791 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ea7d4-839d-467d-8eee-41600be5312b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:45.706666 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ea7d4-839d-467d-8eee-41600be5312b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:45.707153 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ea7d4-839d-467d-8eee-41600be5312b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:45.719989 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ea7d4-839d-467d-8eee-41600be5312b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:45.722266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ea7d4-839d-467d-8eee-41600be5312b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:45.740052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-c88ea7d4-839d-467d-8eee-41600be5312b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:45.740052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:45.740052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:45.740052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:45.740052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:45.740052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:45.740052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:45.740052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:45.740052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:45.740052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:45.740052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:45.740052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:45.740052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:27:45.740052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:27:45.740052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:27:45.741113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:27:45.741113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:45.741113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:45.741113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:45.741113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:45.741113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:45.741113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:45.741113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:45.741113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:45.741113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:45.741113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:45.741113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:45.741113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:45.741113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:45.741113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:45.741113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:45.741113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:45.742001 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:27:45.742001 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:27:45.742001 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:27:45.742001 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:27:45.742001 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:27:45.742001 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:27:45.742001 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:45.742001 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:45.744479 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 303/609] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:27:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:45.749850 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ea7d4-839d-467d-8eee-41600be5312b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:45.809648 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:45.878858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e513ef-d73f-4068-a1b8-0b247eb26ffa None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:45.934381 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ea7d4-839d-467d-8eee-41600be5312b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:45.970644 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f3516-a1c4-4e39-a2fd-e594cf20af89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:45.972654 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f3516-a1c4-4e39-a2fd-e594cf20af89 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:45.973145 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f3516-a1c4-4e39-a2fd-e594cf20af89 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:45.973622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f3516-a1c4-4e39-a2fd-e594cf20af89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:45.994494 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f3516-a1c4-4e39-a2fd-e594cf20af89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:45.998395 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f3516-a1c4-4e39-a2fd-e594cf20af89 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:46.014263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d39630-7eaa-4a6f-81a5-c3838efde7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:46.014576 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d39630-7eaa-4a6f-81a5-c3838efde7ec None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:46.017374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d39630-7eaa-4a6f-81a5-c3838efde7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:46.017374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d39630-7eaa-4a6f-81a5-c3838efde7ec None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:46.017374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d39630-7eaa-4a6f-81a5-c3838efde7ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:46.017374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d39630-7eaa-4a6f-81a5-c3838efde7ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:46.018494 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d39630-7eaa-4a6f-81a5-c3838efde7ec None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:46.029877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-f61f3516-a1c4-4e39-a2fd-e594cf20af89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:46.029877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:46.029877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:46.029877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:46.029877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:46.029877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:46.029877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:46.029877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:46.029877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:46.029877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:46.029877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:46.029877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:46.029877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:46.029877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:46.029877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:46.030776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:46.030776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:46.030776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:46.030776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:46.030776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:46.030776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:46.030776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:46.030776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:46.030776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:46.030776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:46.030776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:46.030776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:46.030776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:46.030776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:46.030776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:46.030776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:46.030776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:46.031654 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:46.031654 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:46.031654 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:46.031654 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:46.035462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 307/610] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:27:46.040898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f3516-a1c4-4e39-a2fd-e594cf20af89 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:46.044626 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 304/611] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:27:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:46.046612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d39630-7eaa-4a6f-81a5-c3838efde7ec None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:46.089256 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:46.166083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:46.175028 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d39630-7eaa-4a6f-81a5-c3838efde7ec None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:46.202889 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f3516-a1c4-4e39-a2fd-e594cf20af89 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:46.226207 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d01b8b-ef09-4900-b901-db0a48bed32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:46.227447 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d01b8b-ef09-4900-b901-db0a48bed32a None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:46.227935 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d01b8b-ef09-4900-b901-db0a48bed32a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:46.228415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d01b8b-ef09-4900-b901-db0a48bed32a None admin] PATH_INFO: `/v3/projects/423854cc8f524ecb8d740d1cb0053856/users/fa8cb52425ba42d9ae3576e6fb18dc88/roles/1c667697d38a434fbb99c61bc846c4a5` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:46.248569 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e65a2a-eac7-41c8-b03c-b259000be672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:46.250602 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e65a2a-eac7-41c8-b03c-b259000be672 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:46.251104 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e65a2a-eac7-41c8-b03c-b259000be672 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:46.251584 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e65a2a-eac7-41c8-b03c-b259000be672 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:46.253917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e65a2a-eac7-41c8-b03c-b259000be672 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:46.254879 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e65a2a-eac7-41c8-b03c-b259000be672 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:46.264581 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e65a2a-eac7-41c8-b03c-b259000be672 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:46.264712 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d01b8b-ef09-4900-b901-db0a48bed32a None admin] RBAC: Authorizing `identity:create_grant(project_id=423854cc8f524ecb8d740d1cb0053856, user_id=fa8cb52425ba42d9ae3576e6fb18dc88, role_id=1c667697d38a434fbb99c61bc846c4a5)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:46.264712 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d01b8b-ef09-4900-b901-db0a48bed32a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:46.278373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 308/612] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:46.286601 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e65a2a-eac7-41c8-b03c-b259000be672 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:46.287188 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 305/613] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 30 10:27:46 2022] PUT /identity/v3/projects/423854cc8f524ecb8d740d1cb0053856/users/fa8cb52425ba42d9ae3576e6fb18dc88/roles/1c667697d38a434fbb99c61bc846c4a5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:27:46.404901 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:46.433877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e65a2a-eac7-41c8-b03c-b259000be672 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:46.474289 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175c7c4-31e1-461b-ae38-3562ffcf6c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:46.475084 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175c7c4-31e1-461b-ae38-3562ffcf6c20 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:46.475361 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175c7c4-31e1-461b-ae38-3562ffcf6c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:46.475631 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175c7c4-31e1-461b-ae38-3562ffcf6c20 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:46.483697 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175c7c4-31e1-461b-ae38-3562ffcf6c20 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:46.485099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175c7c4-31e1-461b-ae38-3562ffcf6c20 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:46.499284 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-b175c7c4-31e1-461b-ae38-3562ffcf6c20 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:27:46.499284 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:46.499284 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:46.499284 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:46.499284 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:46.499284 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:46.499284 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:46.499284 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:46.499284 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:46.499284 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:46.499284 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:46.499284 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:46.499284 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:27:46.499284 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:27:46.499284 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:27:46.499284 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:27:46.500247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:46.500247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:46.500247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:27:46.500247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:46.500247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:27:46.500247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:46.500247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:46.500247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:46.500247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:46.500247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:46.500247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:46.500247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:46.500247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:46.500247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:46.500247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:46.500247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:46.500247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:46.500247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:46.501214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:46.501214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:46.501214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:27:46.501214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:27:46.501214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:27:46.501214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:27:46.501214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:27:46.501214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:27:46.501214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:27:46.501214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:46.501214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 309/614] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:27:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:46.509035 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d01b8b-ef09-4900-b901-db0a48bed32a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:46.662913 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d01b8b-ef09-4900-b901-db0a48bed32a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:46.718323 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573a338-11ae-4f1e-8628-92fcdbb6cd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:46.718998 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573a338-11ae-4f1e-8628-92fcdbb6cd9b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:46.719283 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573a338-11ae-4f1e-8628-92fcdbb6cd9b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:46.719560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573a338-11ae-4f1e-8628-92fcdbb6cd9b None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:46.720405 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573a338-11ae-4f1e-8628-92fcdbb6cd9b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:46.720746 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573a338-11ae-4f1e-8628-92fcdbb6cd9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:46.722181 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573a338-11ae-4f1e-8628-92fcdbb6cd9b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:46.756093 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 306/615] 10.222.0.59 () {56 vars in 1135 bytes} [Thu Jun 30 10:27:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:46.762521 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175c7c4-31e1-461b-ae38-3562ffcf6c20 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:46.916378 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175c7c4-31e1-461b-ae38-3562ffcf6c20 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:46.974861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ac06f-2903-4fd4-96ea-c54c80bb9723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:46.975663 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ac06f-2903-4fd4-96ea-c54c80bb9723 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:46.975944 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ac06f-2903-4fd4-96ea-c54c80bb9723 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:46.976219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ac06f-2903-4fd4-96ea-c54c80bb9723 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:46.998638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ac06f-2903-4fd4-96ea-c54c80bb9723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:47.000193 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ac06f-2903-4fd4-96ea-c54c80bb9723 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:47.006229 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:47.024123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-6a7ac06f-2903-4fd4-96ea-c54c80bb9723 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:47.024123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:47.024123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:47.024123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:47.024123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:47.024123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:47.024123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:47.024123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:47.024123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:47.024123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:47.024123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:47.024123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:47.024123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:47.024123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:47.024123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:47.025072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:47.025072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:47.025072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:47.025072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:47.025072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:47.025072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:47.025072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:47.025072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:47.025072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:47.025072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:47.025072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:47.025072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:47.025072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:47.025072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:47.025072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:47.025072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:47.025072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:47.026369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:47.026369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:47.026369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:47.026369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:47.026369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 310/616] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:47.031286 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573a338-11ae-4f1e-8628-92fcdbb6cd9b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:47.039678 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:47.065671 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cece47-8740-46bf-bc98-a939d3c9efd0 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:47.065971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cece47-8740-46bf-bc98-a939d3c9efd0 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:47.066236 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cece47-8740-46bf-bc98-a939d3c9efd0 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:47.067851 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 311/617] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:47.072605 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da8892-b4a3-4827-844f-818c8b58d7c7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:47.072896 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da8892-b4a3-4827-844f-818c8b58d7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:47.073173 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da8892-b4a3-4827-844f-818c8b58d7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:47.090611 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b2da8892-b4a3-4827-844f-818c8b58d7c7 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:47.091783 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b2da8892-b4a3-4827-844f-818c8b58d7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:47.208625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 312/618] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:47.231132 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573a338-11ae-4f1e-8628-92fcdbb6cd9b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:47.246911 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4ea7b-c7ec-4ab5-accd-6e50a4b4b4b9 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:47.247240 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4ea7b-c7ec-4ab5-accd-6e50a4b4b4b9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:47.247473 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4ea7b-c7ec-4ab5-accd-6e50a4b4b4b9 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:47.249144 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 313/619] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:27:47.255750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb8fe9-54eb-4fe3-a096-da7b49ff65b7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:47.255750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb8fe9-54eb-4fe3-a096-da7b49ff65b7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:47.255750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb8fe9-54eb-4fe3-a096-da7b49ff65b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:47.271970 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9dbb8fe9-54eb-4fe3-a096-da7b49ff65b7 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:47.273187 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9dbb8fe9-54eb-4fe3-a096-da7b49ff65b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:47.282366 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3718f30-65ef-4aa9-8980-5a45421b9298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:47.283773 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3718f30-65ef-4aa9-8980-5a45421b9298 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:47.284772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3718f30-65ef-4aa9-8980-5a45421b9298 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:47.285253 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3718f30-65ef-4aa9-8980-5a45421b9298 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:47.286423 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3718f30-65ef-4aa9-8980-5a45421b9298 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:47.286930 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3718f30-65ef-4aa9-8980-5a45421b9298 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:47.289476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3718f30-65ef-4aa9-8980-5a45421b9298 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:47.306068 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 307/620] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:47.307196 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3718f30-65ef-4aa9-8980-5a45421b9298 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:47.349745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 314/621] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:27:47.350628 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb8fe9-54eb-4fe3-a096-da7b49ff65b7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:47.386697 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:47.426857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3718f30-65ef-4aa9-8980-5a45421b9298 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:47.431889 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:47.461522 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbfb4f-eee8-459d-a707-0bef5e8fe04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:47.462319 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbfb4f-eee8-459d-a707-0bef5e8fe04e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:47.462608 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbfb4f-eee8-459d-a707-0bef5e8fe04e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:47.462887 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbfb4f-eee8-459d-a707-0bef5e8fe04e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:47.473419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbbfb4f-eee8-459d-a707-0bef5e8fe04e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:47.481106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb8fe9-54eb-4fe3-a096-da7b49ff65b7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:47.481788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-7dbbfb4f-eee8-459d-a707-0bef5e8fe04e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:47.481788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:47.481788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:47.481788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:47.481788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:47.481788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:47.481788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:47.481788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:47.481788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:47.481788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:47.481788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:47.481788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:47.481788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:47.481788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:47.481788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:47.481788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:47.482866 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:47.482866 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:47.482866 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:47.482866 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:47.482866 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:47.482866 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:47.482866 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:47.482866 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:47.482866 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:47.482866 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:47.482866 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:47.482866 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:47.482866 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:47.482866 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:47.482866 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:47.482866 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:47.484048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:47.484048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:47.484048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:47.484048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:47.484048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:47.484048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:47.484048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:47.484048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:47.484048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:47.484048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:47.484048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:47.484048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:47.484048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 308/622] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 30 10:27:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:47.484785 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbfb4f-eee8-459d-a707-0bef5e8fe04e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:47.520060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65160e61-662b-44bf-a746-c84cca7197dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:47.520893 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65160e61-662b-44bf-a746-c84cca7197dc None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:47.521161 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65160e61-662b-44bf-a746-c84cca7197dc None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:47.521439 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65160e61-662b-44bf-a746-c84cca7197dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:47.529514 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65160e61-662b-44bf-a746-c84cca7197dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:47.531099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65160e61-662b-44bf-a746-c84cca7197dc None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:47.546583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-65160e61-662b-44bf-a746-c84cca7197dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:47.546583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:47.546583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:47.546583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:47.546583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:47.546583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:47.546583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:47.546583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:47.546583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:47.546583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:47.546583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:47.546583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:47.546583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:27:47.546583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:27:47.546583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:27:47.547493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:27:47.547493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:47.547493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:47.547493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:47.547493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:47.547493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:47.547493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:47.547493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:47.547493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:47.547493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:47.547493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:47.547493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:47.547493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:47.547493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:47.547493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:47.547493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:47.547493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:47.549224 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:27:47.549224 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:27:47.549224 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:27:47.549224 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:27:47.549224 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:27:47.549224 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:27:47.549224 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:47.549224 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:47.553138 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 315/623] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:27:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:47.553969 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65160e61-662b-44bf-a746-c84cca7197dc None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:47.585386 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbfb4f-eee8-459d-a707-0bef5e8fe04e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:47.609670 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:47.624315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63d4dd-32e4-469c-8b1c-07e6064cc65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:47.625235 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63d4dd-32e4-469c-8b1c-07e6064cc65f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:47.625523 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63d4dd-32e4-469c-8b1c-07e6064cc65f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:47.625800 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63d4dd-32e4-469c-8b1c-07e6064cc65f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:47.638575 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63d4dd-32e4-469c-8b1c-07e6064cc65f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:47.646984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-da63d4dd-32e4-469c-8b1c-07e6064cc65f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:47.646984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:47.646984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:47.646984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:47.646984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:47.646984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:47.646984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:47.646984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:47.646984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:47.646984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:47.646984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:47.646984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:47.646984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:47.646984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:47.646984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:47.646984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:47.649279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:47.649279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:47.649279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:47.649279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:47.649279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:47.649279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:47.649279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:47.649279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:47.649279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:47.649279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:47.649279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:47.649279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:47.649279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:47.649279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:47.649279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:47.649279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:47.651317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:47.651317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:47.651317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:47.651317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:47.651317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:47.651317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:47.651317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:47.651317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:47.651317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:47.651317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:47.651317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:47.651317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:47.659552 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 309/624] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 30 10:27:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:47.659552 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63d4dd-32e4-469c-8b1c-07e6064cc65f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:47.668874 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65160e61-662b-44bf-a746-c84cca7197dc None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:47.684180 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:47.707959 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17691c-de68-4ed2-80f3-20f870666055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:47.709026 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17691c-de68-4ed2-80f3-20f870666055 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:47.709392 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17691c-de68-4ed2-80f3-20f870666055 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:47.709812 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17691c-de68-4ed2-80f3-20f870666055 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:47.710654 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17691c-de68-4ed2-80f3-20f870666055 None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:47.711102 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17691c-de68-4ed2-80f3-20f870666055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:47.712731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17691c-de68-4ed2-80f3-20f870666055 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:47.722939 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 316/625] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 30 10:27:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:47.724199 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17691c-de68-4ed2-80f3-20f870666055 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:47.763171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63d4dd-32e4-469c-8b1c-07e6064cc65f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:47.798592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278b7f2-3561-4ef3-845f-0a3e04b98d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:47.799173 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278b7f2-3561-4ef3-845f-0a3e04b98d4f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:47.799458 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278b7f2-3561-4ef3-845f-0a3e04b98d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:47.799733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278b7f2-3561-4ef3-845f-0a3e04b98d4f None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:47.800531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278b7f2-3561-4ef3-845f-0a3e04b98d4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:47.800844 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278b7f2-3561-4ef3-845f-0a3e04b98d4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:47.802272 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278b7f2-3561-4ef3-845f-0a3e04b98d4f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:47.814062 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 310/626] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:27:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:47.814847 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278b7f2-3561-4ef3-845f-0a3e04b98d4f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:47.841312 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17691c-de68-4ed2-80f3-20f870666055 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:47.857919 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:47.879089 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755469bd-007b-49d2-883e-be8d03ba61ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:47.880051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755469bd-007b-49d2-883e-be8d03ba61ab None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:47.880681 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755469bd-007b-49d2-883e-be8d03ba61ab None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:47.881312 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755469bd-007b-49d2-883e-be8d03ba61ab None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:47.882115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755469bd-007b-49d2-883e-be8d03ba61ab None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:47.882432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755469bd-007b-49d2-883e-be8d03ba61ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:47.883867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755469bd-007b-49d2-883e-be8d03ba61ab None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:47.896656 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 317/627] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 30 10:27:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:47.896656 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aae5a6-cdfa-4fe5-850c-fe45ec9c1984 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:47.896656 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aae5a6-cdfa-4fe5-850c-fe45ec9c1984 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:47.896656 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aae5a6-cdfa-4fe5-850c-fe45ec9c1984 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:47.896656 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 318/628] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:47.896656 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aae5a6-cdfa-4fe5-850c-fe45ec9c1984 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:47.923015 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278b7f2-3561-4ef3-845f-0a3e04b98d4f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:47.947560 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:47.961530 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a5ef4-d5a8-4084-b84b-0aee91081b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:47.962571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a5ef4-d5a8-4084-b84b-0aee91081b98 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:47.963058 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a5ef4-d5a8-4084-b84b-0aee91081b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:47.963627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a5ef4-d5a8-4084-b84b-0aee91081b98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:47.976262 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a5ef4-d5a8-4084-b84b-0aee91081b98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:47.978091 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a5ef4-d5a8-4084-b84b-0aee91081b98 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:47.997943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-cd6a5ef4-d5a8-4084-b84b-0aee91081b98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:47.997943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:47.997943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:47.997943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:47.997943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:47.997943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:47.997943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:47.997943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:47.997943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:47.997943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:47.997943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:47.997943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:47.997943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:47.997943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:47.997943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:47.999050 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:47.999050 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:47.999050 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:47.999050 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:47.999050 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:47.999050 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:47.999050 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:47.999050 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:47.999050 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:47.999050 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:47.999050 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:47.999050 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:47.999050 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:47.999050 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:47.999050 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:47.999050 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:47.999050 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:48.000263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:48.000263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:48.000263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:48.000263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:48.007052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 311/629] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:48.008055 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a5ef4-d5a8-4084-b84b-0aee91081b98 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:48.010251 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aae5a6-cdfa-4fe5-850c-fe45ec9c1984 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:48.045476 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e2dd5-8b85-4176-bbb2-1ae773377b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:48.046350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e2dd5-8b85-4176-bbb2-1ae773377b57 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:48.046631 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e2dd5-8b85-4176-bbb2-1ae773377b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:48.046905 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e2dd5-8b85-4176-bbb2-1ae773377b57 None admin] PATH_INFO: `/v3/projects/423854cc8f524ecb8d740d1cb0053856/users/c15327c36c8c49ac87a3b3e9ab49eea7/roles/1c667697d38a434fbb99c61bc846c4a5` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:48.061004 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e2dd5-8b85-4176-bbb2-1ae773377b57 None admin] RBAC: Authorizing `identity:create_grant(project_id=423854cc8f524ecb8d740d1cb0053856, user_id=c15327c36c8c49ac87a3b3e9ab49eea7, role_id=1c667697d38a434fbb99c61bc846c4a5)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:48.062369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e2dd5-8b85-4176-bbb2-1ae773377b57 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:48.075748 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 319/630] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 30 10:27:47 2022] PUT /identity/v3/projects/423854cc8f524ecb8d740d1cb0053856/users/c15327c36c8c49ac87a3b3e9ab49eea7/roles/1c667697d38a434fbb99c61bc846c4a5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:27:48.077096 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b395e1e-2fcf-44c8-bbfa-57276c8cf186 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:48.077382 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b395e1e-2fcf-44c8-bbfa-57276c8cf186 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:48.077653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b395e1e-2fcf-44c8-bbfa-57276c8cf186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:48.096938 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-3b395e1e-2fcf-44c8-bbfa-57276c8cf186 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:48.098270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3b395e1e-2fcf-44c8-bbfa-57276c8cf186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:48.137349 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:48.147768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a5ef4-d5a8-4084-b84b-0aee91081b98 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:48.183912 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 320/631] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:48.184935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b395e1e-2fcf-44c8-bbfa-57276c8cf186 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:48.204601 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998d630-a128-4ec7-9e1e-a352f635defd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:48.205654 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:48.206607 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998d630-a128-4ec7-9e1e-a352f635defd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:48.207093 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998d630-a128-4ec7-9e1e-a352f635defd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:48.207562 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998d630-a128-4ec7-9e1e-a352f635defd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:48.223655 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998d630-a128-4ec7-9e1e-a352f635defd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:48.225785 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998d630-a128-4ec7-9e1e-a352f635defd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:48.250973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-4998d630-a128-4ec7-9e1e-a352f635defd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:48.250973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:48.250973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:48.250973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:48.250973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:48.250973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:48.250973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:48.250973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:48.250973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:48.250973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:48.250973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:48.250973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:48.250973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:48.250973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:48.250973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:48.251941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:48.251941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:48.251941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:48.251941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:48.251941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:48.251941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:48.251941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:48.251941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:48.251941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:48.251941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:48.251941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:48.251941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:48.251941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:48.251941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:48.251941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:48.251941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:48.251941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:48.252886 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:48.252886 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:48.252886 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:48.252886 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:48.252886 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 312/632] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:48.253168 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998d630-a128-4ec7-9e1e-a352f635defd None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:48.331724 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b395e1e-2fcf-44c8-bbfa-57276c8cf186 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:48.367274 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998d630-a128-4ec7-9e1e-a352f635defd None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:48.379499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e586c88-0b26-4576-a5a0-c260db5df91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:48.380630 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e586c88-0b26-4576-a5a0-c260db5df91c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:48.381054 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e586c88-0b26-4576-a5a0-c260db5df91c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:48.381754 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e586c88-0b26-4576-a5a0-c260db5df91c None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:48.383068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e586c88-0b26-4576-a5a0-c260db5df91c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:48.383525 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e586c88-0b26-4576-a5a0-c260db5df91c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:48.385600 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e586c88-0b26-4576-a5a0-c260db5df91c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:48.401313 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 321/633] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:48.402920 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e586c88-0b26-4576-a5a0-c260db5df91c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:48.408747 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1147473-9c00-4870-9bc6-29cbf0cb6004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:48.410004 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1147473-9c00-4870-9bc6-29cbf0cb6004 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:48.411455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1147473-9c00-4870-9bc6-29cbf0cb6004 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:48.411886 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1147473-9c00-4870-9bc6-29cbf0cb6004 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:48.425964 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1147473-9c00-4870-9bc6-29cbf0cb6004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:48.434136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-d1147473-9c00-4870-9bc6-29cbf0cb6004 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:48.434136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:48.434136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:48.434136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:48.434136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:48.434136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:48.434136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:48.434136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:48.434136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:48.434136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:48.434136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:48.434136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:48.434136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:48.434136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:48.434136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:48.434136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:48.435266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:48.435266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:48.435266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:48.435266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:48.435266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:48.435266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:48.435266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:48.435266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:48.435266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:48.435266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:48.435266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:48.435266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:48.435266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:48.435266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:48.435266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:48.435266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:48.436314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:48.436314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:48.436314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:48.436314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:48.436314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:48.436314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:48.436314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:48.436314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:48.436314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:48.436314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:48.436314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:48.436314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:48.438440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 313/634] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 30 10:27:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:48.439291 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1147473-9c00-4870-9bc6-29cbf0cb6004 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:48.449496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:48.508390 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:48.532180 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e586c88-0b26-4576-a5a0-c260db5df91c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:48.561429 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1147473-9c00-4870-9bc6-29cbf0cb6004 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:48.567402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c619b-0daa-4bc9-9ec6-c3202d6c3739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:48.568177 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c619b-0daa-4bc9-9ec6-c3202d6c3739 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:48.568550 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c619b-0daa-4bc9-9ec6-c3202d6c3739 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:48.568908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c619b-0daa-4bc9-9ec6-c3202d6c3739 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:48.569697 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c619b-0daa-4bc9-9ec6-c3202d6c3739 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:48.570072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c619b-0daa-4bc9-9ec6-c3202d6c3739 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:48.571537 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c619b-0daa-4bc9-9ec6-c3202d6c3739 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:48.585177 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 322/635] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:48.585939 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c619b-0daa-4bc9-9ec6-c3202d6c3739 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:48.599013 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f0be4-741b-4a2d-b0af-c2493c350741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:48.599806 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f0be4-741b-4a2d-b0af-c2493c350741 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:48.600089 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f0be4-741b-4a2d-b0af-c2493c350741 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:48.600358 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f0be4-741b-4a2d-b0af-c2493c350741 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:48.610488 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f0be4-741b-4a2d-b0af-c2493c350741 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:48.611981 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f0be4-741b-4a2d-b0af-c2493c350741 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:48.626054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-0e0f0be4-741b-4a2d-b0af-c2493c350741 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 30 10:27:48.626054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:48.626054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:48.626054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:48.626054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:48.626054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:48.626054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:48.626054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:48.626054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:48.626054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:48.626054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:48.626054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:48.626054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:27:48.626054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:27:48.626054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:27:48.626054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:27:48.627240 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:48.627240 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:48.627240 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:27:48.627240 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:48.627240 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:27:48.627240 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:48.627240 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:48.627240 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:48.627240 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:48.627240 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:48.627240 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:48.627240 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:48.627240 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:48.627240 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:48.627240 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:48.627240 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:48.627240 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:48.627240 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:48.628223 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:48.628223 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:48.628223 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:27:48.628223 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:27:48.628223 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:27:48.628223 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:27:48.628223 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:27:48.628223 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:27:48.628223 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 30 10:27:48.628223 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:48.628223 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 314/636] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:48.628869 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b992f6f-3685-47a1-aaa5-64fec4d0b4c8 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:48.629111 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b992f6f-3685-47a1-aaa5-64fec4d0b4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:48.629383 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b992f6f-3685-47a1-aaa5-64fec4d0b4c8 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:48.634610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 315/637] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:48.634610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b992f6f-3685-47a1-aaa5-64fec4d0b4c8 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:48.701973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:48.717252 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c619b-0daa-4bc9-9ec6-c3202d6c3739 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:48.741133 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b992f6f-3685-47a1-aaa5-64fec4d0b4c8 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:48.751844 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404ee6b-03b1-41a2-a93c-7a4266698e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:48.752689 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404ee6b-03b1-41a2-a93c-7a4266698e74 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:48.752899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404ee6b-03b1-41a2-a93c-7a4266698e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:48.753170 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404ee6b-03b1-41a2-a93c-7a4266698e74 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:48.753905 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404ee6b-03b1-41a2-a93c-7a4266698e74 None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:48.754200 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404ee6b-03b1-41a2-a93c-7a4266698e74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:48.755540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404ee6b-03b1-41a2-a93c-7a4266698e74 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:48.762199 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:48.770128 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 323/638] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 30 10:27:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:48.770986 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404ee6b-03b1-41a2-a93c-7a4266698e74 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:48.779380 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf420b68-052b-43d3-a1c6-83b3e302b895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:48.780161 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf420b68-052b-43d3-a1c6-83b3e302b895 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:48.780886 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf420b68-052b-43d3-a1c6-83b3e302b895 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:48.781163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf420b68-052b-43d3-a1c6-83b3e302b895 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:48.789662 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf420b68-052b-43d3-a1c6-83b3e302b895 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:48.791118 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf420b68-052b-43d3-a1c6-83b3e302b895 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:48.806594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-bf420b68-052b-43d3-a1c6-83b3e302b895 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:27:48.806594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:48.806594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:48.806594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:48.806594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:48.806594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:48.806594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:48.806594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:48.806594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:48.806594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:48.806594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:48.806594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:48.806594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:27:48.806594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:27:48.806594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:27:48.806594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:27:48.807551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:48.807551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:48.807551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:27:48.807551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:48.807551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:27:48.807551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:48.807551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:48.807551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:48.807551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:48.807551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:48.807551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:48.807551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:48.807551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:48.807551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:48.807551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:48.807551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:48.807551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:48.807551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:48.808565 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:48.808565 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:48.808565 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:27:48.808565 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:27:48.808565 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:27:48.808565 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:27:48.808565 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:27:48.808565 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:27:48.808565 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:27:48.808565 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:48.808565 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 316/639] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Jun 30 10:27:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:48.809646 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c02d10-d700-43c9-a8d5-4c43969cbfec None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:48.809646 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c02d10-d700-43c9-a8d5-4c43969cbfec None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:48.809939 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c02d10-d700-43c9-a8d5-4c43969cbfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:48.827356 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-85c02d10-d700-43c9-a8d5-4c43969cbfec None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:48.828539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-85c02d10-d700-43c9-a8d5-4c43969cbfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:48.881482 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404ee6b-03b1-41a2-a93c-7a4266698e74 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:48.899163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 317/640] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:48.899996 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c02d10-d700-43c9-a8d5-4c43969cbfec None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:48.923722 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dff3cb-4841-47fa-af57-e71ff847a045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:48.924734 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dff3cb-4841-47fa-af57-e71ff847a045 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:48.925193 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dff3cb-4841-47fa-af57-e71ff847a045 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:48.925670 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dff3cb-4841-47fa-af57-e71ff847a045 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:48.926657 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dff3cb-4841-47fa-af57-e71ff847a045 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:48.927250 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dff3cb-4841-47fa-af57-e71ff847a045 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:48.928758 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dff3cb-4841-47fa-af57-e71ff847a045 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:48.946271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 324/641] 10.222.0.59 () {56 vars in 1137 bytes} [Thu Jun 30 10:27:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:48.947135 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dff3cb-4841-47fa-af57-e71ff847a045 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:48.963779 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:49.008164 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:49.016248 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c02d10-d700-43c9-a8d5-4c43969cbfec None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:49.049783 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fc84a-19a0-4a35-8413-e34fa3b68fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:49.050569 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fc84a-19a0-4a35-8413-e34fa3b68fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:49.050868 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fc84a-19a0-4a35-8413-e34fa3b68fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:49.051131 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fc84a-19a0-4a35-8413-e34fa3b68fe1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:49.054317 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dff3cb-4841-47fa-af57-e71ff847a045 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:49.061857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fc84a-19a0-4a35-8413-e34fa3b68fe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:49.063332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fc84a-19a0-4a35-8413-e34fa3b68fe1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:49.082181 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-373fc84a-19a0-4a35-8413-e34fa3b68fe1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:49.082181 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:49.082181 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:49.082181 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:49.082181 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:49.082181 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:49.082181 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:49.082181 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:49.082181 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:49.082181 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:49.082181 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:49.082181 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:49.082181 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:49.082181 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:49.082181 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:49.083297 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:49.083297 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:49.083297 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:49.083297 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:49.083297 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:49.083297 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:49.083297 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:49.083297 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:49.083297 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:49.083297 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:49.083297 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:49.083297 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:49.083297 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:49.083297 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:49.083297 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:49.083297 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:49.083297 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:49.084400 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:49.084400 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:49.084400 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:49.084400 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:49.085971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 318/642] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:49.086925 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fc84a-19a0-4a35-8413-e34fa3b68fe1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:49.095613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff437ded-6744-43fd-94a7-9a5b7b9e93d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:49.096474 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff437ded-6744-43fd-94a7-9a5b7b9e93d1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:49.096823 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff437ded-6744-43fd-94a7-9a5b7b9e93d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:49.097137 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff437ded-6744-43fd-94a7-9a5b7b9e93d1 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:49.097990 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff437ded-6744-43fd-94a7-9a5b7b9e93d1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:49.098417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff437ded-6744-43fd-94a7-9a5b7b9e93d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:49.100319 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff437ded-6744-43fd-94a7-9a5b7b9e93d1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:49.119213 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 325/643] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Jun 30 10:27:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:49.125137 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff437ded-6744-43fd-94a7-9a5b7b9e93d1 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:49.194332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fc84a-19a0-4a35-8413-e34fa3b68fe1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:49.203905 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:49.232021 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2be5c-6c36-4e00-9b7a-d7d77197c496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:49.232868 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2be5c-6c36-4e00-9b7a-d7d77197c496 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:49.233156 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2be5c-6c36-4e00-9b7a-d7d77197c496 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:49.233432 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2be5c-6c36-4e00-9b7a-d7d77197c496 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:49.239149 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff437ded-6744-43fd-94a7-9a5b7b9e93d1 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:49.245056 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2be5c-6c36-4e00-9b7a-d7d77197c496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:49.255980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-94c2be5c-6c36-4e00-9b7a-d7d77197c496 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:49.255980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:49.255980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:49.255980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:49.255980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:49.255980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:49.255980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:49.255980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:49.255980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:49.255980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:49.255980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:49.255980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:49.255980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:49.255980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:49.255980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:49.255980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:49.257232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:49.257232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:49.257232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:49.257232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:49.257232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:49.257232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:49.257232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:49.257232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:49.257232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:49.257232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:49.257232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:49.257232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:49.257232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:49.257232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:49.257232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:49.257232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:49.258342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:49.258342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:49.258342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:49.258342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:49.258342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:49.258342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:49.258342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:49.258342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:49.258342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:49.258342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:49.258342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:49.258342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:49.258342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 319/644] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 30 10:27:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:49.258342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2be5c-6c36-4e00-9b7a-d7d77197c496 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:49.268152 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:49.289062 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da22f8a-0b4c-4db5-9dd1-1ef5f03125eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:49.289958 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da22f8a-0b4c-4db5-9dd1-1ef5f03125eb None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:49.290701 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da22f8a-0b4c-4db5-9dd1-1ef5f03125eb None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:49.290941 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da22f8a-0b4c-4db5-9dd1-1ef5f03125eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:49.360916 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da22f8a-0b4c-4db5-9dd1-1ef5f03125eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:49.362514 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da22f8a-0b4c-4db5-9dd1-1ef5f03125eb None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:49.369688 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2be5c-6c36-4e00-9b7a-d7d77197c496 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:49.405210 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e6bbb-ef0f-4133-a317-6a1cdaec84c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:49.405875 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e6bbb-ef0f-4133-a317-6a1cdaec84c0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:49.406162 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e6bbb-ef0f-4133-a317-6a1cdaec84c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:49.406446 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e6bbb-ef0f-4133-a317-6a1cdaec84c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:49.407162 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e6bbb-ef0f-4133-a317-6a1cdaec84c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:49.407474 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e6bbb-ef0f-4133-a317-6a1cdaec84c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:49.408876 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e6bbb-ef0f-4133-a317-6a1cdaec84c0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:49.421225 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 320/645] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:49.422017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e6bbb-ef0f-4133-a317-6a1cdaec84c0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:49.450789 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:49.475160 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 326/646] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:27:49.476004 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da22f8a-0b4c-4db5-9dd1-1ef5f03125eb None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:49.494650 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:49.534347 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e6bbb-ef0f-4133-a317-6a1cdaec84c0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:49.569359 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a9844-9d97-4633-8e04-8ebba1403bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:49.569997 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a9844-9d97-4633-8e04-8ebba1403bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:49.570283 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a9844-9d97-4633-8e04-8ebba1403bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:49.570560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a9844-9d97-4633-8e04-8ebba1403bd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:49.580630 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da22f8a-0b4c-4db5-9dd1-1ef5f03125eb None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:49.615668 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b924e3-586c-4c1f-8d87-833720532f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:49.616332 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b924e3-586c-4c1f-8d87-833720532f43 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:49.616660 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b924e3-586c-4c1f-8d87-833720532f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:49.616964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b924e3-586c-4c1f-8d87-833720532f43 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:49.617764 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b924e3-586c-4c1f-8d87-833720532f43 None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:49.618096 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b924e3-586c-4c1f-8d87-833720532f43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:49.619576 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b924e3-586c-4c1f-8d87-833720532f43 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:49.632232 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 327/647] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 30 10:27:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:49.632232 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b924e3-586c-4c1f-8d87-833720532f43 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:49.644431 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a9844-9d97-4633-8e04-8ebba1403bd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:49.645886 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a9844-9d97-4633-8e04-8ebba1403bd1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:49.675992 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:49.717551 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:49.739549 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b924e3-586c-4c1f-8d87-833720532f43 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:49.773682 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a6cb5-6c2b-4bf6-9c30-ad1205097a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:49.774781 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a6cb5-6c2b-4bf6-9c30-ad1205097a6b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:49.774908 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 321/648] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:27:49.775349 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a6cb5-6c2b-4bf6-9c30-ad1205097a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:49.775751 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a6cb5-6c2b-4bf6-9c30-ad1205097a6b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:49.775857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a9844-9d97-4633-8e04-8ebba1403bd1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:49.790619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a6cb5-6c2b-4bf6-9c30-ad1205097a6b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:49.792636 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a6cb5-6c2b-4bf6-9c30-ad1205097a6b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:49.809192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-0c6a6cb5-6c2b-4bf6-9c30-ad1205097a6b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 10:27:49.809192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:49.809192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:49.809192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:49.809192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:49.809192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:49.809192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:49.809192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:49.809192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:49.809192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:49.809192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:49.809192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:49.809192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:27:49.809192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:27:49.809192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:27:49.809192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:27:49.810136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:49.810136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:49.810136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:27:49.810136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:49.810136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:27:49.810136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:49.810136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:49.810136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:49.810136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:49.810136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:49.810136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:49.810136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:49.810136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:49.810136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:49.810136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:49.810136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:49.810136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:49.810136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:49.811080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:49.811080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:49.811080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:27:49.811080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:27:49.811080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:27:49.811080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:27:49.811080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:27:49.811080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:27:49.811080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 10:27:49.811080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:49.811080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 328/649] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:49.811683 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a6cb5-6c2b-4bf6-9c30-ad1205097a6b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:49.899134 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a9844-9d97-4633-8e04-8ebba1403bd1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:49.921071 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a6cb5-6c2b-4bf6-9c30-ad1205097a6b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:49.927677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:49.939742 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74d662-7eba-4be5-aec3-9e2baed2c52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:49.940557 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74d662-7eba-4be5-aec3-9e2baed2c52a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:49.940844 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74d662-7eba-4be5-aec3-9e2baed2c52a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:49.941117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74d662-7eba-4be5-aec3-9e2baed2c52a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:49.951912 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74d662-7eba-4be5-aec3-9e2baed2c52a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:49.953532 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74d662-7eba-4be5-aec3-9e2baed2c52a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:49.958408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca7320-07b3-45c6-9229-9c728db8f441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:49.959199 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca7320-07b3-45c6-9229-9c728db8f441 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:49.959480 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca7320-07b3-45c6-9229-9c728db8f441 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:49.959754 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca7320-07b3-45c6-9229-9c728db8f441 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:49.967257 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:49.971527 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca7320-07b3-45c6-9229-9c728db8f441 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:49.972855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-ad74d662-7eba-4be5-aec3-9e2baed2c52a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:49.972855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:49.972855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:49.972855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:49.972855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:49.972855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:49.972855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:49.972855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:49.972855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:49.972855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:49.972855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:49.972855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:49.972855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:49.972855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:49.972855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:49.974031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:49.974031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:49.974031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:49.974031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:49.974031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:49.974031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:49.974031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:49.974031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:49.974031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:49.974031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:49.974031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:49.974031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:49.974031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:49.974031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:49.974031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:49.974031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:49.974031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:49.979826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:49.979826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:49.979826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:49.979826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:49.980078 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca7320-07b3-45c6-9229-9c728db8f441 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:49.980156 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 322/650] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:49.980156 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74d662-7eba-4be5-aec3-9e2baed2c52a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:49.997653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-2eca7320-07b3-45c6-9229-9c728db8f441 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:49.997653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:49.997653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:49.997653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:49.997653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:49.997653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:49.997653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:49.997653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:49.997653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:49.997653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:49.997653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:49.997653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:49.997653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:49.997653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:49.997653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:49.998542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:49.998542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:49.998542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:49.998542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:49.998542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:49.998542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:49.998542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:49.998542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:49.998542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:49.998542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:49.998542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:49.998542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:49.998542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:49.998542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:49.998542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:49.998542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:49.998542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:50.004252 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:50.004252 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:50.004252 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:50.004252 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:50.004252 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 329/651] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:50.004252 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca7320-07b3-45c6-9229-9c728db8f441 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:50.100469 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74d662-7eba-4be5-aec3-9e2baed2c52a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:50.123059 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca7320-07b3-45c6-9229-9c728db8f441 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:50.134816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2f50e-efee-4b73-8040-317af503feb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:50.135626 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2f50e-efee-4b73-8040-317af503feb9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:50.135909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2f50e-efee-4b73-8040-317af503feb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:50.136186 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2f50e-efee-4b73-8040-317af503feb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:50.147462 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2f50e-efee-4b73-8040-317af503feb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:50.148952 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2f50e-efee-4b73-8040-317af503feb9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:50.159957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2a088-ec81-4932-8021-579e9a1c895a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:50.160917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2a088-ec81-4932-8021-579e9a1c895a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:50.161428 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2a088-ec81-4932-8021-579e9a1c895a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:50.161907 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2a088-ec81-4932-8021-579e9a1c895a None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:50.162958 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2a088-ec81-4932-8021-579e9a1c895a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:50.163472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2a088-ec81-4932-8021-579e9a1c895a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:50.165130 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2a088-ec81-4932-8021-579e9a1c895a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:50.166280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-a2f2f50e-efee-4b73-8040-317af503feb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:50.166280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:50.166280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:50.166280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:50.166280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:50.166280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:50.166280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:50.166280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:50.166280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:50.166280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:50.166280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:50.166280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:50.166280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:50.166280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:50.166280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:50.167220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:50.167220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:50.167220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:50.167220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:50.167220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:50.167220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:50.167220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:50.167220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:50.167220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:50.167220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:50.167220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:50.167220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:50.167220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:50.167220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:50.167220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:50.167220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:50.167220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:50.168692 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:50.168692 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:50.168692 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:50.168692 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:50.168692 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 323/652] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:50.168969 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2f50e-efee-4b73-8040-317af503feb9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:50.190313 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 330/653] 10.222.0.59 () {56 vars in 1137 bytes} [Thu Jun 30 10:27:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:50.191138 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2a088-ec81-4932-8021-579e9a1c895a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:50.208091 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:50.241391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:50.284137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2f50e-efee-4b73-8040-317af503feb9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:50.290469 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2a088-ec81-4932-8021-579e9a1c895a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:50.317608 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f18ff-e303-4412-bfc6-6f30fbd883b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:50.318261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f18ff-e303-4412-bfc6-6f30fbd883b3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:50.318546 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f18ff-e303-4412-bfc6-6f30fbd883b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:50.318821 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f18ff-e303-4412-bfc6-6f30fbd883b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:50.319531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f18ff-e303-4412-bfc6-6f30fbd883b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:50.319840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f18ff-e303-4412-bfc6-6f30fbd883b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:50.321247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f18ff-e303-4412-bfc6-6f30fbd883b3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:50.323879 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31628e-a068-4a9d-8397-f4e16c1225d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:50.324581 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31628e-a068-4a9d-8397-f4e16c1225d4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:50.324863 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31628e-a068-4a9d-8397-f4e16c1225d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:50.325137 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31628e-a068-4a9d-8397-f4e16c1225d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:50.325834 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31628e-a068-4a9d-8397-f4e16c1225d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:50.326136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31628e-a068-4a9d-8397-f4e16c1225d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:50.327462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31628e-a068-4a9d-8397-f4e16c1225d4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:50.333720 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 324/654] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:50.334499 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f18ff-e303-4412-bfc6-6f30fbd883b3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:50.343465 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 331/655] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:50.344785 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539c4de-2552-41e8-aa36-dff6880b33af None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:50.345071 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539c4de-2552-41e8-aa36-dff6880b33af None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:50.345344 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539c4de-2552-41e8-aa36-dff6880b33af None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:50.346695 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 332/656] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:50.347290 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539c4de-2552-41e8-aa36-dff6880b33af None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:50.425188 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:50.435208 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f18ff-e303-4412-bfc6-6f30fbd883b3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:50.448273 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539c4de-2552-41e8-aa36-dff6880b33af None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:50.456926 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:50.467996 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01919e5f-1a4f-4282-8e39-2133499e80a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:50.468688 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01919e5f-1a4f-4282-8e39-2133499e80a7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:50.468970 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01919e5f-1a4f-4282-8e39-2133499e80a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:50.469245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01919e5f-1a4f-4282-8e39-2133499e80a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:50.469956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01919e5f-1a4f-4282-8e39-2133499e80a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:50.470265 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01919e5f-1a4f-4282-8e39-2133499e80a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:50.471640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01919e5f-1a4f-4282-8e39-2133499e80a7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:50.482095 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3c521-423a-4f97-ab02-9ae0dd2c5950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:50.482735 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3c521-423a-4f97-ab02-9ae0dd2c5950 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:50.483014 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3c521-423a-4f97-ab02-9ae0dd2c5950 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:50.483280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 325/657] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:50.483386 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3c521-423a-4f97-ab02-9ae0dd2c5950 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:50.484050 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01919e5f-1a4f-4282-8e39-2133499e80a7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:50.549980 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3c521-423a-4f97-ab02-9ae0dd2c5950 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:50.551347 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3c521-423a-4f97-ab02-9ae0dd2c5950 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:50.582400 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01919e5f-1a4f-4282-8e39-2133499e80a7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:50.617041 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cacc3-f308-40f8-be36-bebce3af2028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:50.617820 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cacc3-f308-40f8-be36-bebce3af2028 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:50.618113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cacc3-f308-40f8-be36-bebce3af2028 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:50.618394 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cacc3-f308-40f8-be36-bebce3af2028 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:50.624971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06cacc3-f308-40f8-be36-bebce3af2028 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:50.626417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06cacc3-f308-40f8-be36-bebce3af2028 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:50.640540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-d06cacc3-f308-40f8-be36-bebce3af2028 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:50.640540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:50.640540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:50.640540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:50.640540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:50.640540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:50.640540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:50.640540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:50.640540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:50.640540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:50.640540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:50.640540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:50.640540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:27:50.640540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:27:50.640540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:27:50.641583 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:27:50.641583 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:50.641583 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:50.641583 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:50.641583 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:50.641583 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:50.641583 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:50.641583 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:50.641583 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:50.641583 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:50.641583 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:50.641583 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:50.641583 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:50.641583 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:50.641583 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:50.641583 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:50.641583 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:50.642554 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:27:50.642554 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:27:50.642554 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:27:50.642554 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:27:50.642554 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:27:50.642554 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:27:50.642554 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:50.642554 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:50.642554 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 326/658] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:27:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:50.642554 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cacc3-f308-40f8-be36-bebce3af2028 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:50.658382 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 333/659] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:27:50.658382 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f398f3c-d46c-432f-bb34-539db033be99 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:50.658382 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f398f3c-d46c-432f-bb34-539db033be99 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:50.658382 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f398f3c-d46c-432f-bb34-539db033be99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:50.658912 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:50.672489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-4f398f3c-d46c-432f-bb34-539db033be99 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:50.673700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4f398f3c-d46c-432f-bb34-539db033be99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:50.675623 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:50.739119 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 334/660] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:50.739930 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f398f3c-d46c-432f-bb34-539db033be99 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:50.741268 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cacc3-f308-40f8-be36-bebce3af2028 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:50.776249 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a11a88-5bc5-4231-abb2-2ed89a0dda93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:50.777065 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a11a88-5bc5-4231-abb2-2ed89a0dda93 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:50.777381 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a11a88-5bc5-4231-abb2-2ed89a0dda93 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:50.777661 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a11a88-5bc5-4231-abb2-2ed89a0dda93 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:50.784599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a11a88-5bc5-4231-abb2-2ed89a0dda93 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:50.786036 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a11a88-5bc5-4231-abb2-2ed89a0dda93 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:50.800271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-09a11a88-5bc5-4231-abb2-2ed89a0dda93 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 10:27:50.800271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:50.800271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:50.800271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:50.800271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:50.800271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:50.800271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:50.800271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:50.800271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:50.800271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:50.800271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:50.800271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:50.800271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:27:50.800271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:27:50.800271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:27:50.800271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:27:50.801305 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:50.801305 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:50.801305 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:27:50.801305 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:50.801305 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:27:50.801305 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:50.801305 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:50.801305 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:50.801305 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:50.801305 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:50.801305 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:50.801305 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:50.801305 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:50.801305 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:50.801305 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:50.801305 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:50.801305 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:50.801305 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:50.802321 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:50.802321 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:50.802321 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:27:50.802321 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:27:50.802321 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:27:50.802321 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:27:50.802321 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:27:50.802321 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:27:50.802321 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 10:27:50.802321 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:50.805846 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 327/661] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 30 10:27:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:50.806614 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a11a88-5bc5-4231-abb2-2ed89a0dda93 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:50.842939 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f398f3c-d46c-432f-bb34-539db033be99 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:50.875625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba59fe-a496-4bfe-96c1-7dafacd66598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:50.876410 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba59fe-a496-4bfe-96c1-7dafacd66598 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:50.876724 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba59fe-a496-4bfe-96c1-7dafacd66598 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:50.876880 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:50.877024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba59fe-a496-4bfe-96c1-7dafacd66598 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:50.884132 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba59fe-a496-4bfe-96c1-7dafacd66598 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:50.885610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba59fe-a496-4bfe-96c1-7dafacd66598 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:50.887928 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:50.901287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-27ba59fe-a496-4bfe-96c1-7dafacd66598 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:50.901287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:50.901287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:50.901287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:50.901287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:50.901287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:50.901287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:50.901287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:50.901287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:50.901287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:50.901287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:50.901287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:50.901287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:27:50.901287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:27:50.901287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:27:50.902276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:27:50.902276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:50.902276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:50.902276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:50.902276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:50.902276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:50.902276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:50.902276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:50.902276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:50.902276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:50.902276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:50.902276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:50.902276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:50.902276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:50.902276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:50.902276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:50.902276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:50.903189 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:27:50.903189 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:27:50.903189 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:27:50.903189 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:27:50.903189 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:27:50.903189 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:27:50.903189 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:50.903189 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:50.903189 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 335/662] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:27:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:50.903752 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba59fe-a496-4bfe-96c1-7dafacd66598 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:50.912684 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a11a88-5bc5-4231-abb2-2ed89a0dda93 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:50.945924 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c02b3a-7bce-4649-b161-0d742f0ff3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:50.946580 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c02b3a-7bce-4649-b161-0d742f0ff3ae None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:50.946847 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c02b3a-7bce-4649-b161-0d742f0ff3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:50.947130 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c02b3a-7bce-4649-b161-0d742f0ff3ae None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:50.947905 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c02b3a-7bce-4649-b161-0d742f0ff3ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:50.948212 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c02b3a-7bce-4649-b161-0d742f0ff3ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:50.949701 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c02b3a-7bce-4649-b161-0d742f0ff3ae None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:50.966173 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 328/663] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:27:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:50.966173 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c02b3a-7bce-4649-b161-0d742f0ff3ae None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:51.007427 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba59fe-a496-4bfe-96c1-7dafacd66598 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:51.039741 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9f98a-3ace-456a-a412-a666ddf59d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:51.040525 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9f98a-3ace-456a-a412-a666ddf59d9d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:51.040817 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9f98a-3ace-456a-a412-a666ddf59d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:51.041085 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9f98a-3ace-456a-a412-a666ddf59d9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:51.051982 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9f98a-3ace-456a-a412-a666ddf59d9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:51.053381 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9f98a-3ace-456a-a412-a666ddf59d9d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:51.060044 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c02b3a-7bce-4649-b161-0d742f0ff3ae None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:51.070547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-6ee9f98a-3ace-456a-a412-a666ddf59d9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:51.070547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:51.070547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:51.070547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:51.070547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:51.070547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:51.070547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:51.070547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:51.070547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:51.070547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:51.070547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:51.070547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:51.070547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:51.070547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:51.070547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:51.071632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:51.071632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:51.071632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:51.071632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:51.071632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:51.071632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:51.071632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:51.071632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:51.071632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:51.071632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:51.071632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:51.071632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:51.071632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:51.071632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:51.071632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:51.071632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:51.071632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:51.072807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:51.072807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:51.072807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:51.072807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:51.072807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 336/664] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:51.072807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9f98a-3ace-456a-a412-a666ddf59d9d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:51.092031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:51.097587 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227c980-dae8-4f9c-a7cf-481a69f6bf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:51.098372 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227c980-dae8-4f9c-a7cf-481a69f6bf96 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:51.098660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227c980-dae8-4f9c-a7cf-481a69f6bf96 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:51.099205 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227c980-dae8-4f9c-a7cf-481a69f6bf96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:51.110125 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227c980-dae8-4f9c-a7cf-481a69f6bf96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:51.117760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-9227c980-dae8-4f9c-a7cf-481a69f6bf96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:51.117760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:51.117760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:51.117760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:51.117760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:51.117760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:51.117760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:51.117760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:51.117760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:51.117760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:51.117760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:51.117760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:51.117760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:51.117760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:51.117760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:51.117760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:51.118910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:51.118910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:51.118910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:51.118910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:51.118910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:51.118910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:51.118910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:51.118910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:51.118910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:51.118910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:51.118910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:51.118910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:51.118910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:51.118910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:51.118910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:51.118910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:51.119949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:51.119949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:51.119949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:51.119949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:51.119949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:51.119949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:51.119949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:51.119949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:51.119949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:51.119949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:51.119949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:51.119949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:51.122191 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 329/665] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 30 10:27:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:51.122999 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227c980-dae8-4f9c-a7cf-481a69f6bf96 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:51.125857 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:51.174130 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9f98a-3ace-456a-a412-a666ddf59d9d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:51.206571 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd232c2-1985-4ae9-8d03-9f7e8488d86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:51.207246 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd232c2-1985-4ae9-8d03-9f7e8488d86a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:51.207511 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd232c2-1985-4ae9-8d03-9f7e8488d86a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:51.207788 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd232c2-1985-4ae9-8d03-9f7e8488d86a None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:51.208640 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd232c2-1985-4ae9-8d03-9f7e8488d86a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:51.208954 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd232c2-1985-4ae9-8d03-9f7e8488d86a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:51.210380 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd232c2-1985-4ae9-8d03-9f7e8488d86a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:51.220972 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227c980-dae8-4f9c-a7cf-481a69f6bf96 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:51.227403 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 337/666] 10.222.0.59 () {56 vars in 1139 bytes} [Thu Jun 30 10:27:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:51.228194 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd232c2-1985-4ae9-8d03-9f7e8488d86a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:51.254815 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462c0e9-62ef-469a-9448-b72534eeaa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:51.255465 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462c0e9-62ef-469a-9448-b72534eeaa6e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:51.255739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462c0e9-62ef-469a-9448-b72534eeaa6e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:51.256011 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462c0e9-62ef-469a-9448-b72534eeaa6e None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:51.256816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462c0e9-62ef-469a-9448-b72534eeaa6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:51.257123 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462c0e9-62ef-469a-9448-b72534eeaa6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:51.258545 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462c0e9-62ef-469a-9448-b72534eeaa6e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:51.270501 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 330/667] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:27:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:51.271291 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462c0e9-62ef-469a-9448-b72534eeaa6e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:51.325509 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:51.334000 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd232c2-1985-4ae9-8d03-9f7e8488d86a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:51.343838 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:51.368526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35752b3c-5f49-47f7-8db3-0276d9e45181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:51.369195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35752b3c-5f49-47f7-8db3-0276d9e45181 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:51.369478 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35752b3c-5f49-47f7-8db3-0276d9e45181 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:51.369762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35752b3c-5f49-47f7-8db3-0276d9e45181 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:51.370568 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35752b3c-5f49-47f7-8db3-0276d9e45181 None admin] RBAC: Adding query filter params (role.id=1c667697d38a434fbb99c61bc846c4a5, scope.project.id=423854cc8f524ecb8d740d1cb0053856, user.id=2522b8560d224aa1a973207a79ce6a99) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:51.371377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35752b3c-5f49-47f7-8db3-0276d9e45181 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:51.372831 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35752b3c-5f49-47f7-8db3-0276d9e45181 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:51.373030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462c0e9-62ef-469a-9448-b72534eeaa6e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:51.378597 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 338/668] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:27:51 2022] GET /identity/v3/role_assignments?user.id=2522b8560d224aa1a973207a79ce6a99&scope.project.id=423854cc8f524ecb8d740d1cb0053856&role.id=1c667697d38a434fbb99c61bc846c4a5 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:51.379647 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35752b3c-5f49-47f7-8db3-0276d9e45181 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:51.427167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce683d63-1f50-4469-a7dc-b20185ad75a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:51.427874 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce683d63-1f50-4469-a7dc-b20185ad75a7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:51.428174 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce683d63-1f50-4469-a7dc-b20185ad75a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:51.428439 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce683d63-1f50-4469-a7dc-b20185ad75a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:51.429519 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce683d63-1f50-4469-a7dc-b20185ad75a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:51.429696 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce683d63-1f50-4469-a7dc-b20185ad75a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:51.431246 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce683d63-1f50-4469-a7dc-b20185ad75a7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:51.449894 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 331/669] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:51.449894 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce683d63-1f50-4469-a7dc-b20185ad75a7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:51.499607 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35752b3c-5f49-47f7-8db3-0276d9e45181 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:51.540612 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e47f5-951d-44fb-aeae-b7ec363c76cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:51.541292 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e47f5-951d-44fb-aeae-b7ec363c76cc None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:51.541569 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e47f5-951d-44fb-aeae-b7ec363c76cc None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:51.541848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e47f5-951d-44fb-aeae-b7ec363c76cc None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:51.542893 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e47f5-951d-44fb-aeae-b7ec363c76cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:51.542893 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e47f5-951d-44fb-aeae-b7ec363c76cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:51.544284 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e47f5-951d-44fb-aeae-b7ec363c76cc None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:51.557298 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 339/670] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 30 10:27:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:51.557298 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e47f5-951d-44fb-aeae-b7ec363c76cc None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:51.568713 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce683d63-1f50-4469-a7dc-b20185ad75a7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:51.585111 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:51.593609 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:51.612816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb412f-8231-4758-92ac-51577196dd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:51.613718 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb412f-8231-4758-92ac-51577196dd92 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:51.614008 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb412f-8231-4758-92ac-51577196dd92 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:51.614291 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb412f-8231-4758-92ac-51577196dd92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:51.662601 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e47f5-951d-44fb-aeae-b7ec363c76cc None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:51.690502 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb412f-8231-4758-92ac-51577196dd92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:51.691964 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb412f-8231-4758-92ac-51577196dd92 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:51.697219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f925bd-5b4a-4778-bc2d-9b35bbc3d9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:51.697877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f925bd-5b4a-4778-bc2d-9b35bbc3d9af None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:51.698162 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f925bd-5b4a-4778-bc2d-9b35bbc3d9af None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:51.698441 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f925bd-5b4a-4778-bc2d-9b35bbc3d9af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:51.699766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f925bd-5b4a-4778-bc2d-9b35bbc3d9af None admin] RBAC: Adding query filter params (role.id=1c667697d38a434fbb99c61bc846c4a5, scope.project.id=423854cc8f524ecb8d740d1cb0053856, user.id=1bfd036d747241d9bc314b60bf8648b6) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:51.700079 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f925bd-5b4a-4778-bc2d-9b35bbc3d9af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:51.701528 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f925bd-5b4a-4778-bc2d-9b35bbc3d9af None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:51.707762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 340/671] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:27:51 2022] GET /identity/v3/role_assignments?user.id=1bfd036d747241d9bc314b60bf8648b6&scope.project.id=423854cc8f524ecb8d740d1cb0053856&role.id=1c667697d38a434fbb99c61bc846c4a5 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:51.708366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f925bd-5b4a-4778-bc2d-9b35bbc3d9af None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:51.806765 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 332/672] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:27:51.806765 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb412f-8231-4758-92ac-51577196dd92 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:51.832654 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:51.837885 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f925bd-5b4a-4778-bc2d-9b35bbc3d9af None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:51.852960 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:51.878930 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b32a9f-6e71-4012-9984-1c8684720696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:51.879726 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b32a9f-6e71-4012-9984-1c8684720696 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:51.880008 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b32a9f-6e71-4012-9984-1c8684720696 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:51.880281 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b32a9f-6e71-4012-9984-1c8684720696 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:51.891323 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b32a9f-6e71-4012-9984-1c8684720696 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:51.892904 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b32a9f-6e71-4012-9984-1c8684720696 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:51.910272 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-a7b32a9f-6e71-4012-9984-1c8684720696 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:51.910272 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:51.910272 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:51.910272 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:51.910272 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:51.910272 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:51.910272 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:51.910272 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:51.910272 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:51.910272 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:51.910272 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:51.910272 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:51.910272 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:27:51.910272 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:27:51.910272 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:27:51.911429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:27:51.911429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:51.911429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:51.911429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:51.911429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:51.911429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:51.911429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:51.911429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:51.911429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:51.911429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:51.911429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:51.911429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:51.911429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:51.911429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:51.911429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:51.911429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:51.911429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:51.912406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:27:51.912406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:27:51.912406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:27:51.912406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:27:51.912406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:27:51.912406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:27:51.912406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:51.912406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:51.912406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 341/673] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:27:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:51.912931 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b32a9f-6e71-4012-9984-1c8684720696 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:51.931062 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb412f-8231-4758-92ac-51577196dd92 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:51.975071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c70084-9ef6-40d5-8d97-477589542ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:51.975865 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c70084-9ef6-40d5-8d97-477589542ace None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:51.976148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c70084-9ef6-40d5-8d97-477589542ace None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:51.976432 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c70084-9ef6-40d5-8d97-477589542ace None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:51.988084 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c70084-9ef6-40d5-8d97-477589542ace None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:51.989577 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c70084-9ef6-40d5-8d97-477589542ace None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:52.008316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-f4c70084-9ef6-40d5-8d97-477589542ace None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:52.008316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:52.008316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:52.008316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:52.008316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:52.008316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:52.008316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:52.008316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:52.008316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:52.008316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:52.008316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:52.008316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:52.008316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:52.008316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:52.008316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:52.009422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:52.009422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:52.009422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:52.009422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:52.009422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:52.009422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:52.009422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:52.009422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:52.009422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:52.009422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:52.009422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:52.009422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:52.009422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:52.009422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:52.009422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:52.009422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:52.009422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:52.010451 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:52.010451 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:52.010451 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:52.010451 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:52.010714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 333/674] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:52.011458 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c70084-9ef6-40d5-8d97-477589542ace None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:52.053097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b32a9f-6e71-4012-9984-1c8684720696 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:52.078405 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:52.102880 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80416324-9aee-4dee-a60b-56ca25fe9c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:52.103858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80416324-9aee-4dee-a60b-56ca25fe9c41 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:52.104140 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80416324-9aee-4dee-a60b-56ca25fe9c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:52.104415 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80416324-9aee-4dee-a60b-56ca25fe9c41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:52.122407 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c70084-9ef6-40d5-8d97-477589542ace None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:52.126284 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80416324-9aee-4dee-a60b-56ca25fe9c41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:52.128614 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80416324-9aee-4dee-a60b-56ca25fe9c41 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:52.157432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-80416324-9aee-4dee-a60b-56ca25fe9c41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:52.157432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:52.157432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:52.157432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:52.157432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:52.157432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:52.157432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:52.157432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:52.157432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:52.157432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:52.157432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:52.157432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:52.157432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:52.157432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:52.157432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:52.158391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:52.158391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:52.158391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:52.158391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:52.158391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:52.158391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:52.158391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:52.158391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:52.158391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:52.158391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:52.158391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:52.158391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:52.158391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:52.158391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:52.158391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:52.158391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:52.158391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:52.159309 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:52.159309 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:52.159309 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:52.159309 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:52.159309 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 342/675] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:52.160029 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80416324-9aee-4dee-a60b-56ca25fe9c41 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:52.170615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97854b-f56a-4d8c-aabd-eac9523df0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:52.172430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97854b-f56a-4d8c-aabd-eac9523df0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:52.172956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97854b-f56a-4d8c-aabd-eac9523df0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:52.173449 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97854b-f56a-4d8c-aabd-eac9523df0e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:52.174893 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97854b-f56a-4d8c-aabd-eac9523df0e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:52.175752 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:52.176296 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97854b-f56a-4d8c-aabd-eac9523df0e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:52.178935 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97854b-f56a-4d8c-aabd-eac9523df0e6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:52.195811 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 334/676] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:27:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:52.197078 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97854b-f56a-4d8c-aabd-eac9523df0e6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:52.284938 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80416324-9aee-4dee-a60b-56ca25fe9c41 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:52.320927 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f60f37-f833-46dc-b591-e54035fbbbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:52.321670 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f60f37-f833-46dc-b591-e54035fbbbe9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:52.321856 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f60f37-f833-46dc-b591-e54035fbbbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:52.322137 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f60f37-f833-46dc-b591-e54035fbbbe9 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:52.322847 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f60f37-f833-46dc-b591-e54035fbbbe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:52.323155 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f60f37-f833-46dc-b591-e54035fbbbe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:52.324624 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f60f37-f833-46dc-b591-e54035fbbbe9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:52.337044 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 343/677] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:52.337932 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f60f37-f833-46dc-b591-e54035fbbbe9 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:52.343653 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97854b-f56a-4d8c-aabd-eac9523df0e6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:52.378289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:52.394402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e402447-d244-49c2-8f46-ee4560b22280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:52.396323 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e402447-d244-49c2-8f46-ee4560b22280 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:52.396853 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e402447-d244-49c2-8f46-ee4560b22280 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:52.397615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e402447-d244-49c2-8f46-ee4560b22280 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:52.398962 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e402447-d244-49c2-8f46-ee4560b22280 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:52.399482 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e402447-d244-49c2-8f46-ee4560b22280 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:52.401657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e402447-d244-49c2-8f46-ee4560b22280 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:52.423403 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 335/678] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:52.425209 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:52.425328 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e402447-d244-49c2-8f46-ee4560b22280 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:52.481981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f60f37-f833-46dc-b591-e54035fbbbe9 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:52.538608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3667cf4-187d-4418-ae71-19a1164897b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:52.539363 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3667cf4-187d-4418-ae71-19a1164897b0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:52.539586 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3667cf4-187d-4418-ae71-19a1164897b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:52.539870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3667cf4-187d-4418-ae71-19a1164897b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:52.540724 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3667cf4-187d-4418-ae71-19a1164897b0 None admin] RBAC: Adding query filter params (role.id=1c667697d38a434fbb99c61bc846c4a5, scope.project.id=423854cc8f524ecb8d740d1cb0053856, user.id=afb7ea0cfb9c423799848b912724cd75) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:52.541037 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3667cf4-187d-4418-ae71-19a1164897b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:52.542471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3667cf4-187d-4418-ae71-19a1164897b0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:52.560860 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 344/679] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:27:52 2022] GET /identity/v3/role_assignments?user.id=afb7ea0cfb9c423799848b912724cd75&scope.project.id=423854cc8f524ecb8d740d1cb0053856&role.id=1c667697d38a434fbb99c61bc846c4a5 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:52.561912 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3667cf4-187d-4418-ae71-19a1164897b0 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:52.635272 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e402447-d244-49c2-8f46-ee4560b22280 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:52.725564 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e77be4-c168-4bdf-b006-52d1ee26bd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:52.729349 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e77be4-c168-4bdf-b006-52d1ee26bd98 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:52.730366 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e77be4-c168-4bdf-b006-52d1ee26bd98 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:52.731304 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e77be4-c168-4bdf-b006-52d1ee26bd98 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:52.750528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e77be4-c168-4bdf-b006-52d1ee26bd98 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:52.756404 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e77be4-c168-4bdf-b006-52d1ee26bd98 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:52.796373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-d1e77be4-c168-4bdf-b006-52d1ee26bd98 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:27:52.796373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:52.796373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:52.796373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:52.796373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:52.796373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:52.796373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:52.796373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:52.796373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:52.796373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:52.796373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:52.796373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:52.796373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:27:52.796373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:27:52.796373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:27:52.796373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:27:52.797419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:52.797419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:52.797419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:27:52.797419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:52.797419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:27:52.797419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:52.797419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:52.797419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:52.797419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:52.797419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:52.797419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:52.797419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:52.797419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:52.797419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:52.797419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:52.797419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:52.797419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:52.797419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:52.798364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:52.798364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:52.798364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:27:52.798364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:27:52.798364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:27:52.798364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:27:52.798364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:27:52.798364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:27:52.798364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:27:52.798364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:52.803152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 336/680] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:27:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:52.810830 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e77be4-c168-4bdf-b006-52d1ee26bd98 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:52.851823 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3667cf4-187d-4418-ae71-19a1164897b0 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:52.894323 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:52.931761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5ca5d-2c21-4fc2-b254-042b18e87cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:52.931761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5ca5d-2c21-4fc2-b254-042b18e87cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:52.931761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5ca5d-2c21-4fc2-b254-042b18e87cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:52.931761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5ca5d-2c21-4fc2-b254-042b18e87cd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:52.935446 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:52.951116 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5ca5d-2c21-4fc2-b254-042b18e87cd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:52.952613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5ca5d-2c21-4fc2-b254-042b18e87cd2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:52.967472 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e77be4-c168-4bdf-b006-52d1ee26bd98 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:52.994442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-52b5ca5d-2c21-4fc2-b254-042b18e87cd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:52.994442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:52.994442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:52.994442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:52.994442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:52.994442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:52.994442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:52.994442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:52.994442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:52.994442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:52.994442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:52.994442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:52.994442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:27:52.994442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:27:52.994442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:27:52.995499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:27:52.995499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:52.995499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:52.995499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:52.995499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:52.995499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:52.995499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:52.995499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:52.995499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:52.995499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:52.995499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:52.995499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:52.995499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:52.995499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:52.995499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:52.995499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:52.995499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:52.996966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:27:52.996966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:27:52.996966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:27:52.996966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:27:52.996966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:27:52.996966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:27:52.996966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:52.996966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:53.001461 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 345/681] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:27:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 434 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:53.002285 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5ca5d-2c21-4fc2-b254-042b18e87cd2 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:53.027202 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d71ea-50a2-4bfa-81f2-83f4f8e4e11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:53.027867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d71ea-50a2-4bfa-81f2-83f4f8e4e11d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:53.029225 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d71ea-50a2-4bfa-81f2-83f4f8e4e11d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:53.029225 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d71ea-50a2-4bfa-81f2-83f4f8e4e11d None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:53.030556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d71ea-50a2-4bfa-81f2-83f4f8e4e11d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:53.036212 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d71ea-50a2-4bfa-81f2-83f4f8e4e11d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:53.037631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d71ea-50a2-4bfa-81f2-83f4f8e4e11d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:53.093059 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 337/682] 10.222.0.59 () {56 vars in 1135 bytes} [Thu Jun 30 10:27:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:53.101023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d71ea-50a2-4bfa-81f2-83f4f8e4e11d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:53.236716 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5ca5d-2c21-4fc2-b254-042b18e87cd2 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:53.257731 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d71ea-50a2-4bfa-81f2-83f4f8e4e11d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:53.259160 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:53.306487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab400c-0cd9-4a1e-b750-6215adc795d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:53.307149 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab400c-0cd9-4a1e-b750-6215adc795d6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:53.307427 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab400c-0cd9-4a1e-b750-6215adc795d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:53.307701 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab400c-0cd9-4a1e-b750-6215adc795d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:53.308590 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab400c-0cd9-4a1e-b750-6215adc795d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:53.308903 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab400c-0cd9-4a1e-b750-6215adc795d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:53.310316 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab400c-0cd9-4a1e-b750-6215adc795d6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:53.324632 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a876a-9646-4335-9310-028ccfcd6ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:53.325348 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a876a-9646-4335-9310-028ccfcd6ffd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:53.325629 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a876a-9646-4335-9310-028ccfcd6ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:53.325903 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a876a-9646-4335-9310-028ccfcd6ffd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:53.338402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 346/683] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:27:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:53.341036 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab400c-0cd9-4a1e-b750-6215adc795d6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:53.448871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:53.466144 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a876a-9646-4335-9310-028ccfcd6ffd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:53.467625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a876a-9646-4335-9310-028ccfcd6ffd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:53.492281 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab400c-0cd9-4a1e-b750-6215adc795d6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:53.530345 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c8922-e9ca-44f3-b3d5-12fb68130273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:53.531170 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c8922-e9ca-44f3-b3d5-12fb68130273 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:53.531559 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c8922-e9ca-44f3-b3d5-12fb68130273 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:53.531938 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c8922-e9ca-44f3-b3d5-12fb68130273 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:53.533214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c8922-e9ca-44f3-b3d5-12fb68130273 None admin] RBAC: Adding query filter params (role.id=1c667697d38a434fbb99c61bc846c4a5, scope.project.id=423854cc8f524ecb8d740d1cb0053856, user.id=fa8cb52425ba42d9ae3576e6fb18dc88) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:53.533685 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c8922-e9ca-44f3-b3d5-12fb68130273 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:53.535449 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c8922-e9ca-44f3-b3d5-12fb68130273 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:53.542639 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 347/684] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:27:53 2022] GET /identity/v3/role_assignments?user.id=fa8cb52425ba42d9ae3576e6fb18dc88&scope.project.id=423854cc8f524ecb8d740d1cb0053856&role.id=1c667697d38a434fbb99c61bc846c4a5 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:53.627552 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 338/685] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:27:53.632950 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c8922-e9ca-44f3-b3d5-12fb68130273 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:53.657664 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7720c4f-49bd-4f75-a355-9909221891e4 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:53.657992 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7720c4f-49bd-4f75-a355-9909221891e4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:53.658236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7720c4f-49bd-4f75-a355-9909221891e4 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:53.659882 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 339/686] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:53.665532 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85966411-d9e6-430c-b81c-4c8fd689551e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:53.665830 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85966411-d9e6-430c-b81c-4c8fd689551e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:53.666115 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85966411-d9e6-430c-b81c-4c8fd689551e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:53.694559 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:53.717577 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-85966411-d9e6-430c-b81c-4c8fd689551e None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:53.718800 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-85966411-d9e6-430c-b81c-4c8fd689551e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:53.765050 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c8922-e9ca-44f3-b3d5-12fb68130273 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:53.788913 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:53.806730 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811894c-767c-4db2-8dc8-110a43de1dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:53.807535 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811894c-767c-4db2-8dc8-110a43de1dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:53.808115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811894c-767c-4db2-8dc8-110a43de1dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:53.808981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811894c-767c-4db2-8dc8-110a43de1dd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:53.816080 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 340/687] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:27:53.829197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811894c-767c-4db2-8dc8-110a43de1dd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:53.830724 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811894c-767c-4db2-8dc8-110a43de1dd9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:53.845653 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85966411-d9e6-430c-b81c-4c8fd689551e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:53.860629 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-f811894c-767c-4db2-8dc8-110a43de1dd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:53.860629 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:53.860629 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:53.860629 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:53.860629 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:53.860629 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:53.860629 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:53.860629 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:53.860629 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:53.860629 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:53.860629 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:53.860629 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:53.860629 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:53.860629 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:53.860629 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:53.861536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:53.861536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:53.861536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:53.861536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:53.861536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:53.861536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:53.861536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:53.861536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:53.861536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:53.861536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:53.861536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:53.861536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:53.861536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:53.861536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:53.861536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:53.861536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:53.861536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:53.862451 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:53.862451 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:53.862451 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:53.862451 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:53.864967 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 348/688] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:53.871659 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811894c-767c-4db2-8dc8-110a43de1dd9 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:53.965308 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85966411-d9e6-430c-b81c-4c8fd689551e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:53.978113 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811894c-767c-4db2-8dc8-110a43de1dd9 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:54.020176 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:54.030397 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64fb80-7e7d-4c41-b5f4-d98f201b6b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:54.031223 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50f0d0-d0d1-4cfc-8e0a-47f6dc15bb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:54.032935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50f0d0-d0d1-4cfc-8e0a-47f6dc15bb7a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:54.033094 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64fb80-7e7d-4c41-b5f4-d98f201b6b7a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:54.033531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64fb80-7e7d-4c41-b5f4-d98f201b6b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:54.033960 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64fb80-7e7d-4c41-b5f4-d98f201b6b7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:54.034379 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50f0d0-d0d1-4cfc-8e0a-47f6dc15bb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:54.035343 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50f0d0-d0d1-4cfc-8e0a-47f6dc15bb7a None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:54.036200 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50f0d0-d0d1-4cfc-8e0a-47f6dc15bb7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:54.036848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50f0d0-d0d1-4cfc-8e0a-47f6dc15bb7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:54.039407 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50f0d0-d0d1-4cfc-8e0a-47f6dc15bb7a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:54.059153 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64fb80-7e7d-4c41-b5f4-d98f201b6b7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:54.060925 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64fb80-7e7d-4c41-b5f4-d98f201b6b7a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:54.065319 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 349/689] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:54.071719 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50f0d0-d0d1-4cfc-8e0a-47f6dc15bb7a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:54.088270 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-4d64fb80-7e7d-4c41-b5f4-d98f201b6b7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:54.088270 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:54.088270 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:54.088270 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:54.088270 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:54.088270 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:54.088270 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:54.088270 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:54.088270 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:54.088270 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:54.088270 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:54.088270 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:54.088270 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:54.088270 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:54.088270 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:54.089261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:54.089261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:54.089261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:54.089261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:54.089261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:54.089261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:54.089261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:54.089261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:54.089261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:54.089261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:54.089261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:54.089261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:54.089261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:54.089261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:54.089261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:54.089261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:54.089261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:54.090197 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:54.090197 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:54.090197 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:54.090197 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:54.097973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 341/690] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:27:54.105080 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64fb80-7e7d-4c41-b5f4-d98f201b6b7a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:54.124895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:54.187196 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50f0d0-d0d1-4cfc-8e0a-47f6dc15bb7a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:54.224752 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60c729-4cec-48ac-87c1-a9475239097b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:54.226068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60c729-4cec-48ac-87c1-a9475239097b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:54.226611 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60c729-4cec-48ac-87c1-a9475239097b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:54.227099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60c729-4cec-48ac-87c1-a9475239097b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:54.235071 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60c729-4cec-48ac-87c1-a9475239097b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:54.236860 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60c729-4cec-48ac-87c1-a9475239097b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:54.253966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-1b60c729-4cec-48ac-87c1-a9475239097b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:54.253966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:54.253966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:54.253966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:54.253966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:54.253966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:54.253966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:54.253966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:54.253966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:54.253966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:54.253966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:54.253966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:54.253966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:27:54.253966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:27:54.253966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:27:54.254867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:27:54.254867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:54.254867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:54.254867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:54.254867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:54.254867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:54.254867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:54.254867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:54.254867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:54.254867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:54.254867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:54.254867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:54.254867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:54.254867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:54.254867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:54.254867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:54.254867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:54.255776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:27:54.255776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:27:54.255776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:27:54.255776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:27:54.255776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:27:54.255776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:27:54.255776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:54.255776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:54.258460 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 350/691] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:27:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:54.260002 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab4b54-9e0c-4f0c-9e8e-55bd828c125c None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:54.260559 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab4b54-9e0c-4f0c-9e8e-55bd828c125c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:54.261037 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab4b54-9e0c-4f0c-9e8e-55bd828c125c None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:54.263496 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 351/692] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:54.264392 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab4b54-9e0c-4f0c-9e8e-55bd828c125c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:54.283682 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64fb80-7e7d-4c41-b5f4-d98f201b6b7a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:54.325589 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1dd60-3faa-4996-ad59-ec3171127803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:54.326729 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1dd60-3faa-4996-ad59-ec3171127803 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:54.327020 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1dd60-3faa-4996-ad59-ec3171127803 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:54.327299 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1dd60-3faa-4996-ad59-ec3171127803 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:54.328211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1dd60-3faa-4996-ad59-ec3171127803 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:54.328679 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1dd60-3faa-4996-ad59-ec3171127803 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:54.330282 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1dd60-3faa-4996-ad59-ec3171127803 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:54.351122 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 342/693] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:54.351420 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368716e-4472-4d37-a4f6-487ca02372fd None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:54.351824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368716e-4472-4d37-a4f6-487ca02372fd None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:54.352285 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368716e-4472-4d37-a4f6-487ca02372fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:54.372789 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4368716e-4472-4d37-a4f6-487ca02372fd None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:54.373967 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4368716e-4472-4d37-a4f6-487ca02372fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:54.380931 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:54.392127 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab4b54-9e0c-4f0c-9e8e-55bd828c125c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:54.424344 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:54.439407 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af61d7-e6ae-4034-a9bf-932315ff4afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:54.440951 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af61d7-e6ae-4034-a9bf-932315ff4afc None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:54.441741 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af61d7-e6ae-4034-a9bf-932315ff4afc None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:54.442221 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af61d7-e6ae-4034-a9bf-932315ff4afc None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:54.443930 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af61d7-e6ae-4034-a9bf-932315ff4afc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:54.444729 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af61d7-e6ae-4034-a9bf-932315ff4afc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:54.447142 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af61d7-e6ae-4034-a9bf-932315ff4afc None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:54.454783 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 343/694] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:54.455601 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368716e-4472-4d37-a4f6-487ca02372fd None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:54.466660 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 352/695] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:27:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:54.473428 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af61d7-e6ae-4034-a9bf-932315ff4afc None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:54.585353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af61d7-e6ae-4034-a9bf-932315ff4afc None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:54.593984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368716e-4472-4d37-a4f6-487ca02372fd None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:54.622574 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fca339-f007-45ee-99a5-717052e25c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:54.623225 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fca339-f007-45ee-99a5-717052e25c8b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:54.623506 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fca339-f007-45ee-99a5-717052e25c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:54.623780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fca339-f007-45ee-99a5-717052e25c8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:54.624770 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fca339-f007-45ee-99a5-717052e25c8b None admin] RBAC: Adding query filter params (role.id=1c667697d38a434fbb99c61bc846c4a5, scope.project.id=423854cc8f524ecb8d740d1cb0053856, user.id=c15327c36c8c49ac87a3b3e9ab49eea7) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:54.625157 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fca339-f007-45ee-99a5-717052e25c8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:54.626578 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fca339-f007-45ee-99a5-717052e25c8b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:54.635175 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 353/696] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:27:54 2022] GET /identity/v3/role_assignments?user.id=c15327c36c8c49ac87a3b3e9ab49eea7&scope.project.id=423854cc8f524ecb8d740d1cb0053856&role.id=1c667697d38a434fbb99c61bc846c4a5 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:54.636032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fca339-f007-45ee-99a5-717052e25c8b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:54.645235 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa12499-7d2e-44d4-ba56-18aa48aceacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:54.645921 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa12499-7d2e-44d4-ba56-18aa48aceacc None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:54.646207 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa12499-7d2e-44d4-ba56-18aa48aceacc None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:54.646486 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa12499-7d2e-44d4-ba56-18aa48aceacc None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:54.647197 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa12499-7d2e-44d4-ba56-18aa48aceacc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:54.648674 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa12499-7d2e-44d4-ba56-18aa48aceacc None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:54.653915 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:54.686442 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 344/697] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 30 10:27:54 2022] POST /identity/v3/users => generated 254 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:27:54.759063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fca339-f007-45ee-99a5-717052e25c8b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:54.798966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c2f89-05b8-4198-a17c-127a5863ea77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:54.799786 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c2f89-05b8-4198-a17c-127a5863ea77 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:54.800065 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c2f89-05b8-4198-a17c-127a5863ea77 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:54.800338 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c2f89-05b8-4198-a17c-127a5863ea77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:54.813124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c2f89-05b8-4198-a17c-127a5863ea77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:54.821067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-307c2f89-05b8-4198-a17c-127a5863ea77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:27:54.821067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:54.821067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:54.821067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:54.821067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:54.821067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:54.821067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:54.821067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:54.821067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:54.821067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:54.821067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:54.821067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:54.821067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:54.821067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:54.821067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:54.821067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:54.822068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:54.822068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:54.822068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:54.822068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:54.822068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:54.822068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:54.822068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:54.822068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:54.822068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:54.822068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:54.822068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:54.822068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:54.822068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:54.822068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:54.822068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:54.822068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:54.822911 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:54.822911 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:54.822911 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:54.822911 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:54.822911 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:54.822911 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:54.822911 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:54.822911 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:54.822911 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:54.822911 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:54.822911 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:27:54.822911 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:54.822911 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 354/698] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:27:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:54.829069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa12499-7d2e-44d4-ba56-18aa48aceacc None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:54.879276 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:54.966175 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa12499-7d2e-44d4-ba56-18aa48aceacc None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:55.005055 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959db032-ed92-43f8-ab6b-4fa3c22e9873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:55.005980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959db032-ed92-43f8-ab6b-4fa3c22e9873 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:55.006414 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959db032-ed92-43f8-ab6b-4fa3c22e9873 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:55.006857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959db032-ed92-43f8-ab6b-4fa3c22e9873 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:55.007793 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959db032-ed92-43f8-ab6b-4fa3c22e9873 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:55.008296 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959db032-ed92-43f8-ab6b-4fa3c22e9873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:55.009875 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959db032-ed92-43f8-ab6b-4fa3c22e9873 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:55.020841 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 345/699] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:55.026582 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c2f89-05b8-4198-a17c-127a5863ea77 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:55.062541 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83b44c-2ed6-42ca-86e9-6ec6036a05c5 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:55.063206 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83b44c-2ed6-42ca-86e9-6ec6036a05c5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:55.063698 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83b44c-2ed6-42ca-86e9-6ec6036a05c5 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:55.065644 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 346/700] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:55.071502 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c626ece-491f-4072-b7a9-56e6504550b2 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:55.071791 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c626ece-491f-4072-b7a9-56e6504550b2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:55.072071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c626ece-491f-4072-b7a9-56e6504550b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:55.105583 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6c626ece-491f-4072-b7a9-56e6504550b2 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:55.107147 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6c626ece-491f-4072-b7a9-56e6504550b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:55.117132 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:55.146578 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c2f89-05b8-4198-a17c-127a5863ea77 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:55.181249 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66fd21-cbec-41f1-acb7-1c0ce04cc380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:55.182420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66fd21-cbec-41f1-acb7-1c0ce04cc380 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:55.182907 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66fd21-cbec-41f1-acb7-1c0ce04cc380 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:55.183975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66fd21-cbec-41f1-acb7-1c0ce04cc380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:55.195675 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66fd21-cbec-41f1-acb7-1c0ce04cc380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:55.197507 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66fd21-cbec-41f1-acb7-1c0ce04cc380 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:55.216198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-4b66fd21-cbec-41f1-acb7-1c0ce04cc380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:55.216198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:55.216198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:55.216198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:55.216198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:55.216198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:55.216198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:55.216198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:55.216198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:55.216198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:55.216198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:55.216198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:55.216198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:55.216198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:55.216198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:55.217198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:55.217198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:55.217198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:55.217198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:55.217198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:55.217198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:55.217198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:55.217198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:55.217198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:55.217198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:55.217198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:55.217198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:55.217198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:55.217198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:55.217198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:55.217198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:55.217198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:55.218104 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:55.218104 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:55.218104 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:55.218104 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:55.220345 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 355/701] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:55.225586 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66fd21-cbec-41f1-acb7-1c0ce04cc380 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:55.247749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 347/702] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:55.289586 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c626ece-491f-4072-b7a9-56e6504550b2 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:55.331250 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:55.333175 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66fd21-cbec-41f1-acb7-1c0ce04cc380 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:55.370771 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a25c6-0db9-443b-8639-7087d67eba23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:55.372341 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a25c6-0db9-443b-8639-7087d67eba23 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:55.373073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a25c6-0db9-443b-8639-7087d67eba23 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:55.373586 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a25c6-0db9-443b-8639-7087d67eba23 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:55.374492 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a25c6-0db9-443b-8639-7087d67eba23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:55.375028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a25c6-0db9-443b-8639-7087d67eba23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:55.376616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a25c6-0db9-443b-8639-7087d67eba23 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:55.389918 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 356/703] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:55.390081 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:55.394749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a25c6-0db9-443b-8639-7087d67eba23 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:55.498727 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c626ece-491f-4072-b7a9-56e6504550b2 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:55.523418 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a25c6-0db9-443b-8639-7087d67eba23 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:55.562617 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0efb57-462a-49a8-ab14-7e76ecc7e89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:55.563777 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0efb57-462a-49a8-ab14-7e76ecc7e89f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:55.564278 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0efb57-462a-49a8-ab14-7e76ecc7e89f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:55.564781 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0efb57-462a-49a8-ab14-7e76ecc7e89f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:55.572626 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0efb57-462a-49a8-ab14-7e76ecc7e89f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:55.574295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0efb57-462a-49a8-ab14-7e76ecc7e89f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:55.589123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-be0efb57-462a-49a8-ab14-7e76ecc7e89f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:27:55.589123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:55.589123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:55.589123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:55.589123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:55.589123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:55.589123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:55.589123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:55.589123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:55.589123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:55.589123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:55.589123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:55.589123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:27:55.589123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:27:55.589123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:27:55.589123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:27:55.590625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:55.590625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:55.590625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:27:55.590625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:55.590625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:27:55.590625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:55.590625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:55.590625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:55.590625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:55.590625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:55.590625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:55.590625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:55.590625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:55.590625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:55.590625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:55.590625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:55.590625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:55.590625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:55.591575 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:55.591575 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:55.591575 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:27:55.591575 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:27:55.591575 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:27:55.591575 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:27:55.591575 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:27:55.591575 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:27:55.591575 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:27:55.591575 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:55.594254 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 357/704] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Jun 30 10:27:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:55.597102 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00ab42-dd04-443d-81f0-18688f5767de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:55.598199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00ab42-dd04-443d-81f0-18688f5767de None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:55.600082 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0efb57-462a-49a8-ab14-7e76ecc7e89f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:55.600724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00ab42-dd04-443d-81f0-18688f5767de None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:55.605873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00ab42-dd04-443d-81f0-18688f5767de None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:55.608316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00ab42-dd04-443d-81f0-18688f5767de None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:55.612179 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00ab42-dd04-443d-81f0-18688f5767de None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:55.645464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-4e00ab42-dd04-443d-81f0-18688f5767de None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 10:27:55.645464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:55.645464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:27:55.645464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:27:55.645464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:27:55.645464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:27:55.645464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:27:55.645464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:27:55.645464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 10:27:55.645464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:55.645464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:27:55.645464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:55.645464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:55.645464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:55.645464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:55.645464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:55.646510 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:55.646510 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:55.646510 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:55.646510 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:55.646510 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:55.646510 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:55.646510 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:55.646510 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:27:55.646510 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:27:55.646510 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:27:55.646510 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:27:55.646510 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:55.646510 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:55.646510 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:55.646510 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:55.646510 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:55.647364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:55.647364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:55.647364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:55.647364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:55.647364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:55.647364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:55.647364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:55.647364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:55.647364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:55.647364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:55.647364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:55.647364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:27:55.647364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:27:55.647364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 10:27:55.647364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:55.652707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 348/705] 10.222.0.59 () {56 vars in 1129 bytes} [Thu Jun 30 10:27:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:55.656098 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00ab42-dd04-443d-81f0-18688f5767de None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:55.692893 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:55.794915 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0efb57-462a-49a8-ab14-7e76ecc7e89f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:55.833392 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:55.859069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00ab42-dd04-443d-81f0-18688f5767de None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:55.879922 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8399a9-74b8-42e5-a10e-1afea2559727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:55.880637 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8399a9-74b8-42e5-a10e-1afea2559727 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:55.880925 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8399a9-74b8-42e5-a10e-1afea2559727 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:55.881204 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8399a9-74b8-42e5-a10e-1afea2559727 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:55.882042 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8399a9-74b8-42e5-a10e-1afea2559727 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:55.882355 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8399a9-74b8-42e5-a10e-1afea2559727 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:55.883902 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8399a9-74b8-42e5-a10e-1afea2559727 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:55.916710 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a61734-f2a6-4789-a840-d32745ecdc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:55.920539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a61734-f2a6-4789-a840-d32745ecdc57 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:55.921052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a61734-f2a6-4789-a840-d32745ecdc57 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:55.921531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a61734-f2a6-4789-a840-d32745ecdc57 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:55.922459 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a61734-f2a6-4789-a840-d32745ecdc57 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:55.922980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a61734-f2a6-4789-a840-d32745ecdc57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:55.924605 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a61734-f2a6-4789-a840-d32745ecdc57 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:55.932269 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 358/706] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Jun 30 10:27:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:55.934566 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 349/707] 10.222.0.59 () {56 vars in 1124 bytes} [Thu Jun 30 10:27:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:55.935945 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8399a9-74b8-42e5-a10e-1afea2559727 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:55.940527 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a61734-f2a6-4789-a840-d32745ecdc57 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:56.053584 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8399a9-74b8-42e5-a10e-1afea2559727 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:56.056357 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:56.089281 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b63ce-b49d-4562-8199-cbfa19d18624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:56.090832 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b63ce-b49d-4562-8199-cbfa19d18624 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:56.091400 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b63ce-b49d-4562-8199-cbfa19d18624 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:56.091887 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b63ce-b49d-4562-8199-cbfa19d18624 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:56.165207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b63ce-b49d-4562-8199-cbfa19d18624 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:56.168826 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b63ce-b49d-4562-8199-cbfa19d18624 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:56.210540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a61734-f2a6-4789-a840-d32745ecdc57 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:56.288006 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 359/708] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 10:27:56.289688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaca8ec-b4d8-4847-8945-5d2ff35c8c5a None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:56.290196 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaca8ec-b4d8-4847-8945-5d2ff35c8c5a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:56.290682 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaca8ec-b4d8-4847-8945-5d2ff35c8c5a None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:56.292401 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 360/709] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:56.293424 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaca8ec-b4d8-4847-8945-5d2ff35c8c5a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:56.297925 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:56.299291 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc157e25-9c83-441c-9243-9bfe75090361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:56.299959 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc157e25-9c83-441c-9243-9bfe75090361 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:56.300234 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc157e25-9c83-441c-9243-9bfe75090361 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:56.300751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc157e25-9c83-441c-9243-9bfe75090361 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:56.301248 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc157e25-9c83-441c-9243-9bfe75090361 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:56.301558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc157e25-9c83-441c-9243-9bfe75090361 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:56.302979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc157e25-9c83-441c-9243-9bfe75090361 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:56.310974 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 350/710] 10.222.0.59 () {56 vars in 1124 bytes} [Thu Jun 30 10:27:55 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:56.312607 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ad035-ad80-4446-9536-b444ee004358 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:56.312722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ad035-ad80-4446-9536-b444ee004358 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:56.312975 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ad035-ad80-4446-9536-b444ee004358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:56.331634 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-227ad035-ad80-4446-9536-b444ee004358 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:56.332955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-227ad035-ad80-4446-9536-b444ee004358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:56.344829 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:56.420359 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 351/711] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:56.447635 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ad035-ad80-4446-9536-b444ee004358 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:56.470127 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaca8ec-b4d8-4847-8945-5d2ff35c8c5a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:56.520021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe34db5-da77-4e25-8062-34580fc491a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:56.520452 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe34db5-da77-4e25-8062-34580fc491a7 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:56.520796 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe34db5-da77-4e25-8062-34580fc491a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:56.521067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe34db5-da77-4e25-8062-34580fc491a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:56.533389 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe34db5-da77-4e25-8062-34580fc491a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:56.534836 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe34db5-da77-4e25-8062-34580fc491a7 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:56.554417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-ffe34db5-da77-4e25-8062-34580fc491a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:56.554417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:56.554417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:56.554417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:56.554417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:56.554417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:56.554417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:56.554417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:56.554417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:56.554417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:56.554417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:56.554417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:56.554417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:56.554417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:56.554417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:56.555398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:56.555398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:56.555398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:56.555398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:56.555398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:56.555398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:56.555398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:56.555398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:56.555398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:56.555398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:56.555398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:56.555398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:56.555398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:56.555398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:56.555398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:56.555398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:56.555398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:56.556314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:56.556314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:56.556314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:56.556314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:56.556314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 361/712] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:56.563077 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe34db5-da77-4e25-8062-34580fc491a7 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:56.618918 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ad035-ad80-4446-9536-b444ee004358 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:56.630775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:56.656713 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22edc14f-ca46-491f-8391-b05e0bea4896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:56.657671 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edc14f-ca46-491f-8391-b05e0bea4896 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:56.658053 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edc14f-ca46-491f-8391-b05e0bea4896 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:56.658436 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edc14f-ca46-491f-8391-b05e0bea4896 None admin] PATH_INFO: `/v3/services/network` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:56.659221 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22edc14f-ca46-491f-8391-b05e0bea4896 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:56.660749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22edc14f-ca46-491f-8391-b05e0bea4896 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:56.673258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-22edc14f-ca46-491f-8391-b05e0bea4896 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 10:27:56.673258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:56.673258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:27:56.673258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:27:56.673258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:27:56.673258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:27:56.673258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:27:56.673258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:27:56.673258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 10:27:56.673258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:56.673258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:27:56.673258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:56.673258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:56.673258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:56.673258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:56.673258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:56.673258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:56.674558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:56.674558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:56.674558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:56.674558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:56.674558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:56.674558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:56.674558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:27:56.674558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:27:56.674558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:27:56.674558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:27:56.674558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:56.674558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:56.674558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:56.674558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:56.674558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:56.674558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:56.675681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:56.675681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:56.675681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:56.675681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:56.675681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:56.675681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:56.675681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:56.675681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:56.675681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:56.675681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:56.675681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:27:56.675681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:27:56.675681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 10:27:56.675681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:56.678400 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 352/713] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:27:56 2022] GET /identity/v3/services/network => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:56.688748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22edc14f-ca46-491f-8391-b05e0bea4896 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:56.693818 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe34db5-da77-4e25-8062-34580fc491a7 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:56.707059 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:56.733118 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5523e-6b9b-4491-850c-520aa3392519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:56.734081 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5523e-6b9b-4491-850c-520aa3392519 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:56.734543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5523e-6b9b-4491-850c-520aa3392519 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:56.734993 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5523e-6b9b-4491-850c-520aa3392519 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:56.735905 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5523e-6b9b-4491-850c-520aa3392519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:56.736399 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5523e-6b9b-4491-850c-520aa3392519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:56.738189 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5523e-6b9b-4491-850c-520aa3392519 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:56.751442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 362/714] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:56.757498 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5523e-6b9b-4491-850c-520aa3392519 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:56.895335 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22edc14f-ca46-491f-8391-b05e0bea4896 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:56.914227 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5523e-6b9b-4491-850c-520aa3392519 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:56.932311 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:56.953565 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd16cfe-0681-4096-a174-a6f180fa4d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:56.954700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd16cfe-0681-4096-a174-a6f180fa4d35 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:56.955178 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd16cfe-0681-4096-a174-a6f180fa4d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:56.955632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd16cfe-0681-4096-a174-a6f180fa4d35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:56.963077 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd16cfe-0681-4096-a174-a6f180fa4d35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:56.964818 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd16cfe-0681-4096-a174-a6f180fa4d35 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:56.980936 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-fdd16cfe-0681-4096-a174-a6f180fa4d35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:56.980936 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:56.980936 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:56.980936 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:56.980936 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:56.980936 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:56.980936 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:56.980936 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:56.980936 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:56.980936 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:56.980936 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:56.980936 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:56.980936 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:27:56.980936 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:27:56.980936 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:27:56.981848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:27:56.981848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:56.981848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:56.981848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:56.981848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:56.981848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:56.981848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:56.981848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:56.981848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:56.981848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:56.981848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:56.981848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:56.981848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:56.981848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:56.981848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:56.981848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:56.981848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:56.982759 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:27:56.982759 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:27:56.982759 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:27:56.982759 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:27:56.982759 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:27:56.982759 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:27:56.982759 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:27:56.982759 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:56.985126 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 363/715] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:27:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:56.987746 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64593e27-bb6d-4dab-ad56-f537d245df1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:56.988685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64593e27-bb6d-4dab-ad56-f537d245df1a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:56.989176 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64593e27-bb6d-4dab-ad56-f537d245df1a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:56.989603 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64593e27-bb6d-4dab-ad56-f537d245df1a None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:56.990571 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd16cfe-0681-4096-a174-a6f180fa4d35 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:56.992233 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64593e27-bb6d-4dab-ad56-f537d245df1a None admin] RBAC: Adding query filter params (name=network) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:56.997944 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64593e27-bb6d-4dab-ad56-f537d245df1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:57.001592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64593e27-bb6d-4dab-ad56-f537d245df1a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:57.011966 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 353/716] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 30 10:27:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:57.033998 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64593e27-bb6d-4dab-ad56-f537d245df1a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:57.130382 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd16cfe-0681-4096-a174-a6f180fa4d35 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:57.168553 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06119767-7c6f-428f-a2fe-6b830bc0d572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:57.169451 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06119767-7c6f-428f-a2fe-6b830bc0d572 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:57.169883 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06119767-7c6f-428f-a2fe-6b830bc0d572 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:57.170306 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06119767-7c6f-428f-a2fe-6b830bc0d572 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:57.171255 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06119767-7c6f-428f-a2fe-6b830bc0d572 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:57.171710 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06119767-7c6f-428f-a2fe-6b830bc0d572 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:57.173446 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06119767-7c6f-428f-a2fe-6b830bc0d572 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:57.184927 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:57.188534 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 364/717] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:27:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:57.190010 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8209a1f-7148-4f09-9614-7becc8151e06 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:57.190499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8209a1f-7148-4f09-9614-7becc8151e06 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:57.190931 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8209a1f-7148-4f09-9614-7becc8151e06 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:57.193206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 365/718] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:57.197089 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8209a1f-7148-4f09-9614-7becc8151e06 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:57.227406 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64593e27-bb6d-4dab-ad56-f537d245df1a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:57.237903 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:57.279308 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c346b8-ff30-458f-a5bc-0c44139e0dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:57.280578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c346b8-ff30-458f-a5bc-0c44139e0dbf None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:57.281115 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c346b8-ff30-458f-a5bc-0c44139e0dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:57.281606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c346b8-ff30-458f-a5bc-0c44139e0dbf None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:57.282803 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c346b8-ff30-458f-a5bc-0c44139e0dbf None admin] RBAC: Adding query filter params (type=network) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:57.283345 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c346b8-ff30-458f-a5bc-0c44139e0dbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:57.285865 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c346b8-ff30-458f-a5bc-0c44139e0dbf None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:57.292383 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 354/719] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 30 10:27:57 2022] GET /identity/v3/services?type=network => generated 124 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:57.294486 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110633e-fad0-4113-9d70-77919b32c61f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:57.294974 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110633e-fad0-4113-9d70-77919b32c61f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:57.295423 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110633e-fad0-4113-9d70-77919b32c61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:57.335953 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1110633e-fad0-4113-9d70-77919b32c61f None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:57.341833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1110633e-fad0-4113-9d70-77919b32c61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:57.368109 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8209a1f-7148-4f09-9614-7becc8151e06 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:57.416989 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b060083-5d30-4abe-a01d-b3ed791398f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:57.417647 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b060083-5d30-4abe-a01d-b3ed791398f1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:57.418634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b060083-5d30-4abe-a01d-b3ed791398f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:57.418851 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b060083-5d30-4abe-a01d-b3ed791398f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:57.419729 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b060083-5d30-4abe-a01d-b3ed791398f1 None admin] RBAC: Adding query filter params (role.id=ab64ea6d0475430195af26a049485569, scope.project.id=423854cc8f524ecb8d740d1cb0053856, user.id=1bfd036d747241d9bc314b60bf8648b6) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:57.420052 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b060083-5d30-4abe-a01d-b3ed791398f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:57.421688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b060083-5d30-4abe-a01d-b3ed791398f1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:57.433120 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 366/720] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:27:57 2022] GET /identity/v3/role_assignments?user.id=1bfd036d747241d9bc314b60bf8648b6&scope.project.id=423854cc8f524ecb8d740d1cb0053856&role.id=ab64ea6d0475430195af26a049485569 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:57.434655 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66263c52-4f9d-4b03-aca7-fcd999216fa2 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:57.434917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66263c52-4f9d-4b03-aca7-fcd999216fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:57.435195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66263c52-4f9d-4b03-aca7-fcd999216fa2 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:57.440915 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 367/721] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:57.456538 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b35be-a34e-4e0b-86c2-adadce11624b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:57.456538 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b35be-a34e-4e0b-86c2-adadce11624b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:57.456538 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b35be-a34e-4e0b-86c2-adadce11624b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:57.456892 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 355/722] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:57.479918 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-660b35be-a34e-4e0b-86c2-adadce11624b None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:57.480969 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110633e-fad0-4113-9d70-77919b32c61f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:57.481950 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-660b35be-a34e-4e0b-86c2-adadce11624b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:57.567321 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:57.573694 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 368/723] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:57.627541 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b35be-a34e-4e0b-86c2-adadce11624b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:57.628727 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110633e-fad0-4113-9d70-77919b32c61f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:57.673462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:57.674750 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fd3ff-cc8e-4868-babd-17649ad03c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:57.675571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fd3ff-cc8e-4868-babd-17649ad03c64 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:57.675858 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fd3ff-cc8e-4868-babd-17649ad03c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:57.676135 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fd3ff-cc8e-4868-babd-17649ad03c64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:57.703855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6fd3ff-cc8e-4868-babd-17649ad03c64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:57.717936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-cf6fd3ff-cc8e-4868-babd-17649ad03c64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:57.717936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:57.717936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:57.717936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:57.717936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:57.717936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:57.717936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:57.717936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:57.717936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:57.717936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:57.717936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:57.717936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:57.717936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:57.717936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:57.717936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:57.717936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:57.718958 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:57.718958 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:57.718958 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:57.718958 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:57.718958 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:57.718958 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:57.718958 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:57.718958 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:57.718958 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:57.718958 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:57.718958 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:57.718958 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:57.718958 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:57.718958 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:57.718958 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:57.718958 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:57.719793 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:57.719793 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:57.719793 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:57.719793 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:57.719793 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:57.719793 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:57.719793 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:57.719793 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:57.719793 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:57.719793 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:57.719793 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:27:57.719793 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:57.725559 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 356/724] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 30 10:27:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:27:57.731976 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fd3ff-cc8e-4868-babd-17649ad03c64 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:57.819465 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b35be-a34e-4e0b-86c2-adadce11624b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:57.890731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f59fc-024b-45d3-9287-b6a1b7db755b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:57.891530 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f59fc-024b-45d3-9287-b6a1b7db755b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:57.891816 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f59fc-024b-45d3-9287-b6a1b7db755b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:57.892100 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f59fc-024b-45d3-9287-b6a1b7db755b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:57.904743 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f59fc-024b-45d3-9287-b6a1b7db755b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:27:57.914237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-441f59fc-024b-45d3-9287-b6a1b7db755b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:27:57.914237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:57.914237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:57.914237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:57.914237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:57.914237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:57.914237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:57.914237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:57.914237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:57.914237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:57.914237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:57.914237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:57.914237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:27:57.914237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:27:57.914237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:27:57.914237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:27:57.915182 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:27:57.915182 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:27:57.915182 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:27:57.915182 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:27:57.915182 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:57.915182 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:57.915182 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:57.915182 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:57.915182 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:57.915182 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:57.915182 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:57.915182 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:57.915182 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:57.915182 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:57.915182 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:57.915182 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:57.916110 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:57.916110 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:57.916110 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:57.916110 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:57.916110 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:27:57.916110 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:27:57.916110 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:27:57.916110 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:27:57.916110 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:27:57.916110 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:27:57.916110 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:27:57.916110 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:57.916831 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 369/725] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:27:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:57.923037 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f59fc-024b-45d3-9287-b6a1b7db755b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:57.934789 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fd3ff-cc8e-4868-babd-17649ad03c64 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:57.985709 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:58.004703 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083324d1-8bbd-411a-b092-c4d87c88b576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:58.006519 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083324d1-8bbd-411a-b092-c4d87c88b576 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:58.007893 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083324d1-8bbd-411a-b092-c4d87c88b576 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:58.008187 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083324d1-8bbd-411a-b092-c4d87c88b576 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:58.009432 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083324d1-8bbd-411a-b092-c4d87c88b576 None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:58.009768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083324d1-8bbd-411a-b092-c4d87c88b576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:58.011166 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083324d1-8bbd-411a-b092-c4d87c88b576 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:58.032180 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 357/726] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 30 10:27:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:27:58.033630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083324d1-8bbd-411a-b092-c4d87c88b576 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:58.058010 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:58.069334 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f59fc-024b-45d3-9287-b6a1b7db755b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:58.106491 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6176f-ee8f-40a2-a6e2-494e4f6580b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:58.107180 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6176f-ee8f-40a2-a6e2-494e4f6580b7 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:58.107461 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6176f-ee8f-40a2-a6e2-494e4f6580b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:58.107745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6176f-ee8f-40a2-a6e2-494e4f6580b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:58.108490 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6176f-ee8f-40a2-a6e2-494e4f6580b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:58.108825 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6176f-ee8f-40a2-a6e2-494e4f6580b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:58.110210 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6176f-ee8f-40a2-a6e2-494e4f6580b7 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:58.119289 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 370/727] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:27:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:58.133300 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6176f-ee8f-40a2-a6e2-494e4f6580b7 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:58.217561 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083324d1-8bbd-411a-b092-c4d87c88b576 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:58.243140 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6176f-ee8f-40a2-a6e2-494e4f6580b7 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:58.282025 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534fae2-18d1-47fe-92fc-fb240bbd9ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:58.282858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534fae2-18d1-47fe-92fc-fb240bbd9ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:58.283139 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534fae2-18d1-47fe-92fc-fb240bbd9ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:58.283467 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534fae2-18d1-47fe-92fc-fb240bbd9ca6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:58.285276 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6a923-5c7f-46e8-b43f-41275ac7fb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:58.286183 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6a923-5c7f-46e8-b43f-41275ac7fb7e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:58.286473 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6a923-5c7f-46e8-b43f-41275ac7fb7e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:58.286751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6a923-5c7f-46e8-b43f-41275ac7fb7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:58.294408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534fae2-18d1-47fe-92fc-fb240bbd9ca6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:58.295911 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534fae2-18d1-47fe-92fc-fb240bbd9ca6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:58.309839 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c6a923-5c7f-46e8-b43f-41275ac7fb7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:58.311602 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c6a923-5c7f-46e8-b43f-41275ac7fb7e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:58.322298 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-b534fae2-18d1-47fe-92fc-fb240bbd9ca6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:58.322298 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:58.322298 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:58.322298 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:58.322298 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:58.322298 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:58.322298 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:58.322298 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:58.322298 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:58.322298 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:58.322298 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:58.322298 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:58.322298 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:58.322298 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:58.322298 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:58.323216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:58.323216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:58.323216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:58.323216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:58.323216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:58.323216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:58.323216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:58.323216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:58.323216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:58.323216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:58.323216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:58.323216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:58.323216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:58.323216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:58.323216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:58.323216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:58.323216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:58.324734 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:58.324734 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:58.324734 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:58.324734 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:58.324734 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 371/728] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:27:58.331036 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534fae2-18d1-47fe-92fc-fb240bbd9ca6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:58.335565 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:58.339154 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-b2c6a923-5c7f-46e8-b43f-41275ac7fb7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:58.339154 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:58.339154 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:58.339154 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:58.339154 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:58.339154 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:58.339154 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:58.339154 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:58.339154 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:58.339154 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:58.339154 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:58.339154 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:58.339154 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:58.339154 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:58.339154 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:58.340071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:58.340071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:58.340071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:58.340071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:58.340071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:58.340071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:58.340071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:58.340071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:58.340071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:58.340071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:58.340071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:58.340071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:58.340071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:58.340071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:58.340071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:58.340071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:58.340071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:58.341005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:58.341005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:58.341005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:58.341005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:58.343161 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 358/729] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:27:58.351730 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6a923-5c7f-46e8-b43f-41275ac7fb7e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:58.420247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:58.522659 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534fae2-18d1-47fe-92fc-fb240bbd9ca6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:58.526417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6a923-5c7f-46e8-b43f-41275ac7fb7e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:58.578503 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62736711-0216-40de-b624-c8e2119e3b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:58.579168 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62736711-0216-40de-b624-c8e2119e3b9f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:58.579451 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62736711-0216-40de-b624-c8e2119e3b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:58.579727 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62736711-0216-40de-b624-c8e2119e3b9f None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:58.580446 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62736711-0216-40de-b624-c8e2119e3b9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:58.580792 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62736711-0216-40de-b624-c8e2119e3b9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:58.582173 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62736711-0216-40de-b624-c8e2119e3b9f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:58.604524 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7d025-97f2-4083-826a-668b6567f5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:58.605220 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7d025-97f2-4083-826a-668b6567f5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:58.605503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7d025-97f2-4083-826a-668b6567f5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:58.605779 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7d025-97f2-4083-826a-668b6567f5d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:58.606497 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7d025-97f2-4083-826a-668b6567f5d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:58.606804 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7d025-97f2-4083-826a-668b6567f5d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:58.608159 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7d025-97f2-4083-826a-668b6567f5d3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:58.611553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 359/730] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:58.617117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62736711-0216-40de-b624-c8e2119e3b9f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:58.634499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 372/731] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:58.640489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7d025-97f2-4083-826a-668b6567f5d3 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:58.750273 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:58.766918 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:58.770446 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62736711-0216-40de-b624-c8e2119e3b9f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:58.794330 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7d025-97f2-4083-826a-668b6567f5d3 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:58.811387 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb050cf-ac11-4bc3-8c0a-59926bfdab34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:58.812516 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb050cf-ac11-4bc3-8c0a-59926bfdab34 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:58.812836 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb050cf-ac11-4bc3-8c0a-59926bfdab34 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:58.813278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb050cf-ac11-4bc3-8c0a-59926bfdab34 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:58.824893 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb050cf-ac11-4bc3-8c0a-59926bfdab34 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:58.827125 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb050cf-ac11-4bc3-8c0a-59926bfdab34 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:58.833231 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122bec9-4806-4de8-a122-6ae69d94cdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:58.834028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122bec9-4806-4de8-a122-6ae69d94cdd4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:58.834311 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122bec9-4806-4de8-a122-6ae69d94cdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:58.834587 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122bec9-4806-4de8-a122-6ae69d94cdd4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:58.842314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122bec9-4806-4de8-a122-6ae69d94cdd4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:58.843728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122bec9-4806-4de8-a122-6ae69d94cdd4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:58.844869 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-bfb050cf-ac11-4bc3-8c0a-59926bfdab34 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:27:58.844869 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:58.844869 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:58.844869 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:58.844869 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:58.844869 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:58.844869 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:58.844869 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:58.844869 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:58.844869 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:58.844869 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:58.844869 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:58.844869 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:27:58.844869 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:27:58.844869 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:27:58.844869 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:27:58.845774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:58.845774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:58.845774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:27:58.845774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:58.845774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:27:58.845774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:58.845774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:58.845774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:58.845774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:58.845774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:58.845774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:58.845774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:58.845774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:58.845774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:58.845774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:58.845774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:58.845774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:58.845774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:58.846739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:58.846739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:58.846739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:27:58.846739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:27:58.846739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:27:58.846739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:27:58.846739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:27:58.846739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:27:58.846739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:27:58.846739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:58.848042 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 360/732] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Jun 30 10:27:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:27:58.851080 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9383e-ff13-46e6-b0c6-cd0829f6c8e8 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:58.851080 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9383e-ff13-46e6-b0c6-cd0829f6c8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:58.851080 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9383e-ff13-46e6-b0c6-cd0829f6c8e8 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:58.851080 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 361/733] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:58.852375 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9383e-ff13-46e6-b0c6-cd0829f6c8e8 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:58.863136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-3122bec9-4806-4de8-a122-6ae69d94cdd4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:27:58.863136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:58.863136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:58.863136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:58.863136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:58.863136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:58.863136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:58.863136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:58.863136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:58.863136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:58.863136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:58.863136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:58.863136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:27:58.863136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:27:58.863136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:27:58.863136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:27:58.865618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:58.865618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:58.865618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:27:58.865618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:58.865618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:27:58.865618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:27:58.865618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:58.865618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:58.865618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:58.865618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:58.865618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:58.865618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:58.865618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:58.865618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:58.865618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:58.865618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:58.865618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:58.865618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:58.867909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:58.867909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:58.867909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:27:58.867909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:27:58.867909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:27:58.867909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:27:58.867909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:27:58.867909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:27:58.867909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:27:58.867909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:58.867909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 373/734] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:27:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:27:58.867909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdba067-c729-4688-a2df-4cb5db6c3826 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:58.867909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdba067-c729-4688-a2df-4cb5db6c3826 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:58.877750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdba067-c729-4688-a2df-4cb5db6c3826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:58.885292 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-1bdba067-c729-4688-a2df-4cb5db6c3826 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:58.887275 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1bdba067-c729-4688-a2df-4cb5db6c3826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:58.958878 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 374/735] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:27:58.959524 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdba067-c729-4688-a2df-4cb5db6c3826 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:58.973634 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9383e-ff13-46e6-b0c6-cd0829f6c8e8 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:59.015494 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ec7b9-fe01-43cd-9db8-da54c0b5909a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:59.016305 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ec7b9-fe01-43cd-9db8-da54c0b5909a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:59.016615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ec7b9-fe01-43cd-9db8-da54c0b5909a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:59.016894 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ec7b9-fe01-43cd-9db8-da54c0b5909a None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:59.018000 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ec7b9-fe01-43cd-9db8-da54c0b5909a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:59.018310 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ec7b9-fe01-43cd-9db8-da54c0b5909a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:59.019740 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ec7b9-fe01-43cd-9db8-da54c0b5909a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:59.022521 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:59.046273 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 362/736] 10.222.0.59 () {56 vars in 1149 bytes} [Thu Jun 30 10:27:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:59.046273 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ec7b9-fe01-43cd-9db8-da54c0b5909a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:59.077468 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdba067-c729-4688-a2df-4cb5db6c3826 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:59.080931 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:59.122103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81064d7c-3d31-4c8e-94bb-7741e0f238d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:59.123532 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81064d7c-3d31-4c8e-94bb-7741e0f238d3 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:59.124228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81064d7c-3d31-4c8e-94bb-7741e0f238d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:59.125026 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81064d7c-3d31-4c8e-94bb-7741e0f238d3 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:59.126674 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81064d7c-3d31-4c8e-94bb-7741e0f238d3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:59.127454 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81064d7c-3d31-4c8e-94bb-7741e0f238d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:59.130216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81064d7c-3d31-4c8e-94bb-7741e0f238d3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:59.163322 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 375/737] 10.222.0.59 () {56 vars in 1135 bytes} [Thu Jun 30 10:27:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:59.164547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81064d7c-3d31-4c8e-94bb-7741e0f238d3 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:59.175026 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ec7b9-fe01-43cd-9db8-da54c0b5909a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:59.211092 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12504df-7572-4c5a-b9e3-5eca8ec364b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:59.211760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12504df-7572-4c5a-b9e3-5eca8ec364b8 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:59.212047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12504df-7572-4c5a-b9e3-5eca8ec364b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:59.212328 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12504df-7572-4c5a-b9e3-5eca8ec364b8 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:59.213080 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12504df-7572-4c5a-b9e3-5eca8ec364b8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:59.214493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12504df-7572-4c5a-b9e3-5eca8ec364b8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:59.236563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 363/738] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 30 10:27:59 2022] POST /identity/v3/services => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:27:59.236563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12504df-7572-4c5a-b9e3-5eca8ec364b8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:59.316177 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81064d7c-3d31-4c8e-94bb-7741e0f238d3 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:59.334882 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:59.378221 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495585c-deda-4755-ae4a-63b60f586c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:59.379259 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495585c-deda-4755-ae4a-63b60f586c91 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:59.379807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495585c-deda-4755-ae4a-63b60f586c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:59.380285 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495585c-deda-4755-ae4a-63b60f586c91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:59.437402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:59.464355 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12504df-7572-4c5a-b9e3-5eca8ec364b8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:59.472823 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495585c-deda-4755-ae4a-63b60f586c91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:59.474867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495585c-deda-4755-ae4a-63b60f586c91 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:59.506471 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc4c19-7ca9-40d5-9a3d-78da2fedfbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:59.507079 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc4c19-7ca9-40d5-9a3d-78da2fedfbf0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:59.507370 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc4c19-7ca9-40d5-9a3d-78da2fedfbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:59.507653 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc4c19-7ca9-40d5-9a3d-78da2fedfbf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:59.584245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc4c19-7ca9-40d5-9a3d-78da2fedfbf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:59.585805 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc4c19-7ca9-40d5-9a3d-78da2fedfbf0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:59.592943 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 376/739] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:59 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:27:59.598794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495585c-deda-4755-ae4a-63b60f586c91 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:59.610594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:59.673847 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:59.700859 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 364/740] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:27:59 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:27:59.710004 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc4c19-7ca9-40d5-9a3d-78da2fedfbf0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:59.716668 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495585c-deda-4755-ae4a-63b60f586c91 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:59.755040 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e0247-a366-4cee-8cac-4a7912a5d51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:59.756560 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e0247-a366-4cee-8cac-4a7912a5d51e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:59.756995 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e0247-a366-4cee-8cac-4a7912a5d51e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:59.757420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e0247-a366-4cee-8cac-4a7912a5d51e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:59.769672 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e0247-a366-4cee-8cac-4a7912a5d51e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:59.771425 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e0247-a366-4cee-8cac-4a7912a5d51e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:59.790279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-ba9e0247-a366-4cee-8cac-4a7912a5d51e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:59.790279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:59.790279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:59.790279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:59.790279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:59.790279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:59.790279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:59.790279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:59.790279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:59.790279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:59.790279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:59.790279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:59.790279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:59.790279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:59.790279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:59.791351 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:59.791351 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:59.791351 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:59.791351 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:59.791351 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:59.791351 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:59.791351 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:59.791351 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:59.791351 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:59.791351 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:59.791351 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:59.791351 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:59.791351 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:59.791351 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:59.791351 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:59.791351 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:59.791351 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:59.792442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:59.792442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:59.792442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:59.792442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:27:59.794320 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 377/741] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:27:59.795793 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b3a38-3354-4208-8e5f-51ef2a75c62f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:59.796313 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b3a38-3354-4208-8e5f-51ef2a75c62f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:59.796829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b3a38-3354-4208-8e5f-51ef2a75c62f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:59.798548 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 378/742] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:59.799457 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b3a38-3354-4208-8e5f-51ef2a75c62f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:59.833585 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc4c19-7ca9-40d5-9a3d-78da2fedfbf0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:59.866390 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:59.873000 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701d6c4-5cb4-4c88-9078-f1f9fbb882d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:59.873793 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701d6c4-5cb4-4c88-9078-f1f9fbb882d8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:59.874079 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701d6c4-5cb4-4c88-9078-f1f9fbb882d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:59.874359 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701d6c4-5cb4-4c88-9078-f1f9fbb882d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:59.884957 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701d6c4-5cb4-4c88-9078-f1f9fbb882d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:59.887115 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701d6c4-5cb4-4c88-9078-f1f9fbb882d8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:59.905049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-c701d6c4-5cb4-4c88-9078-f1f9fbb882d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:59.905049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:27:59.905049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:27:59.905049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:27:59.905049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:27:59.905049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:27:59.905049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:27:59.905049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:27:59.905049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:27:59.905049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:27:59.905049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:27:59.905049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:27:59.905049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:27:59.905049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:27:59.905049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:27:59.905979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:27:59.905979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:27:59.905979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:27:59.905979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:27:59.905979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:27:59.905979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:27:59.905979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:27:59.905979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:27:59.905979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:27:59.905979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:27:59.905979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:27:59.905979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:27:59.905979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:27:59.905979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:27:59.905979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:27:59.905979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:27:59.905979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:27:59.906850 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:27:59.906850 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:27:59.906850 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:27:59.906850 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:27:59.910987 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 365/743] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:27:59.912042 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd430835-7d95-4d57-ae21-17285cb87b56 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:59.912336 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd430835-7d95-4d57-ae21-17285cb87b56 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:59.912649 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd430835-7d95-4d57-ae21-17285cb87b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:59.915177 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b3a38-3354-4208-8e5f-51ef2a75c62f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:59.929954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-fd430835-7d95-4d57-ae21-17285cb87b56 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:59.931380 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fd430835-7d95-4d57-ae21-17285cb87b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:59.951478 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a00e7-d59f-4307-bf09-bdfe166d9609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:59.952128 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a00e7-d59f-4307-bf09-bdfe166d9609 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:59.952453 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a00e7-d59f-4307-bf09-bdfe166d9609 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:59.952751 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a00e7-d59f-4307-bf09-bdfe166d9609 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:59.953455 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a00e7-d59f-4307-bf09-bdfe166d9609 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:27:59.953820 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a00e7-d59f-4307-bf09-bdfe166d9609 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:59.955200 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a00e7-d59f-4307-bf09-bdfe166d9609 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:59.958226 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:59.967040 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 379/744] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:27:59.968387 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e7076-3696-4bb6-8cdc-88fe6442c8ce None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:59.968703 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e7076-3696-4bb6-8cdc-88fe6442c8ce None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:59.968976 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e7076-3696-4bb6-8cdc-88fe6442c8ce None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:59.970346 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 380/745] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:27:59.975332 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e7076-3696-4bb6-8cdc-88fe6442c8ce None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:00.014675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 366/746] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:27:59 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:28:00.014675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd430835-7d95-4d57-ae21-17285cb87b56 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:00.102121 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e7076-3696-4bb6-8cdc-88fe6442c8ce None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:00.119781 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd430835-7d95-4d57-ae21-17285cb87b56 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:00.125693 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:00.143924 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64f896-c366-46ab-857f-fd252066335f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:00.145012 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64f896-c366-46ab-857f-fd252066335f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:00.145446 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64f896-c366-46ab-857f-fd252066335f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:00.145729 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64f896-c366-46ab-857f-fd252066335f None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:00.146443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64f896-c366-46ab-857f-fd252066335f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:00.146868 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64f896-c366-46ab-857f-fd252066335f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:00.148242 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64f896-c366-46ab-857f-fd252066335f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:00.156176 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bd583-0ed4-48cb-b2c3-f2302e7fc915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:00.157417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bd583-0ed4-48cb-b2c3-f2302e7fc915 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:00.157702 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bd583-0ed4-48cb-b2c3-f2302e7fc915 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:00.157976 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bd583-0ed4-48cb-b2c3-f2302e7fc915 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:00.163981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 381/747] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:00.163981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631a16e-aa4e-4a1b-970d-b6595fe2cc50 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:00.163981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631a16e-aa4e-4a1b-970d-b6595fe2cc50 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:00.163981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631a16e-aa4e-4a1b-970d-b6595fe2cc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:00.169604 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491bd583-0ed4-48cb-b2c3-f2302e7fc915 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:00.171076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491bd583-0ed4-48cb-b2c3-f2302e7fc915 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:00.178583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b631a16e-aa4e-4a1b-970d-b6595fe2cc50 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:00.179762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b631a16e-aa4e-4a1b-970d-b6595fe2cc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:00.185509 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-491bd583-0ed4-48cb-b2c3-f2302e7fc915 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:00.185509 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:00.185509 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:00.185509 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:00.185509 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:00.185509 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:00.185509 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:00.185509 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:00.185509 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:00.185509 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:00.185509 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:00.185509 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:00.185509 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:28:00.185509 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:28:00.185509 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:28:00.186378 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:28:00.186378 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:00.186378 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:00.186378 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:00.186378 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:00.186378 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:00.186378 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:00.186378 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:00.186378 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:00.186378 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:00.186378 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:00.186378 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:00.186378 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:00.186378 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:00.186378 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:00.186378 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:00.186378 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:00.192164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:28:00.192164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:28:00.192164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:28:00.192164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:28:00.192164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:28:00.192164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:28:00.192164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:00.192164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:00.192164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 367/748] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:28:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:00.192164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bd583-0ed4-48cb-b2c3-f2302e7fc915 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:00.215803 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:00.252972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 382/749] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:28:00.254155 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631a16e-aa4e-4a1b-970d-b6595fe2cc50 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:00.322964 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bd583-0ed4-48cb-b2c3-f2302e7fc915 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:00.357805 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a927759-9eb8-40a0-9c0b-55afff93b030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:00.358280 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631a16e-aa4e-4a1b-970d-b6595fe2cc50 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:00.358457 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a927759-9eb8-40a0-9c0b-55afff93b030 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:00.358741 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a927759-9eb8-40a0-9c0b-55afff93b030 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:00.359018 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a927759-9eb8-40a0-9c0b-55afff93b030 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:00.359733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a927759-9eb8-40a0-9c0b-55afff93b030 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:00.361139 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a927759-9eb8-40a0-9c0b-55afff93b030 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:00.370658 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:00.377024 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 368/750] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 30 10:28:00 2022] POST /identity/v3/services => generated 240 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:28:00.378135 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a927759-9eb8-40a0-9c0b-55afff93b030 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:00.410997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc993c-51d9-4dc9-98eb-3cf6ab9364f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:00.412567 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc993c-51d9-4dc9-98eb-3cf6ab9364f8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:00.413189 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc993c-51d9-4dc9-98eb-3cf6ab9364f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:00.413813 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc993c-51d9-4dc9-98eb-3cf6ab9364f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:00.422536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc993c-51d9-4dc9-98eb-3cf6ab9364f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:00.424642 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc993c-51d9-4dc9-98eb-3cf6ab9364f8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:00.441711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-fddc993c-51d9-4dc9-98eb-3cf6ab9364f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:00.441711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:00.441711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:00.441711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:00.441711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:00.441711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:00.441711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:00.441711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:00.441711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:00.441711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:00.441711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:00.441711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:00.441711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:28:00.441711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:28:00.441711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:28:00.442716 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:28:00.442716 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:00.442716 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:00.442716 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:00.442716 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:00.442716 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:00.442716 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:00.442716 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:00.442716 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:00.442716 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:00.442716 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:00.442716 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:00.442716 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:00.442716 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:00.442716 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:00.442716 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:00.442716 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:00.443619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:28:00.443619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:28:00.443619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:28:00.443619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:28:00.443619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:28:00.443619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:28:00.443619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:00.443619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:00.451616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 383/751] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:28:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:00.452918 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc993c-51d9-4dc9-98eb-3cf6ab9364f8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:00.472950 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:00.497863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a927759-9eb8-40a0-9c0b-55afff93b030 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:00.535422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065445a-4317-4a63-91cb-31993bcf2dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:00.536124 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065445a-4317-4a63-91cb-31993bcf2dff None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:00.536412 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065445a-4317-4a63-91cb-31993bcf2dff None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:00.536721 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065445a-4317-4a63-91cb-31993bcf2dff None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:00.537501 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065445a-4317-4a63-91cb-31993bcf2dff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:00.537847 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065445a-4317-4a63-91cb-31993bcf2dff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:00.539326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065445a-4317-4a63-91cb-31993bcf2dff None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:00.552175 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 369/752] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:28:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:00.553149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065445a-4317-4a63-91cb-31993bcf2dff None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:00.577945 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc993c-51d9-4dc9-98eb-3cf6ab9364f8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:00.619903 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289cd919-964a-4f67-a9db-f78128bca0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:00.621463 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cd919-964a-4f67-a9db-f78128bca0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:00.621690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cd919-964a-4f67-a9db-f78128bca0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:00.622274 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cd919-964a-4f67-a9db-f78128bca0a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:00.640385 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289cd919-964a-4f67-a9db-f78128bca0a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:28:00.650809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-289cd919-964a-4f67-a9db-f78128bca0a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:28:00.650809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:00.650809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:00.650809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:00.650809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:00.650809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:00.650809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:00.650809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:00.650809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:00.650809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:00.650809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:00.650809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:00.650809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:28:00.650809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:28:00.650809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:28:00.650809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:28:00.651749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:28:00.651749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:28:00.651749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:28:00.651749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:28:00.651749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:00.651749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:00.651749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:00.651749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:00.651749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:00.651749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:00.651749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:00.651749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:00.651749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:00.651749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:00.651749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:00.651749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:00.652668 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:00.652668 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:00.652668 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:00.652668 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:00.652668 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:28:00.652668 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:28:00.652668 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:28:00.652668 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:28:00.652668 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:28:00.652668 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:28:00.652668 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:28:00.652668 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:00.653318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 384/753] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:28:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:00.654118 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289cd919-964a-4f67-a9db-f78128bca0a7 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:00.674313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065445a-4317-4a63-91cb-31993bcf2dff None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:00.696239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:00.721463 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d0814-b854-4279-9d52-7f2857a6805f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:00.722255 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d0814-b854-4279-9d52-7f2857a6805f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:00.722646 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d0814-b854-4279-9d52-7f2857a6805f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:00.722934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d0814-b854-4279-9d52-7f2857a6805f None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:00.723718 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d0814-b854-4279-9d52-7f2857a6805f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:00.724289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d0814-b854-4279-9d52-7f2857a6805f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:00.725882 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d0814-b854-4279-9d52-7f2857a6805f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:00.736661 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:00.740821 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 370/754] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:28:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:00.741909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d0814-b854-4279-9d52-7f2857a6805f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:00.790164 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289cd919-964a-4f67-a9db-f78128bca0a7 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:00.839193 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e445b40-1c94-4148-a77b-0eb6c58893f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:00.840533 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e445b40-1c94-4148-a77b-0eb6c58893f5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:00.841033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e445b40-1c94-4148-a77b-0eb6c58893f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:00.841764 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e445b40-1c94-4148-a77b-0eb6c58893f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:00.843289 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e445b40-1c94-4148-a77b-0eb6c58893f5 None admin] RBAC: Adding query filter params (role.id=1c667697d38a434fbb99c61bc846c4a5, scope.project.id=423854cc8f524ecb8d740d1cb0053856, user.id=a2bd48e6390241448fe2cf098ab64df3) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:00.844067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e445b40-1c94-4148-a77b-0eb6c58893f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:00.846358 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e445b40-1c94-4148-a77b-0eb6c58893f5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:00.854201 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 385/755] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:28:00 2022] GET /identity/v3/role_assignments?user.id=a2bd48e6390241448fe2cf098ab64df3&scope.project.id=423854cc8f524ecb8d740d1cb0053856&role.id=1c667697d38a434fbb99c61bc846c4a5 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:00.856145 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e445b40-1c94-4148-a77b-0eb6c58893f5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:00.863678 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d0814-b854-4279-9d52-7f2857a6805f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:00.912489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b7e71-0e11-41f4-8c95-053a0880067f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:00.913210 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b7e71-0e11-41f4-8c95-053a0880067f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:00.913499 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b7e71-0e11-41f4-8c95-053a0880067f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:00.913782 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b7e71-0e11-41f4-8c95-053a0880067f None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:00.914550 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b7e71-0e11-41f4-8c95-053a0880067f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:00.914863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b7e71-0e11-41f4-8c95-053a0880067f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:00.916256 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b7e71-0e11-41f4-8c95-053a0880067f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:00.936898 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 371/756] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:28:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:00.954045 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b7e71-0e11-41f4-8c95-053a0880067f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:00.978781 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:00.991536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e445b40-1c94-4148-a77b-0eb6c58893f5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:01.034881 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289e16a-a3be-4683-aa03-9cdf582f83f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:01.035824 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289e16a-a3be-4683-aa03-9cdf582f83f3 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:01.036116 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289e16a-a3be-4683-aa03-9cdf582f83f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:01.036405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289e16a-a3be-4683-aa03-9cdf582f83f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:01.037732 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289e16a-a3be-4683-aa03-9cdf582f83f3 None admin] RBAC: Adding query filter params (role.id=ab64ea6d0475430195af26a049485569, scope.project.id=423854cc8f524ecb8d740d1cb0053856, user.id=c15327c36c8c49ac87a3b3e9ab49eea7) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:01.038051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289e16a-a3be-4683-aa03-9cdf582f83f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:01.039514 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289e16a-a3be-4683-aa03-9cdf582f83f3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:01.053375 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 386/757] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:28:00 2022] GET /identity/v3/role_assignments?user.id=c15327c36c8c49ac87a3b3e9ab49eea7&scope.project.id=423854cc8f524ecb8d740d1cb0053856&role.id=ab64ea6d0475430195af26a049485569 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:01.105825 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:01.155697 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b7e71-0e11-41f4-8c95-053a0880067f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:01.193675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01088fa1-09d4-4e32-8b2d-38f56dedbb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:01.194396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01088fa1-09d4-4e32-8b2d-38f56dedbb39 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:01.194677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01088fa1-09d4-4e32-8b2d-38f56dedbb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:01.194948 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01088fa1-09d4-4e32-8b2d-38f56dedbb39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:01.207243 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01088fa1-09d4-4e32-8b2d-38f56dedbb39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:01.208864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01088fa1-09d4-4e32-8b2d-38f56dedbb39 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:01.228443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-01088fa1-09d4-4e32-8b2d-38f56dedbb39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:01.228443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:01.228443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:01.228443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:01.228443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:01.228443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:01.228443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:01.228443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:01.228443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:01.228443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:01.228443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:01.228443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:01.228443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:28:01.228443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:28:01.228443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:28:01.231171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:28:01.231171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:01.231171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:01.231171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:01.231171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:01.231171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:01.231171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:01.231171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:01.231171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:01.231171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:01.231171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:01.231171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:01.231171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:01.231171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:01.231171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:01.231171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:01.231171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:01.232868 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:28:01.232868 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:28:01.232868 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:01.232868 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:01.232868 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 372/758] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:28:01.236291 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289e16a-a3be-4683-aa03-9cdf582f83f3 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:01.355683 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289e16a-a3be-4683-aa03-9cdf582f83f3 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:01.391940 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2a612-c47f-4daf-95bd-779fa8f29ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:01.392640 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2a612-c47f-4daf-95bd-779fa8f29ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:01.392926 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2a612-c47f-4daf-95bd-779fa8f29ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:01.393205 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2a612-c47f-4daf-95bd-779fa8f29ef7 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:01.393923 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2a612-c47f-4daf-95bd-779fa8f29ef7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:01.394230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2a612-c47f-4daf-95bd-779fa8f29ef7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:01.395603 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2a612-c47f-4daf-95bd-779fa8f29ef7 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:01.412619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 387/759] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:01.414576 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01088fa1-09d4-4e32-8b2d-38f56dedbb39 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:01.523146 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01088fa1-09d4-4e32-8b2d-38f56dedbb39 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:01.537365 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:01.560534 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da35c0-0ce6-42fd-93e1-5ce74314dd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:01.561347 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da35c0-0ce6-42fd-93e1-5ce74314dd12 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:01.561639 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da35c0-0ce6-42fd-93e1-5ce74314dd12 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:01.561923 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da35c0-0ce6-42fd-93e1-5ce74314dd12 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:01.569932 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da35c0-0ce6-42fd-93e1-5ce74314dd12 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:01.571420 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da35c0-0ce6-42fd-93e1-5ce74314dd12 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:01.585563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-66da35c0-0ce6-42fd-93e1-5ce74314dd12 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:28:01.585563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:01.585563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:01.585563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:01.585563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:01.585563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:01.585563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:01.585563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:01.585563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:01.585563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:01.585563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:01.585563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:01.585563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:28:01.585563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:28:01.585563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:28:01.585563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:28:01.586549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:01.586549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:01.586549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:28:01.586549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:01.586549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:28:01.586549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:01.586549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:01.586549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:01.586549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:01.586549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:01.586549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:01.586549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:01.586549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:01.586549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:01.586549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:01.586549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:01.586549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:01.586549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:01.587518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:01.587518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:01.587518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:28:01.587518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:28:01.587518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:28:01.587518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:28:01.587518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:28:01.587518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:28:01.587518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:28:01.587518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:01.591667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 373/760] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Jun 30 10:28:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:01.593085 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2a612-c47f-4daf-95bd-779fa8f29ef7 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:01.610347 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:01.701641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2a612-c47f-4daf-95bd-779fa8f29ef7 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:01.738483 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16842f-535a-4988-bdb4-eae476b847e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:01.739162 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16842f-535a-4988-bdb4-eae476b847e1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:01.739446 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16842f-535a-4988-bdb4-eae476b847e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:01.739725 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16842f-535a-4988-bdb4-eae476b847e1 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:01.740591 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16842f-535a-4988-bdb4-eae476b847e1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:01.740905 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16842f-535a-4988-bdb4-eae476b847e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:01.742343 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16842f-535a-4988-bdb4-eae476b847e1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:01.767973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 388/761] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Jun 30 10:28:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:01.769357 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da35c0-0ce6-42fd-93e1-5ce74314dd12 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:01.778714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e420ba-f16b-4ea1-9296-c1d338e1364a None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:01.778960 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e420ba-f16b-4ea1-9296-c1d338e1364a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:01.779188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e420ba-f16b-4ea1-9296-c1d338e1364a None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:01.780830 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 389/762] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:01.785305 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f44a3-7e52-40c2-913d-1f0a7087e76f None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:01.785587 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f44a3-7e52-40c2-913d-1f0a7087e76f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:01.785861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f44a3-7e52-40c2-913d-1f0a7087e76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:01.812889 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c17f44a3-7e52-40c2-913d-1f0a7087e76f None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:01.814092 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c17f44a3-7e52-40c2-913d-1f0a7087e76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:01.887319 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da35c0-0ce6-42fd-93e1-5ce74314dd12 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:01.924053 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af9bad-9aa1-46c6-a748-5e33fc749676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:01.924899 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af9bad-9aa1-46c6-a748-5e33fc749676 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:01.925277 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af9bad-9aa1-46c6-a748-5e33fc749676 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:01.925568 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af9bad-9aa1-46c6-a748-5e33fc749676 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:01.936789 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af9bad-9aa1-46c6-a748-5e33fc749676 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:01.939199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af9bad-9aa1-46c6-a748-5e33fc749676 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:01.958257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-92af9bad-9aa1-46c6-a748-5e33fc749676 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:01.958257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:01.958257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:01.958257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:01.958257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:01.958257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:01.958257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:01.958257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:01.958257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:01.958257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:01.958257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:01.958257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:01.958257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:28:01.958257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:28:01.958257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:28:01.959190 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:28:01.959190 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:01.959190 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:01.959190 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:01.959190 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:01.959190 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:01.959190 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:01.959190 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:01.959190 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:01.959190 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:01.959190 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:01.959190 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:01.959190 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:01.959190 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:01.959190 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:01.959190 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:01.959190 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:01.960091 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:28:01.960091 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:28:01.960091 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:01.960091 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:01.965350 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 374/763] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:01.966707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af9bad-9aa1-46c6-a748-5e33fc749676 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:02.000870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:02.030273 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 390/764] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:28:02.054067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f44a3-7e52-40c2-913d-1f0a7087e76f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:02.056563 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:02.082262 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af9bad-9aa1-46c6-a748-5e33fc749676 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:02.124901 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5b520-f220-44cc-b8bd-2b9ba44f4e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:02.125648 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5b520-f220-44cc-b8bd-2b9ba44f4e2d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:02.125847 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5b520-f220-44cc-b8bd-2b9ba44f4e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:02.126372 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5b520-f220-44cc-b8bd-2b9ba44f4e2d None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:02.127193 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5b520-f220-44cc-b8bd-2b9ba44f4e2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:02.127605 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5b520-f220-44cc-b8bd-2b9ba44f4e2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:02.129412 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5b520-f220-44cc-b8bd-2b9ba44f4e2d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:02.146977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 375/765] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:02.148378 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5b520-f220-44cc-b8bd-2b9ba44f4e2d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:02.262383 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:02.270185 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5b520-f220-44cc-b8bd-2b9ba44f4e2d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:02.311753 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975258e-205a-4ae9-84ec-2c8c7104965a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:02.313267 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975258e-205a-4ae9-84ec-2c8c7104965a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:02.313779 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975258e-205a-4ae9-84ec-2c8c7104965a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:02.314287 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975258e-205a-4ae9-84ec-2c8c7104965a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:02.322102 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975258e-205a-4ae9-84ec-2c8c7104965a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:02.324353 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975258e-205a-4ae9-84ec-2c8c7104965a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:02.340551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-9975258e-205a-4ae9-84ec-2c8c7104965a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:02.340551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:02.340551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:02.340551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:02.340551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:02.340551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:02.340551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:02.340551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:02.340551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:02.340551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:02.340551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:02.340551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:02.340551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:28:02.340551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:28:02.340551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:28:02.341513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:28:02.341513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:02.341513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:02.341513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:02.341513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:02.341513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:02.341513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:02.341513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:02.341513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:02.341513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:02.341513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:02.341513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:02.341513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:02.341513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:02.341513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:02.341513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:02.341513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:02.342424 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:28:02.342424 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:28:02.342424 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:28:02.342424 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:28:02.342424 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:28:02.342424 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:28:02.342424 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:02.342424 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:02.350269 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 376/766] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:28:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:28:02.351868 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975258e-205a-4ae9-84ec-2c8c7104965a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:02.390396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f44a3-7e52-40c2-913d-1f0a7087e76f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:02.462945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975258e-205a-4ae9-84ec-2c8c7104965a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:02.500229 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ecba1-4703-48af-a686-e7be874ba172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:02.501277 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ecba1-4703-48af-a686-e7be874ba172 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:02.501770 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ecba1-4703-48af-a686-e7be874ba172 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:02.502366 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ecba1-4703-48af-a686-e7be874ba172 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:02.503357 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ecba1-4703-48af-a686-e7be874ba172 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:02.503953 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ecba1-4703-48af-a686-e7be874ba172 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:02.505616 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ecba1-4703-48af-a686-e7be874ba172 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:02.505741 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89501ef5-3805-4c2e-ba9d-882bc61baaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:02.506536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89501ef5-3805-4c2e-ba9d-882bc61baaca None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:02.506814 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89501ef5-3805-4c2e-ba9d-882bc61baaca None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:02.507134 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89501ef5-3805-4c2e-ba9d-882bc61baaca None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:02.507787 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89501ef5-3805-4c2e-ba9d-882bc61baaca None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:02.509151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89501ef5-3805-4c2e-ba9d-882bc61baaca None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:02.524743 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 377/767] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:28:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:02.527655 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ecba1-4703-48af-a686-e7be874ba172 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:02.536836 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:02.541032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-89501ef5-3805-4c2e-ba9d-882bc61baaca None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 10:28:02.541032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:02.541032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:28:02.541032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:28:02.541032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:28:02.541032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:28:02.541032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:28:02.541032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:02.541032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 10:28:02.541032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:02.541032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:28:02.541032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:02.541032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:02.541032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:02.541032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:02.541032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:02.541972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:02.541972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:02.541972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:02.541972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:02.541972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:02.541972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:02.541972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:02.541972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:28:02.541972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:28:02.541972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:28:02.541972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:28:02.541972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:02.541972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:02.541972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:02.541972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:02.541972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:02.542854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:02.542854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:02.542854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:02.542854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:02.542854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:02.542854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:02.542854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:02.542854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:02.542854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:02.542854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:02.542854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:02.542854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:28:02.542854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:02.542854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 10:28:02.542854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:02.548662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 391/768] 10.222.0.59 () {56 vars in 1129 bytes} [Thu Jun 30 10:28:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 495 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:02.549621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89501ef5-3805-4c2e-ba9d-882bc61baaca None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:02.641825 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ecba1-4703-48af-a686-e7be874ba172 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:02.680379 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32074b-3a32-4dc5-b958-5281b1305f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:02.681716 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32074b-3a32-4dc5-b958-5281b1305f46 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:02.682213 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32074b-3a32-4dc5-b958-5281b1305f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:02.682702 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32074b-3a32-4dc5-b958-5281b1305f46 None admin] PATH_INFO: `/v3/projects/423854cc8f524ecb8d740d1cb0053856/users/1bfd036d747241d9bc314b60bf8648b6/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:02.685219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32074b-3a32-4dc5-b958-5281b1305f46 None admin] RBAC: Authorizing `identity:create_grant(project_id=423854cc8f524ecb8d740d1cb0053856, user_id=1bfd036d747241d9bc314b60bf8648b6, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:02.688157 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32074b-3a32-4dc5-b958-5281b1305f46 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:02.708651 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 378/769] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 30 10:28:02 2022] PUT /identity/v3/projects/423854cc8f524ecb8d740d1cb0053856/users/1bfd036d747241d9bc314b60bf8648b6/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:28:02.767684 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:02.811512 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89501ef5-3805-4c2e-ba9d-882bc61baaca None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:02.846215 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ff762-e6a9-4062-af4c-aa5f4031e79a None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:02.846660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ff762-e6a9-4062-af4c-aa5f4031e79a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:02.846899 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ff762-e6a9-4062-af4c-aa5f4031e79a None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:02.848396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 379/770] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:28:02.854933 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c95ef9-938c-4440-985f-1c3444397607 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:02.856173 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c95ef9-938c-4440-985f-1c3444397607 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:02.856762 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c95ef9-938c-4440-985f-1c3444397607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:02.865323 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ab105-924c-43ec-8023-986132e093d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:02.866019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ab105-924c-43ec-8023-986132e093d1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:02.866300 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ab105-924c-43ec-8023-986132e093d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:02.866581 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ab105-924c-43ec-8023-986132e093d1 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:02.867306 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ab105-924c-43ec-8023-986132e093d1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:02.867618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ab105-924c-43ec-8023-986132e093d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:02.869042 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ab105-924c-43ec-8023-986132e093d1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:02.874759 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 392/771] 10.222.0.59 () {56 vars in 1124 bytes} [Thu Jun 30 10:28:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:02.882782 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-37c95ef9-938c-4440-985f-1c3444397607 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:02.882973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ab105-924c-43ec-8023-986132e093d1 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:02.884562 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-37c95ef9-938c-4440-985f-1c3444397607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:02.963807 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:02.973519 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 380/772] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:28:02.999464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c95ef9-938c-4440-985f-1c3444397607 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:03.020201 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ab105-924c-43ec-8023-986132e093d1 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:03.060933 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:03.066234 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7eb53a-78b9-4653-a60b-a3f3cc54080b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:03.066908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7eb53a-78b9-4653-a60b-a3f3cc54080b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:03.067200 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7eb53a-78b9-4653-a60b-a3f3cc54080b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:03.067485 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7eb53a-78b9-4653-a60b-a3f3cc54080b None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:03.070339 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7eb53a-78b9-4653-a60b-a3f3cc54080b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:03.070663 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7eb53a-78b9-4653-a60b-a3f3cc54080b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:03.072875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7eb53a-78b9-4653-a60b-a3f3cc54080b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:03.086977 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 393/773] 10.222.0.59 () {56 vars in 1124 bytes} [Thu Jun 30 10:28:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:03.095750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7eb53a-78b9-4653-a60b-a3f3cc54080b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:03.141690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c95ef9-938c-4440-985f-1c3444397607 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:03.205292 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7373e2-5b07-4d0f-9243-bcc8e96764a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:03.206463 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7373e2-5b07-4d0f-9243-bcc8e96764a8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:03.207076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7373e2-5b07-4d0f-9243-bcc8e96764a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:03.207543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7373e2-5b07-4d0f-9243-bcc8e96764a8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:03.208387 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7373e2-5b07-4d0f-9243-bcc8e96764a8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:03.210186 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7373e2-5b07-4d0f-9243-bcc8e96764a8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:03.220799 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7eb53a-78b9-4653-a60b-a3f3cc54080b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:03.230860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-9d7373e2-5b07-4d0f-9243-bcc8e96764a8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 10:28:03.230860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:03.230860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:28:03.230860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:28:03.230860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:28:03.230860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:28:03.230860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:28:03.230860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:03.230860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 10:28:03.230860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:03.230860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:28:03.230860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:03.230860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:03.230860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:03.230860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:03.230860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:03.230860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:03.231888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:03.231888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:03.231888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:03.231888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:03.231888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:03.231888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:03.231888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:28:03.231888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:28:03.231888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:28:03.231888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:28:03.231888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:03.231888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:03.231888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:03.231888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:03.231888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:03.231888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:03.232766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:03.232766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:03.232766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:03.232766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:03.232766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:03.232766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:03.232766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:03.232766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:03.232766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:03.232766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:03.232766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:28:03.232766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:03.232766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 10:28:03.232766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:03.235565 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 381/774] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:28:02 2022] GET /identity/v3/services/network => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:03.241818 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7373e2-5b07-4d0f-9243-bcc8e96764a8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:03.300295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5fee4-7541-4036-a0de-59560fc9a38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:03.301381 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5fee4-7541-4036-a0de-59560fc9a38a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:03.301882 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5fee4-7541-4036-a0de-59560fc9a38a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:03.302351 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5fee4-7541-4036-a0de-59560fc9a38a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:03.303322 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5fee4-7541-4036-a0de-59560fc9a38a None admin] RBAC: Adding query filter params (interface=public, service_id=c033777302b74140aac94366b87881d4, region_id=RegionOne) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:03.303827 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5fee4-7541-4036-a0de-59560fc9a38a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:03.305413 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5fee4-7541-4036-a0de-59560fc9a38a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:03.315078 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 394/775] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Jun 30 10:28:03 2022] GET /identity/v3/endpoints?service_id=c033777302b74140aac94366b87881d4&interface=public®ion_id=RegionOne => generated 194 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:03.321266 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dea10f-5f4f-407a-b5c7-14a33dce2f74 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:03.321811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dea10f-5f4f-407a-b5c7-14a33dce2f74 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:03.322276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dea10f-5f4f-407a-b5c7-14a33dce2f74 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:03.324661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 395/776] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:03.325692 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dea10f-5f4f-407a-b5c7-14a33dce2f74 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:03.340866 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:03.380787 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7373e2-5b07-4d0f-9243-bcc8e96764a8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:03.397153 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:03.419960 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce5755-e016-4893-93c2-5609830b0963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:03.420922 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce5755-e016-4893-93c2-5609830b0963 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:03.421205 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce5755-e016-4893-93c2-5609830b0963 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:03.421923 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce5755-e016-4893-93c2-5609830b0963 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:03.422778 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce5755-e016-4893-93c2-5609830b0963 None admin] RBAC: Adding query filter params (name=network) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:03.423215 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce5755-e016-4893-93c2-5609830b0963 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:03.425244 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce5755-e016-4893-93c2-5609830b0963 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:03.435693 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 382/777] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 30 10:28:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:03.437020 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54feb67e-89b4-4d28-8017-eeed3c7e0db9 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:03.437313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54feb67e-89b4-4d28-8017-eeed3c7e0db9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:03.437592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54feb67e-89b4-4d28-8017-eeed3c7e0db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:03.447595 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dea10f-5f4f-407a-b5c7-14a33dce2f74 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:03.455758 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-54feb67e-89b4-4d28-8017-eeed3c7e0db9 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:03.457079 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-54feb67e-89b4-4d28-8017-eeed3c7e0db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:03.496932 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8d791-1eb3-4f18-a241-f58b06d13aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:03.497513 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8d791-1eb3-4f18-a241-f58b06d13aeb None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:03.497792 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8d791-1eb3-4f18-a241-f58b06d13aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:03.498068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8d791-1eb3-4f18-a241-f58b06d13aeb None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:03.498739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8d791-1eb3-4f18-a241-f58b06d13aeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:03.500638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8d791-1eb3-4f18-a241-f58b06d13aeb None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:03.508397 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 396/778] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Jun 30 10:28:03 2022] GET /identity/v3/services => generated 772 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:03.509287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8d791-1eb3-4f18-a241-f58b06d13aeb None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:03.553452 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 383/779] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:03.591850 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54feb67e-89b4-4d28-8017-eeed3c7e0db9 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:03.627964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8d791-1eb3-4f18-a241-f58b06d13aeb None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:03.656236 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:03.670947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f4700-face-4070-96d4-7b68543e7efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:03.671633 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f4700-face-4070-96d4-7b68543e7efa None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:03.671911 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f4700-face-4070-96d4-7b68543e7efa None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:03.672356 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f4700-face-4070-96d4-7b68543e7efa None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:03.673738 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f4700-face-4070-96d4-7b68543e7efa None admin] RBAC: Adding query filter params (type=network) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:03.674097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f4700-face-4070-96d4-7b68543e7efa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:03.675691 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f4700-face-4070-96d4-7b68543e7efa None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:03.682921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 397/780] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 30 10:28:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:03.688727 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f4700-face-4070-96d4-7b68543e7efa None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:03.731096 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:03.812662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f4700-face-4070-96d4-7b68543e7efa None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:03.813066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54feb67e-89b4-4d28-8017-eeed3c7e0db9 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:03.854400 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47cbbb-cc5b-44d3-8fa3-28417aa29285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:03.855090 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47cbbb-cc5b-44d3-8fa3-28417aa29285 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:03.855371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47cbbb-cc5b-44d3-8fa3-28417aa29285 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:03.855646 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47cbbb-cc5b-44d3-8fa3-28417aa29285 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:03.856420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47cbbb-cc5b-44d3-8fa3-28417aa29285 None admin] RBAC: Adding query filter params (interface=public, service_id=f5f5e0f4ba3d43b69e20ac38e77ddf8e, region_id=RegionOne) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:03.856761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47cbbb-cc5b-44d3-8fa3-28417aa29285 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:03.858110 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47cbbb-cc5b-44d3-8fa3-28417aa29285 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:03.864756 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 398/781] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Jun 30 10:28:03 2022] GET /identity/v3/endpoints?service_id=f5f5e0f4ba3d43b69e20ac38e77ddf8e&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:03.865938 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed07e8-08fa-4547-a9eb-854afb52ce53 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:03.866461 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed07e8-08fa-4547-a9eb-854afb52ce53 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:03.866936 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed07e8-08fa-4547-a9eb-854afb52ce53 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:03.869672 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 399/782] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:03.870347 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8224184-626b-45f5-9bb4-be2998265fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:03.871484 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8224184-626b-45f5-9bb4-be2998265fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:03.871765 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8224184-626b-45f5-9bb4-be2998265fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:03.872035 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8224184-626b-45f5-9bb4-be2998265fe7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:03.873213 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed07e8-08fa-4547-a9eb-854afb52ce53 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:03.883977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8224184-626b-45f5-9bb4-be2998265fe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:28:03.892010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-f8224184-626b-45f5-9bb4-be2998265fe7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:28:03.892010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:03.892010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:03.892010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:03.892010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:03.892010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:03.892010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:03.892010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:03.892010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:03.892010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:03.892010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:03.892010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:03.892010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:28:03.892010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:28:03.892010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:28:03.892010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:28:03.892993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:28:03.892993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:28:03.892993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:28:03.892993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:28:03.892993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:03.892993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:03.892993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:03.892993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:03.892993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:03.892993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:03.892993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:03.892993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:03.892993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:03.892993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:03.892993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:03.892993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:03.893845 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:03.893845 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:03.893845 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:03.893845 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:03.893845 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:28:03.893845 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:28:03.893845 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:28:03.893845 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:28:03.893845 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:28:03.893845 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:28:03.893845 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:28:03.893845 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:03.893845 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 384/783] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 30 10:28:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:03.894554 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e77e4-0ce6-4ccc-b5e3-e879ac5536e3 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:03.895139 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e77e4-0ce6-4ccc-b5e3-e879ac5536e3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:03.895139 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e77e4-0ce6-4ccc-b5e3-e879ac5536e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:03.913065 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ec4e77e4-0ce6-4ccc-b5e3-e879ac5536e3 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:03.914454 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ec4e77e4-0ce6-4ccc-b5e3-e879ac5536e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:03.936318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:03.998315 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed07e8-08fa-4547-a9eb-854afb52ce53 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:04.040109 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985cc888-020d-49e3-a4cb-26bf60ee54f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:04.041209 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cc888-020d-49e3-a4cb-26bf60ee54f9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:04.041747 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cc888-020d-49e3-a4cb-26bf60ee54f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:04.042237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cc888-020d-49e3-a4cb-26bf60ee54f9 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:04.043225 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985cc888-020d-49e3-a4cb-26bf60ee54f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:04.044971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985cc888-020d-49e3-a4cb-26bf60ee54f9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:04.060876 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 400/784] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Jun 30 10:28:03 2022] GET /identity/v3/services => generated 772 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:04.062279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985cc888-020d-49e3-a4cb-26bf60ee54f9 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:04.105343 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 385/785] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:04.128632 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e77e4-0ce6-4ccc-b5e3-e879ac5536e3 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:04.201763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:04.228562 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985cc888-020d-49e3-a4cb-26bf60ee54f9 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:04.245290 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:04.274030 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb58813-59be-4e80-9291-437f888adbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:04.274804 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb58813-59be-4e80-9291-437f888adbfa None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:04.275619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb58813-59be-4e80-9291-437f888adbfa None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:04.275903 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb58813-59be-4e80-9291-437f888adbfa None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:04.277143 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb58813-59be-4e80-9291-437f888adbfa None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:04.277461 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb58813-59be-4e80-9291-437f888adbfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:04.278845 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb58813-59be-4e80-9291-437f888adbfa None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:04.288832 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 401/786] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 30 10:28:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:04.295152 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb58813-59be-4e80-9291-437f888adbfa None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:04.330271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e77e4-0ce6-4ccc-b5e3-e879ac5536e3 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:04.373717 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a443e-fa3a-4b4c-a5b9-23cdb8212bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:04.374426 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a443e-fa3a-4b4c-a5b9-23cdb8212bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:04.375256 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a443e-fa3a-4b4c-a5b9-23cdb8212bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:04.375543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a443e-fa3a-4b4c-a5b9-23cdb8212bb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:04.386223 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a443e-fa3a-4b4c-a5b9-23cdb8212bb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:28:04.394885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-b37a443e-fa3a-4b4c-a5b9-23cdb8212bb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:28:04.394885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:04.394885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:04.394885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:04.394885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:04.394885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:04.394885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:04.394885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:04.394885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:04.394885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:04.394885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:04.394885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:04.394885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:28:04.394885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:28:04.394885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:28:04.394885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:28:04.395855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:28:04.395855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:28:04.395855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:28:04.395855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:28:04.395855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:04.395855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:04.395855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:04.395855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:04.395855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:04.395855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:04.395855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:04.395855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:04.395855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:04.395855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:04.395855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:04.395855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:04.396752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:04.396752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:04.396752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:04.396752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:04.396752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:28:04.396752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:28:04.396752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:28:04.396752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:28:04.396752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:28:04.396752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:28:04.396752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:28:04.396752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:04.396752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 386/787] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:28:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:28:04.409839 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a443e-fa3a-4b4c-a5b9-23cdb8212bb5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:04.451387 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb58813-59be-4e80-9291-437f888adbfa None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:04.505501 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900f504-d4a0-406c-8a4d-9fa80e07e89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:04.506343 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900f504-d4a0-406c-8a4d-9fa80e07e89f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:04.506624 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900f504-d4a0-406c-8a4d-9fa80e07e89f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:04.506895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900f504-d4a0-406c-8a4d-9fa80e07e89f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:04.531094 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900f504-d4a0-406c-8a4d-9fa80e07e89f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:04.532564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900f504-d4a0-406c-8a4d-9fa80e07e89f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:04.567230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-0900f504-d4a0-406c-8a4d-9fa80e07e89f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:04.567230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:04.567230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:04.567230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:04.567230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:04.567230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:04.567230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:04.567230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:04.567230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:04.567230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:04.567230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:04.567230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:04.567230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:28:04.567230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:28:04.567230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:28:04.569355 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:28:04.569355 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:04.569355 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:04.569355 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:04.569355 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:04.569355 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:04.569355 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:04.569355 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:04.569355 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:04.569355 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:04.569355 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:04.569355 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:04.569355 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:04.569355 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:04.569355 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:04.569355 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:04.569355 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:04.571472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:28:04.571472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:28:04.571472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:04.571472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:04.571472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 402/788] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:04.578093 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a443e-fa3a-4b4c-a5b9-23cdb8212bb5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:04.581165 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900f504-d4a0-406c-8a4d-9fa80e07e89f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:04.583463 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:04.638299 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78479da-35c7-436d-87e6-bc0d114752e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:04.638962 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78479da-35c7-436d-87e6-bc0d114752e8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:04.640069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78479da-35c7-436d-87e6-bc0d114752e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:04.640349 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78479da-35c7-436d-87e6-bc0d114752e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:04.641117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78479da-35c7-436d-87e6-bc0d114752e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:04.641425 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78479da-35c7-436d-87e6-bc0d114752e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:04.642791 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78479da-35c7-436d-87e6-bc0d114752e8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:04.643240 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:04.663966 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 387/789] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:28:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:04.670112 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78479da-35c7-436d-87e6-bc0d114752e8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:04.772654 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900f504-d4a0-406c-8a4d-9fa80e07e89f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:04.832660 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65d662-e509-48d4-bf3b-e5f53bc00e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:04.833326 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65d662-e509-48d4-bf3b-e5f53bc00e13 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:04.833606 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65d662-e509-48d4-bf3b-e5f53bc00e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:04.833873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65d662-e509-48d4-bf3b-e5f53bc00e13 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:04.834581 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65d662-e509-48d4-bf3b-e5f53bc00e13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:04.834883 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65d662-e509-48d4-bf3b-e5f53bc00e13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:04.836237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65d662-e509-48d4-bf3b-e5f53bc00e13 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:04.843989 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78479da-35c7-436d-87e6-bc0d114752e8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:04.872554 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 403/790] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:04.873530 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65d662-e509-48d4-bf3b-e5f53bc00e13 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:04.914233 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43648c69-a4b5-4ca5-8bc2-9db869f14d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:04.915132 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43648c69-a4b5-4ca5-8bc2-9db869f14d39 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:04.915410 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43648c69-a4b5-4ca5-8bc2-9db869f14d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:04.915679 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43648c69-a4b5-4ca5-8bc2-9db869f14d39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:04.931540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43648c69-a4b5-4ca5-8bc2-9db869f14d39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:04.933394 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43648c69-a4b5-4ca5-8bc2-9db869f14d39 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:04.952101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-43648c69-a4b5-4ca5-8bc2-9db869f14d39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:04.952101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:04.952101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:04.952101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:04.952101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:04.952101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:04.952101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:04.952101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:04.952101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:04.952101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:04.952101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:04.952101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:04.952101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:28:04.952101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:28:04.952101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:28:04.953081 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:28:04.953081 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:04.953081 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:04.953081 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:04.953081 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:04.953081 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:04.953081 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:04.953081 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:04.953081 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:04.953081 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:04.953081 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:04.953081 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:04.953081 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:04.953081 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:04.953081 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:04.953081 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:04.953081 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:04.954002 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:28:04.954002 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:28:04.954002 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:04.954002 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:04.956314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 388/791] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:04.965929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43648c69-a4b5-4ca5-8bc2-9db869f14d39 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:05.000877 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:05.050847 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:05.065663 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65d662-e509-48d4-bf3b-e5f53bc00e13 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:05.117284 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d460d5-dcc5-4b6a-bd3a-8fb7b5559fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:05.118115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d460d5-dcc5-4b6a-bd3a-8fb7b5559fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:05.118396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d460d5-dcc5-4b6a-bd3a-8fb7b5559fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:05.118670 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d460d5-dcc5-4b6a-bd3a-8fb7b5559fd4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:05.126295 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43648c69-a4b5-4ca5-8bc2-9db869f14d39 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:05.126510 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d460d5-dcc5-4b6a-bd3a-8fb7b5559fd4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:05.127958 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d460d5-dcc5-4b6a-bd3a-8fb7b5559fd4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:05.160359 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69157790-a035-4e55-8cdc-324b67a90d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:05.161051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69157790-a035-4e55-8cdc-324b67a90d85 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:05.161367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-66d460d5-dcc5-4b6a-bd3a-8fb7b5559fd4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:28:05.161367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:05.161367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:05.161367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:05.161367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:05.161367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:05.161367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:05.161367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:05.161367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:05.161367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:05.161367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:05.161367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:05.161367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:28:05.161367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:28:05.161367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:28:05.161367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:28:05.162271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:05.162271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:05.162271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:28:05.162271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:05.162271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:28:05.162271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:05.162271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:05.162271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:05.162271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:05.162271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:05.162271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:05.162271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:05.162271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:05.162271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:05.162271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:05.162271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:05.162271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:05.162271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:05.163214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:05.163214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:05.163214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:28:05.163214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:28:05.163214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:28:05.163214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:28:05.163214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:28:05.163214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:28:05.163214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:28:05.163214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:05.163741 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69157790-a035-4e55-8cdc-324b67a90d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:05.163741 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69157790-a035-4e55-8cdc-324b67a90d85 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:05.163876 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 404/792] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Jun 30 10:28:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:05.163943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69157790-a035-4e55-8cdc-324b67a90d85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:05.164019 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69157790-a035-4e55-8cdc-324b67a90d85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:05.164087 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c37f6-3ce3-4cbc-b874-d8aa9ad3aba8 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:05.165844 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c37f6-3ce3-4cbc-b874-d8aa9ad3aba8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:05.165844 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c37f6-3ce3-4cbc-b874-d8aa9ad3aba8 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:05.168253 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69157790-a035-4e55-8cdc-324b67a90d85 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:05.169613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 405/793] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:05.171635 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c37f6-3ce3-4cbc-b874-d8aa9ad3aba8 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:05.179856 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 389/794] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:05.181507 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8634417-ec73-4356-8019-8ff62ba3bece None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:05.181797 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8634417-ec73-4356-8019-8ff62ba3bece None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:05.182072 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8634417-ec73-4356-8019-8ff62ba3bece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:05.198586 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a8634417-ec73-4356-8019-8ff62ba3bece None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:05.200284 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a8634417-ec73-4356-8019-8ff62ba3bece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:05.276471 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 390/795] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:05.278533 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8634417-ec73-4356-8019-8ff62ba3bece None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:05.293299 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:05.306588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c37f6-3ce3-4cbc-b874-d8aa9ad3aba8 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:05.357664 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b87975-1854-4252-8ef9-dd7ccb4f91ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:05.358728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b87975-1854-4252-8ef9-dd7ccb4f91ae None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:05.359208 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b87975-1854-4252-8ef9-dd7ccb4f91ae None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:05.359678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b87975-1854-4252-8ef9-dd7ccb4f91ae None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:05.360740 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b87975-1854-4252-8ef9-dd7ccb4f91ae None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:05.361281 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b87975-1854-4252-8ef9-dd7ccb4f91ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:05.362895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b87975-1854-4252-8ef9-dd7ccb4f91ae None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:05.391759 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 406/796] 10.222.0.59 () {56 vars in 1149 bytes} [Thu Jun 30 10:28:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:05.391759 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b87975-1854-4252-8ef9-dd7ccb4f91ae None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:05.392012 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8634417-ec73-4356-8019-8ff62ba3bece None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:05.404352 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:05.434899 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f871de-41fd-45b9-832a-20a9a22b28ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:05.436432 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f871de-41fd-45b9-832a-20a9a22b28ad None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:05.437278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f871de-41fd-45b9-832a-20a9a22b28ad None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:05.438037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f871de-41fd-45b9-832a-20a9a22b28ad None admin] PATH_INFO: `/v3/users/swift` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:05.447035 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f871de-41fd-45b9-832a-20a9a22b28ad None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:05.450057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f871de-41fd-45b9-832a-20a9a22b28ad None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:05.469075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-29f871de-41fd-45b9-832a-20a9a22b28ad None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:28:05.469075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:05.469075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:05.469075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:05.469075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:05.469075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:05.469075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:05.469075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:05.469075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:05.469075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:05.469075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:05.469075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:05.469075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:28:05.469075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:28:05.469075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:28:05.469075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:28:05.470047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:05.470047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:05.470047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:28:05.470047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:05.470047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:28:05.470047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:05.470047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:05.470047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:05.470047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:05.470047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:05.470047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:05.470047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:05.470047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:05.470047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:05.470047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:05.470047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:05.470047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:05.470047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:05.470993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:05.470993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:05.470993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:28:05.470993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:28:05.470993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:28:05.470993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:28:05.470993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:28:05.470993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:28:05.470993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:28:05.470993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:05.477856 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 391/797] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:28:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:05.477856 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f871de-41fd-45b9-832a-20a9a22b28ad None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:05.519955 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b87975-1854-4252-8ef9-dd7ccb4f91ae None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:05.553716 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:05.568466 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3a304-5e8f-47f0-909e-453208b681fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:05.569690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3a304-5e8f-47f0-909e-453208b681fc None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:05.569979 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3a304-5e8f-47f0-909e-453208b681fc None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:05.570258 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3a304-5e8f-47f0-909e-453208b681fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:05.587827 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3a304-5e8f-47f0-909e-453208b681fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:28:05.595762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-f4c3a304-5e8f-47f0-909e-453208b681fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:28:05.595762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:05.595762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:05.595762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:05.595762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:05.595762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:05.595762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:05.595762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:05.595762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:05.595762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:05.595762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:05.595762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:05.595762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:28:05.595762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:28:05.595762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:28:05.595762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:28:05.596780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:28:05.596780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:28:05.596780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:28:05.596780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:28:05.596780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:05.596780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:05.596780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:05.596780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:05.596780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:05.596780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:05.596780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:05.596780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:05.596780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:05.596780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:05.596780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:05.596780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:05.597627 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:05.597627 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:05.597627 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:05.597627 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:05.597627 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:28:05.597627 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:28:05.597627 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:28:05.597627 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:28:05.597627 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:28:05.597627 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:28:05.597627 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:28:05.597627 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:05.602052 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 407/798] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:28:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:05.602882 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3a304-5e8f-47f0-909e-453208b681fc None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:05.604228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f871de-41fd-45b9-832a-20a9a22b28ad None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:05.649811 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d23b4-b12a-4493-96ee-3e5a6b3de375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:05.650963 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d23b4-b12a-4493-96ee-3e5a6b3de375 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:05.651630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d23b4-b12a-4493-96ee-3e5a6b3de375 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:05.652534 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d23b4-b12a-4493-96ee-3e5a6b3de375 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:05.667367 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d23b4-b12a-4493-96ee-3e5a6b3de375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:05.668912 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d23b4-b12a-4493-96ee-3e5a6b3de375 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:05.673729 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:05.689955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-a42d23b4-b12a-4493-96ee-3e5a6b3de375 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:05.689955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:05.689955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:05.689955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:05.689955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:05.689955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:05.689955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:05.689955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:05.689955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:05.689955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:05.689955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:05.689955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:05.689955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:28:05.689955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:28:05.689955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:28:05.690947 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:28:05.690947 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:05.690947 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:05.690947 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:05.690947 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:05.690947 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:05.690947 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:05.690947 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:05.690947 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:05.690947 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:05.690947 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:05.690947 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:05.690947 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:05.690947 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:05.690947 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:05.690947 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:05.690947 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:05.691837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:28:05.691837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:28:05.691837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:05.691837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:05.695675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 392/799] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:05.696638 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d23b4-b12a-4493-96ee-3e5a6b3de375 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:05.719819 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3a304-5e8f-47f0-909e-453208b681fc None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:05.766262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3691a4-5111-4140-a138-dc33e5726cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:05.767569 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3691a4-5111-4140-a138-dc33e5726cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:05.768450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3691a4-5111-4140-a138-dc33e5726cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:05.768961 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3691a4-5111-4140-a138-dc33e5726cd3 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:05.770232 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3691a4-5111-4140-a138-dc33e5726cd3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:05.770762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3691a4-5111-4140-a138-dc33e5726cd3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:05.772701 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3691a4-5111-4140-a138-dc33e5726cd3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:05.796318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 408/800] 10.222.0.59 () {56 vars in 1135 bytes} [Thu Jun 30 10:28:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:05.797624 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3691a4-5111-4140-a138-dc33e5726cd3 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:05.818437 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d23b4-b12a-4493-96ee-3e5a6b3de375 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:05.846450 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:05.862563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d1fdb-6198-4566-8896-1878afcc9c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:05.863229 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d1fdb-6198-4566-8896-1878afcc9c4e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:05.863508 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d1fdb-6198-4566-8896-1878afcc9c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:05.863778 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d1fdb-6198-4566-8896-1878afcc9c4e None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:05.864532 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d1fdb-6198-4566-8896-1878afcc9c4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:05.864865 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d1fdb-6198-4566-8896-1878afcc9c4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:05.866241 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d1fdb-6198-4566-8896-1878afcc9c4e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:05.880455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 393/801] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:28:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:05.881366 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d1fdb-6198-4566-8896-1878afcc9c4e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:05.928535 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3691a4-5111-4140-a138-dc33e5726cd3 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:05.962166 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:05.975808 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72dbb2-d587-40f9-b1a0-d1e888391592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:05.976477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72dbb2-d587-40f9-b1a0-d1e888391592 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:05.976802 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72dbb2-d587-40f9-b1a0-d1e888391592 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:05.977087 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72dbb2-d587-40f9-b1a0-d1e888391592 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:05.977798 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72dbb2-d587-40f9-b1a0-d1e888391592 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:05.978105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72dbb2-d587-40f9-b1a0-d1e888391592 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:05.979466 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72dbb2-d587-40f9-b1a0-d1e888391592 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:05.988184 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d1fdb-6198-4566-8896-1878afcc9c4e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:05.996520 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 409/802] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:05.996520 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72dbb2-d587-40f9-b1a0-d1e888391592 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:06.025371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de007b-ac2d-4353-ac37-ded38958bcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:06.026273 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de007b-ac2d-4353-ac37-ded38958bcaf None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:06.026556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de007b-ac2d-4353-ac37-ded38958bcaf None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:06.026831 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de007b-ac2d-4353-ac37-ded38958bcaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:06.038708 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de007b-ac2d-4353-ac37-ded38958bcaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:06.040283 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de007b-ac2d-4353-ac37-ded38958bcaf None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:06.059686 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-03de007b-ac2d-4353-ac37-ded38958bcaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:06.059686 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:06.059686 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:06.059686 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:06.059686 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:06.059686 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:06.059686 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:06.059686 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:06.059686 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:06.059686 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:06.059686 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:06.059686 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:06.059686 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:28:06.059686 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:28:06.059686 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:28:06.060764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:28:06.060764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:06.060764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:06.060764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:06.060764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:06.060764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:06.060764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:06.060764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:06.060764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:06.060764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:06.060764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:06.060764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:06.060764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:06.060764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:06.060764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:06.060764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:06.060764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:06.066304 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:28:06.066304 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:28:06.066304 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:06.066304 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:06.066304 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 394/803] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:06.066304 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f7092-9333-4fe0-b577-e0f94ac700d4 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:06.066304 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f7092-9333-4fe0-b577-e0f94ac700d4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:06.066304 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f7092-9333-4fe0-b577-e0f94ac700d4 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:06.066304 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 395/804] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:06.066798 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f7092-9333-4fe0-b577-e0f94ac700d4 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:06.101956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:06.105742 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72dbb2-d587-40f9-b1a0-d1e888391592 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:06.138702 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53820dc8-eb26-4d1c-8512-a5e3498a3456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:06.139486 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53820dc8-eb26-4d1c-8512-a5e3498a3456 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:06.139768 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53820dc8-eb26-4d1c-8512-a5e3498a3456 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:06.140042 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53820dc8-eb26-4d1c-8512-a5e3498a3456 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:06.152893 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53820dc8-eb26-4d1c-8512-a5e3498a3456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:06.154864 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53820dc8-eb26-4d1c-8512-a5e3498a3456 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:06.172070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-53820dc8-eb26-4d1c-8512-a5e3498a3456 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:06.172070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:06.172070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:06.172070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:06.172070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:06.172070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:06.172070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:06.172070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:06.172070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:06.172070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:06.172070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:06.172070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:06.172070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:28:06.172070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:28:06.172070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:28:06.173007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:28:06.173007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:06.173007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:06.173007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:06.173007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:06.173007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:06.173007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:06.173007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:06.173007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:06.173007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:06.173007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:06.173007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:06.173007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:06.173007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:06.173007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:06.173007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:06.173007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:06.173908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:28:06.173908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:28:06.173908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:06.173908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:06.173908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 410/805] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:06.174740 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53820dc8-eb26-4d1c-8512-a5e3498a3456 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:06.179363 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f7092-9333-4fe0-b577-e0f94ac700d4 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:06.210058 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:06.217576 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5d9ea-2aa6-4ac8-89cc-6700a21b0818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:06.218411 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5d9ea-2aa6-4ac8-89cc-6700a21b0818 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:06.218695 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5d9ea-2aa6-4ac8-89cc-6700a21b0818 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:06.218971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5d9ea-2aa6-4ac8-89cc-6700a21b0818 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:06.229160 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5d9ea-2aa6-4ac8-89cc-6700a21b0818 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:06.231145 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5d9ea-2aa6-4ac8-89cc-6700a21b0818 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:06.244900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-a4f5d9ea-2aa6-4ac8-89cc-6700a21b0818 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:06.244900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:06.244900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:06.244900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:06.244900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:06.244900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:06.244900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:06.244900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:06.244900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:06.244900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:06.244900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:06.244900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:06.244900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:28:06.244900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:28:06.244900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:28:06.245895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:28:06.245895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:06.245895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:06.245895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:06.245895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:06.245895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:06.245895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:06.245895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:06.245895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:06.245895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:06.245895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:06.245895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:06.245895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:06.245895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:06.245895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:06.245895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:06.245895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:06.246833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:28:06.246833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:28:06.246833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:28:06.246833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:28:06.246833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:28:06.246833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:28:06.246833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:06.246833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:06.246833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 396/806] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:28:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:06.248223 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbb357-ee96-4725-a431-f1ba5ff65c8a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:06.248551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbb357-ee96-4725-a431-f1ba5ff65c8a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:06.248809 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbb357-ee96-4725-a431-f1ba5ff65c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:06.273909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-76bbb357-ee96-4725-a431-f1ba5ff65c8a None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:06.275188 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-76bbb357-ee96-4725-a431-f1ba5ff65c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:06.291933 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53820dc8-eb26-4d1c-8512-a5e3498a3456 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:06.327008 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400ca13-aef8-4208-a000-0e773e40a3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:06.327667 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400ca13-aef8-4208-a000-0e773e40a3df None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:06.327950 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400ca13-aef8-4208-a000-0e773e40a3df None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:06.328424 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400ca13-aef8-4208-a000-0e773e40a3df None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:06.328962 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400ca13-aef8-4208-a000-0e773e40a3df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:06.329270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400ca13-aef8-4208-a000-0e773e40a3df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:06.330638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400ca13-aef8-4208-a000-0e773e40a3df None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:06.342898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 411/807] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:06.343525 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400ca13-aef8-4208-a000-0e773e40a3df None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:06.355933 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 397/808] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:06.355933 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbb357-ee96-4725-a431-f1ba5ff65c8a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:06.372023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:06.444351 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbb357-ee96-4725-a431-f1ba5ff65c8a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:06.450445 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:06.456824 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400ca13-aef8-4208-a000-0e773e40a3df None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:06.478888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9d78f-5145-44a2-b5ac-ec69c3d03204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:06.479485 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9d78f-5145-44a2-b5ac-ec69c3d03204 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:06.479776 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9d78f-5145-44a2-b5ac-ec69c3d03204 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:06.480052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9d78f-5145-44a2-b5ac-ec69c3d03204 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:06.480871 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9d78f-5145-44a2-b5ac-ec69c3d03204 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:06.481202 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9d78f-5145-44a2-b5ac-ec69c3d03204 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:06.482635 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9d78f-5145-44a2-b5ac-ec69c3d03204 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:06.490556 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003c402-8923-4abb-be7f-214373fc9759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:06.491200 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003c402-8923-4abb-be7f-214373fc9759 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:06.491479 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003c402-8923-4abb-be7f-214373fc9759 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:06.491751 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003c402-8923-4abb-be7f-214373fc9759 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:06.492446 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003c402-8923-4abb-be7f-214373fc9759 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:06.492777 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003c402-8923-4abb-be7f-214373fc9759 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:06.494121 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003c402-8923-4abb-be7f-214373fc9759 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:06.494254 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 398/809] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:28:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:06.495464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953688fc-7e65-4047-9fc5-550e54edb02d None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:06.496273 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953688fc-7e65-4047-9fc5-550e54edb02d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:06.496567 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953688fc-7e65-4047-9fc5-550e54edb02d None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:06.497954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 399/810] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:06.498530 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953688fc-7e65-4047-9fc5-550e54edb02d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:06.512542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 412/811] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:06.512542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003c402-8923-4abb-be7f-214373fc9759 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:06.584855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:06.602100 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953688fc-7e65-4047-9fc5-550e54edb02d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:06.608235 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003c402-8923-4abb-be7f-214373fc9759 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:06.635257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88252760-b0d1-49ac-9736-74f926dd9f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:06.636017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88252760-b0d1-49ac-9736-74f926dd9f6f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:06.636317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88252760-b0d1-49ac-9736-74f926dd9f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:06.636618 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88252760-b0d1-49ac-9736-74f926dd9f6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:06.640714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2549d-797a-43d3-abdd-c60404876ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:06.641506 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2549d-797a-43d3-abdd-c60404876ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:06.641788 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2549d-797a-43d3-abdd-c60404876ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:06.642060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2549d-797a-43d3-abdd-c60404876ca5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:06.642700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2549d-797a-43d3-abdd-c60404876ca5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:06.643178 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88252760-b0d1-49ac-9736-74f926dd9f6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:06.644051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2549d-797a-43d3-abdd-c60404876ca5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:06.644630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88252760-b0d1-49ac-9736-74f926dd9f6f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:06.656438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-e2c2549d-797a-43d3-abdd-c60404876ca5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 10:28:06.656438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:06.656438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:28:06.656438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:28:06.656438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:28:06.656438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:28:06.656438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:28:06.656438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:06.656438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 10:28:06.656438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:06.656438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:28:06.656438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:06.656438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:06.656438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:06.656438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:06.656438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:06.657543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:06.657543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:06.657543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:06.657543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:06.657543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:06.657543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:06.657543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:06.657543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:28:06.657543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:28:06.657543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:28:06.657543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:28:06.657543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:06.657543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:06.657543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:06.657543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:06.657543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:06.658409 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:06.658409 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:06.658409 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:06.658409 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:06.658409 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:06.658409 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:06.658409 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:06.658409 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:06.658409 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:06.658409 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:06.658409 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:06.658409 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:28:06.658409 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:06.658409 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 10:28:06.658409 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:06.658409 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 413/812] 10.222.0.59 () {56 vars in 1129 bytes} [Thu Jun 30 10:28:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:06.659245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-88252760-b0d1-49ac-9736-74f926dd9f6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:06.659245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:06.659245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:06.659245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:06.659245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:06.659245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:06.659245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:06.659245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:06.659245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:06.659245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:06.659245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:06.659245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:06.659245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:28:06.659245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:28:06.659245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:28:06.660037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:28:06.660037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:06.660037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:06.660037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:06.660037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:06.660037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:06.660037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:06.660037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:06.660037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:06.660037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:06.660037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:06.660037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:06.660037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:06.660037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:06.660037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:06.660037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:06.660037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:06.660937 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:28:06.660937 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:28:06.660937 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:28:06.660937 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:28:06.660937 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:28:06.660937 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:28:06.660937 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:06.660937 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:06.661355 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2549d-797a-43d3-abdd-c60404876ca5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:06.661424 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 400/813] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:28:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:06.661424 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cdf09-8d0a-4bf9-914e-f5cb8047d14e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:06.661424 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cdf09-8d0a-4bf9-914e-f5cb8047d14e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:06.661424 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cdf09-8d0a-4bf9-914e-f5cb8047d14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:06.677817 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-665cdf09-8d0a-4bf9-914e-f5cb8047d14e None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:06.678892 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-665cdf09-8d0a-4bf9-914e-f5cb8047d14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:06.684548 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:06.752760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 401/814] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:06.752760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cdf09-8d0a-4bf9-914e-f5cb8047d14e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:06.764127 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2549d-797a-43d3-abdd-c60404876ca5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:06.800162 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f8b87-26fe-4b83-a0f8-687d898a0802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:06.801070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f8b87-26fe-4b83-a0f8-687d898a0802 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:06.801350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f8b87-26fe-4b83-a0f8-687d898a0802 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:06.801622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f8b87-26fe-4b83-a0f8-687d898a0802 None admin] PATH_INFO: `/v3/projects/423854cc8f524ecb8d740d1cb0053856/users/a2bd48e6390241448fe2cf098ab64df3/roles/1c667697d38a434fbb99c61bc846c4a5` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:06.815934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f8b87-26fe-4b83-a0f8-687d898a0802 None admin] RBAC: Authorizing `identity:create_grant(project_id=423854cc8f524ecb8d740d1cb0053856, user_id=a2bd48e6390241448fe2cf098ab64df3, role_id=1c667697d38a434fbb99c61bc846c4a5)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:06.817378 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f8b87-26fe-4b83-a0f8-687d898a0802 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:06.825079 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:06.829864 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 414/815] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 30 10:28:06 2022] PUT /identity/v3/projects/423854cc8f524ecb8d740d1cb0053856/users/a2bd48e6390241448fe2cf098ab64df3/roles/1c667697d38a434fbb99c61bc846c4a5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:06.830688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f8b87-26fe-4b83-a0f8-687d898a0802 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:06.851948 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cdf09-8d0a-4bf9-914e-f5cb8047d14e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:06.893316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b015d-4ce6-4c22-988c-214a29284141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:06.894218 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b015d-4ce6-4c22-988c-214a29284141 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:06.894510 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b015d-4ce6-4c22-988c-214a29284141 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:06.894789 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b015d-4ce6-4c22-988c-214a29284141 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:06.903072 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b015d-4ce6-4c22-988c-214a29284141 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:06.904585 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b015d-4ce6-4c22-988c-214a29284141 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:06.920977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-0c7b015d-4ce6-4c22-988c-214a29284141 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:28:06.920977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:06.920977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:06.920977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:06.920977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:06.920977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:06.920977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:06.920977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:06.920977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:06.920977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:06.920977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:06.920977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:06.920977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:28:06.920977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:28:06.920977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:28:06.920977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:28:06.922025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:06.922025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:06.922025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:28:06.922025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:06.922025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:28:06.922025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:06.922025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:06.922025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:06.922025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:06.922025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:06.922025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:06.922025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:06.922025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:06.922025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:06.922025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:06.922025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:06.922025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:06.922025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:06.922986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:06.922986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:06.922986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:28:06.922986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:28:06.922986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:28:06.922986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:28:06.922986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:28:06.922986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:28:06.922986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:28:06.922986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:06.922986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 402/816] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Jun 30 10:28:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:06.922986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b015d-4ce6-4c22-988c-214a29284141 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:06.931925 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:06.971472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f8b87-26fe-4b83-a0f8-687d898a0802 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:07.015447 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fcb6b-cbb1-488c-b971-9368e80ecfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:07.016042 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fcb6b-cbb1-488c-b971-9368e80ecfb2 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:07.016326 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fcb6b-cbb1-488c-b971-9368e80ecfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:07.016639 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fcb6b-cbb1-488c-b971-9368e80ecfb2 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:07.017345 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932fcb6b-cbb1-488c-b971-9368e80ecfb2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:07.017654 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932fcb6b-cbb1-488c-b971-9368e80ecfb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:07.019018 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932fcb6b-cbb1-488c-b971-9368e80ecfb2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:07.023626 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 415/817] 10.222.0.59 () {56 vars in 1124 bytes} [Thu Jun 30 10:28:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:07.024402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fcb6b-cbb1-488c-b971-9368e80ecfb2 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:07.044439 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b015d-4ce6-4c22-988c-214a29284141 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:07.079665 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a805fe6-9973-4265-b4e2-f9b48d3ab778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:07.080586 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a805fe6-9973-4265-b4e2-f9b48d3ab778 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:07.080875 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a805fe6-9973-4265-b4e2-f9b48d3ab778 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:07.081145 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a805fe6-9973-4265-b4e2-f9b48d3ab778 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:07.081920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a805fe6-9973-4265-b4e2-f9b48d3ab778 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:07.082227 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a805fe6-9973-4265-b4e2-f9b48d3ab778 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:07.083652 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a805fe6-9973-4265-b4e2-f9b48d3ab778 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:07.085324 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:07.102732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 403/818] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:28:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:07.102732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a805fe6-9973-4265-b4e2-f9b48d3ab778 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:07.143010 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fcb6b-cbb1-488c-b971-9368e80ecfb2 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:07.180758 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083fce3-dff2-42e8-83ca-29a6c4c1a4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:07.181645 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083fce3-dff2-42e8-83ca-29a6c4c1a4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:07.181931 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083fce3-dff2-42e8-83ca-29a6c4c1a4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:07.182229 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083fce3-dff2-42e8-83ca-29a6c4c1a4b9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:07.182837 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083fce3-dff2-42e8-83ca-29a6c4c1a4b9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:07.184224 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083fce3-dff2-42e8-83ca-29a6c4c1a4b9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:07.186178 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:07.197353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-1083fce3-dff2-42e8-83ca-29a6c4c1a4b9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 10:28:07.197353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:07.197353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:28:07.197353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:28:07.197353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:28:07.197353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:28:07.197353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:28:07.197353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:07.197353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 10:28:07.197353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:07.197353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:28:07.197353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:07.197353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:07.197353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:07.197353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:07.197353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:07.197353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:07.198450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:07.198450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:07.198450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:07.198450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:07.198450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:07.198450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:07.198450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:28:07.198450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:28:07.198450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:28:07.198450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:28:07.198450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:07.198450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:07.198450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:07.198450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:07.198450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:07.198450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:07.199324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:07.199324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:07.199324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:07.199324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:07.199324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:07.199324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:07.199324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:07.199324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:07.199324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:07.199324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:07.199324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:28:07.199324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:07.199324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 10:28:07.199324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:07.199324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 416/819] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:28:07 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:07.200106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083fce3-dff2-42e8-83ca-29a6c4c1a4b9 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:07.211124 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a805fe6-9973-4265-b4e2-f9b48d3ab778 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:07.246895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cdf24-ec21-4fc8-804c-f9a2a441e006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:07.247560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cdf24-ec21-4fc8-804c-f9a2a441e006 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:07.247848 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cdf24-ec21-4fc8-804c-f9a2a441e006 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:07.248124 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cdf24-ec21-4fc8-804c-f9a2a441e006 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:07.248987 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36cdf24-ec21-4fc8-804c-f9a2a441e006 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:07.249301 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36cdf24-ec21-4fc8-804c-f9a2a441e006 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:07.250722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36cdf24-ec21-4fc8-804c-f9a2a441e006 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:07.274951 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 404/820] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Jun 30 10:28:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:07.275684 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cdf24-ec21-4fc8-804c-f9a2a441e006 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:07.319295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083fce3-dff2-42e8-83ca-29a6c4c1a4b9 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:07.333191 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:07.357846 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f8dff-2331-49cc-8771-794fce4df862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:07.358506 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f8dff-2331-49cc-8771-794fce4df862 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:07.358783 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f8dff-2331-49cc-8771-794fce4df862 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:07.359055 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f8dff-2331-49cc-8771-794fce4df862 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:07.359858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f8dff-2331-49cc-8771-794fce4df862 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:07.360158 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f8dff-2331-49cc-8771-794fce4df862 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:07.361743 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f8dff-2331-49cc-8771-794fce4df862 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:07.371304 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 417/821] 10.222.0.59 () {56 vars in 1124 bytes} [Thu Jun 30 10:28:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:07.371304 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f8dff-2331-49cc-8771-794fce4df862 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:07.387880 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cdf24-ec21-4fc8-804c-f9a2a441e006 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:07.425382 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81514c7-1a79-4ddf-8ee6-7254a9aff80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:07.426266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81514c7-1a79-4ddf-8ee6-7254a9aff80a None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:07.426941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81514c7-1a79-4ddf-8ee6-7254a9aff80a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:07.427235 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81514c7-1a79-4ddf-8ee6-7254a9aff80a None admin] PATH_INFO: `/v3/projects/423854cc8f524ecb8d740d1cb0053856/users/c15327c36c8c49ac87a3b3e9ab49eea7/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:07.429310 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81514c7-1a79-4ddf-8ee6-7254a9aff80a None admin] RBAC: Authorizing `identity:create_grant(project_id=423854cc8f524ecb8d740d1cb0053856, user_id=c15327c36c8c49ac87a3b3e9ab49eea7, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:07.430921 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81514c7-1a79-4ddf-8ee6-7254a9aff80a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:07.436805 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:07.445334 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 405/822] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 30 10:28:07 2022] PUT /identity/v3/projects/423854cc8f524ecb8d740d1cb0053856/users/c15327c36c8c49ac87a3b3e9ab49eea7/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:07.446326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81514c7-1a79-4ddf-8ee6-7254a9aff80a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:07.493549 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f8dff-2331-49cc-8771-794fce4df862 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:07.537614 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0921db1-6603-4cd4-892a-6e908c481772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:07.538400 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0921db1-6603-4cd4-892a-6e908c481772 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:07.538786 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0921db1-6603-4cd4-892a-6e908c481772 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:07.539189 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0921db1-6603-4cd4-892a-6e908c481772 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:07.540017 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0921db1-6603-4cd4-892a-6e908c481772 None admin] RBAC: Adding query filter params (name=network) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:07.540435 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0921db1-6603-4cd4-892a-6e908c481772 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:07.541964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0921db1-6603-4cd4-892a-6e908c481772 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:07.552720 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 418/823] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 30 10:28:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:07.554914 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0921db1-6603-4cd4-892a-6e908c481772 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:07.581517 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81514c7-1a79-4ddf-8ee6-7254a9aff80a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:07.601443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:07.628822 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172eec9-6e4e-4a72-b984-ceb45f351268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:07.630001 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172eec9-6e4e-4a72-b984-ceb45f351268 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:07.630599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172eec9-6e4e-4a72-b984-ceb45f351268 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:07.630951 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172eec9-6e4e-4a72-b984-ceb45f351268 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:07.684237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0921db1-6603-4cd4-892a-6e908c481772 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:07.713762 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172eec9-6e4e-4a72-b984-ceb45f351268 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:07.715095 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:07.716141 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172eec9-6e4e-4a72-b984-ceb45f351268 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:07.726135 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948aa78-0ba8-432a-b683-138558c795a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:07.726981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948aa78-0ba8-432a-b683-138558c795a3 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:07.727406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948aa78-0ba8-432a-b683-138558c795a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:07.727819 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948aa78-0ba8-432a-b683-138558c795a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:07.728731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948aa78-0ba8-432a-b683-138558c795a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:07.730266 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948aa78-0ba8-432a-b683-138558c795a3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:07.753763 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 419/824] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Jun 30 10:28:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:28:07.754868 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948aa78-0ba8-432a-b683-138558c795a3 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:07.904231 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 406/825] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:28:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:28:07.911356 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172eec9-6e4e-4a72-b984-ceb45f351268 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:07.930205 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:07.967437 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948aa78-0ba8-432a-b683-138558c795a3 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:08.012194 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a35c26-b3ea-4eb8-8163-1e082e817046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:08.012887 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a35c26-b3ea-4eb8-8163-1e082e817046 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:08.013167 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a35c26-b3ea-4eb8-8163-1e082e817046 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:08.013436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a35c26-b3ea-4eb8-8163-1e082e817046 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:08.014137 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a35c26-b3ea-4eb8-8163-1e082e817046 None admin] RBAC: Adding query filter params (type=network) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:08.014437 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a35c26-b3ea-4eb8-8163-1e082e817046 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:08.016247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a35c26-b3ea-4eb8-8163-1e082e817046 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:08.023294 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 420/826] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 30 10:28:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:08.029671 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a35c26-b3ea-4eb8-8163-1e082e817046 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:08.050959 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172eec9-6e4e-4a72-b984-ceb45f351268 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:08.079677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:08.093706 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9cdf2-b7cf-46e5-89ff-7af3f228bc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:08.094666 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9cdf2-b7cf-46e5-89ff-7af3f228bc3e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:08.094957 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9cdf2-b7cf-46e5-89ff-7af3f228bc3e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:08.095239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9cdf2-b7cf-46e5-89ff-7af3f228bc3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:08.106771 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9cdf2-b7cf-46e5-89ff-7af3f228bc3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:08.108232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9cdf2-b7cf-46e5-89ff-7af3f228bc3e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:08.127675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-d7f9cdf2-b7cf-46e5-89ff-7af3f228bc3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:08.127675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:08.127675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:08.127675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:08.127675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:08.127675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:08.127675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:08.127675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:08.127675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:08.127675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:08.127675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:08.127675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:08.127675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:28:08.127675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:28:08.127675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:28:08.128640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:28:08.128640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:08.128640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:08.128640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:08.128640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:08.128640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:08.128640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:08.128640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:08.128640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:08.128640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:08.128640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:08.128640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:08.128640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:08.128640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:08.128640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:08.128640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:08.128640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:08.129538 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:28:08.129538 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:28:08.129538 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:08.129538 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:08.129538 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 407/827] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:08.135715 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9cdf2-b7cf-46e5-89ff-7af3f228bc3e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:08.141883 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a35c26-b3ea-4eb8-8163-1e082e817046 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:08.181066 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe87bba-3940-4d0c-954f-d03d07440bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:08.181642 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe87bba-3940-4d0c-954f-d03d07440bd3 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:08.181918 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe87bba-3940-4d0c-954f-d03d07440bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:08.182191 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe87bba-3940-4d0c-954f-d03d07440bd3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:08.182929 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe87bba-3940-4d0c-954f-d03d07440bd3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:08.184888 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe87bba-3940-4d0c-954f-d03d07440bd3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:08.208146 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 421/828] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Jun 30 10:28:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:28:08.236936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:08.310764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9cdf2-b7cf-46e5-89ff-7af3f228bc3e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:08.372063 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2c555-dc54-438d-9f29-c180966df395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:08.372757 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2c555-dc54-438d-9f29-c180966df395 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:08.373037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2c555-dc54-438d-9f29-c180966df395 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:08.373312 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2c555-dc54-438d-9f29-c180966df395 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:08.374034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2c555-dc54-438d-9f29-c180966df395 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:08.374337 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2c555-dc54-438d-9f29-c180966df395 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:08.375743 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2c555-dc54-438d-9f29-c180966df395 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:08.392641 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 408/829] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:08.398933 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe87bba-3940-4d0c-954f-d03d07440bd3 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:08.505267 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:08.508517 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe87bba-3940-4d0c-954f-d03d07440bd3 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:08.545470 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c2a55-55eb-44e3-b065-b578c2ea3b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:08.546308 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c2a55-55eb-44e3-b065-b578c2ea3b59 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:08.546584 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c2a55-55eb-44e3-b065-b578c2ea3b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:08.546857 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c2a55-55eb-44e3-b065-b578c2ea3b59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:08.553788 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c2a55-55eb-44e3-b065-b578c2ea3b59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:08.555234 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c2a55-55eb-44e3-b065-b578c2ea3b59 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:08.568871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-215c2a55-55eb-44e3-b065-b578c2ea3b59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:08.568871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:08.568871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:08.568871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:08.568871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:08.568871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:08.568871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:08.568871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:08.568871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:08.568871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:08.568871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:08.568871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:08.568871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:28:08.568871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:28:08.568871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:28:08.570900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:28:08.570900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:08.570900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:08.570900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:08.570900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:08.570900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:08.570900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:08.570900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:08.570900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:08.570900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:08.570900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:08.570900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:08.570900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:08.570900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:08.570900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:08.570900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:08.570900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:08.572698 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:28:08.572698 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:28:08.572698 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:28:08.572698 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:28:08.572698 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:28:08.572698 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:28:08.572698 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:08.572698 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:08.572698 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 422/830] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:28:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:08.579543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2c555-dc54-438d-9f29-c180966df395 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:08.685441 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2c555-dc54-438d-9f29-c180966df395 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:08.708918 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:08.722816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920e3e2-4b22-467a-acec-02b3059b8fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:08.723481 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920e3e2-4b22-467a-acec-02b3059b8fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:08.723764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920e3e2-4b22-467a-acec-02b3059b8fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:08.724291 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920e3e2-4b22-467a-acec-02b3059b8fc0 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:08.725150 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920e3e2-4b22-467a-acec-02b3059b8fc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:08.725468 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920e3e2-4b22-467a-acec-02b3059b8fc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:08.726960 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920e3e2-4b22-467a-acec-02b3059b8fc0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:08.740625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 409/831] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:28:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:08.749647 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c2a55-55eb-44e3-b065-b578c2ea3b59 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:08.861123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c2a55-55eb-44e3-b065-b578c2ea3b59 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:08.893733 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4183b-090d-4024-80da-93dc88c68143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:08.894375 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4183b-090d-4024-80da-93dc88c68143 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:08.894653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4183b-090d-4024-80da-93dc88c68143 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:08.894926 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4183b-090d-4024-80da-93dc88c68143 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:08.895736 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4183b-090d-4024-80da-93dc88c68143 None admin] RBAC: Adding query filter params (role.id=ab64ea6d0475430195af26a049485569, scope.project.id=423854cc8f524ecb8d740d1cb0053856, user.id=1bfd036d747241d9bc314b60bf8648b6) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:08.896043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4183b-090d-4024-80da-93dc88c68143 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:08.897531 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4183b-090d-4024-80da-93dc88c68143 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:08.904126 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 423/832] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:28:08 2022] GET /identity/v3/role_assignments?user.id=1bfd036d747241d9bc314b60bf8648b6&scope.project.id=423854cc8f524ecb8d740d1cb0053856&role.id=ab64ea6d0475430195af26a049485569 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:09.123814 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03098dac-45b9-4549-9a34-4421d162e737 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:09.123990 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03098dac-45b9-4549-9a34-4421d162e737 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:09.124277 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03098dac-45b9-4549-9a34-4421d162e737 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:09.125971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 410/833] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:09.131344 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607b6ff-6b16-49e3-8f53-6a6f9ca67f4e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:09.131779 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607b6ff-6b16-49e3-8f53-6a6f9ca67f4e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:09.131948 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607b6ff-6b16-49e3-8f53-6a6f9ca67f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:09.149542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e607b6ff-6b16-49e3-8f53-6a6f9ca67f4e None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:09.150918 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e607b6ff-6b16-49e3-8f53-6a6f9ca67f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:09.168676 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:09.224645 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 424/834] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:09.245121 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03098dac-45b9-4549-9a34-4421d162e737 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:09.364205 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03098dac-45b9-4549-9a34-4421d162e737 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:09.399456 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e2260-ee8b-406c-a650-114902572511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:09.400246 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e2260-ee8b-406c-a650-114902572511 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:09.400548 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e2260-ee8b-406c-a650-114902572511 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:09.400831 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e2260-ee8b-406c-a650-114902572511 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:09.411412 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e2260-ee8b-406c-a650-114902572511 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:28:09.419137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-a14e2260-ee8b-406c-a650-114902572511 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:28:09.419137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:09.419137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:09.419137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:09.419137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:09.419137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:09.419137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:09.419137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:09.419137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:09.419137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:09.419137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:09.419137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:09.419137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:28:09.419137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:28:09.419137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:28:09.419137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:28:09.420069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:28:09.420069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:28:09.420069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:28:09.420069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:28:09.420069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:09.420069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:09.420069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:09.420069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:09.420069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:09.420069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:09.420069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:09.420069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:09.420069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:09.420069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:09.420069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:09.420069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:09.420956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:09.420956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:09.420956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:09.420956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:09.420956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:28:09.420956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:28:09.420956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:28:09.420956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:28:09.420956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:28:09.420956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:28:09.420956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:28:09.420956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:09.420956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 411/835] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 30 10:28:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:09.426278 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607b6ff-6b16-49e3-8f53-6a6f9ca67f4e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:09.526170 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607b6ff-6b16-49e3-8f53-6a6f9ca67f4e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:09.560905 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6af21f-1c5f-4384-84fc-b80eb53a923b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:09.561618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6af21f-1c5f-4384-84fc-b80eb53a923b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:09.561897 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6af21f-1c5f-4384-84fc-b80eb53a923b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:09.562169 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6af21f-1c5f-4384-84fc-b80eb53a923b None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:09.562902 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6af21f-1c5f-4384-84fc-b80eb53a923b None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:09.563202 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6af21f-1c5f-4384-84fc-b80eb53a923b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:09.564574 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6af21f-1c5f-4384-84fc-b80eb53a923b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:09.572982 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 425/836] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 30 10:28:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:09.578452 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e2260-ee8b-406c-a650-114902572511 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:09.626507 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:09.631287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e6b62-97b9-43ac-be09-81d08a821120 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:09.631582 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e6b62-97b9-43ac-be09-81d08a821120 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:09.631863 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e6b62-97b9-43ac-be09-81d08a821120 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:09.633681 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 426/837] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:09.639940 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bed29-1ba7-4fc7-8fcf-839b8547378d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:09.640228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bed29-1ba7-4fc7-8fcf-839b8547378d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:09.640525 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bed29-1ba7-4fc7-8fcf-839b8547378d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:09.658134 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-cf8bed29-1ba7-4fc7-8fcf-839b8547378d None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:09.659254 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-cf8bed29-1ba7-4fc7-8fcf-839b8547378d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:09.670087 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:09.706309 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e2260-ee8b-406c-a650-114902572511 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:09.743022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 427/838] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:28:09.748710 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f5614-b0eb-4816-8f31-32c6dd6f16be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:09.749740 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f5614-b0eb-4816-8f31-32c6dd6f16be None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:09.750220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f5614-b0eb-4816-8f31-32c6dd6f16be None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:09.750688 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f5614-b0eb-4816-8f31-32c6dd6f16be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:09.763755 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bed29-1ba7-4fc7-8fcf-839b8547378d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:09.764637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f5614-b0eb-4816-8f31-32c6dd6f16be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:09.766482 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f5614-b0eb-4816-8f31-32c6dd6f16be None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:09.786163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-379f5614-b0eb-4816-8f31-32c6dd6f16be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:09.786163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:09.786163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:09.786163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:09.786163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:09.786163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:09.786163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:09.786163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:09.786163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:09.786163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:09.786163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:09.786163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:09.786163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:28:09.786163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:28:09.786163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:28:09.787116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:28:09.787116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:09.787116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:09.787116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:09.787116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:09.787116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:09.787116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:09.787116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:09.787116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:09.787116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:09.787116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:09.787116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:09.787116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:09.787116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:09.787116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:09.787116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:09.787116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:09.788011 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:28:09.788011 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:28:09.788011 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:09.788011 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:09.790384 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 412/839] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:09.795711 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f5614-b0eb-4816-8f31-32c6dd6f16be None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:09.871927 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bed29-1ba7-4fc7-8fcf-839b8547378d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:09.903821 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:09.914071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f5614-b0eb-4816-8f31-32c6dd6f16be None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:09.917795 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ec96c-c67f-467b-8764-14fc967a015b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:09.918589 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ec96c-c67f-467b-8764-14fc967a015b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:09.918870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ec96c-c67f-467b-8764-14fc967a015b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:09.919143 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ec96c-c67f-467b-8764-14fc967a015b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:09.931629 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ec96c-c67f-467b-8764-14fc967a015b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:28:09.940107 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-324ec96c-c67f-467b-8764-14fc967a015b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:28:09.940107 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:09.940107 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:09.940107 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:09.940107 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:09.940107 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:09.940107 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:09.940107 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:09.940107 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:09.940107 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:09.940107 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:09.940107 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:09.940107 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:28:09.940107 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:28:09.940107 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:28:09.940107 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:28:09.941060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:28:09.941060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:28:09.941060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:28:09.941060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:28:09.941060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:09.941060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:09.941060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:09.941060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:09.941060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:09.941060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:09.941060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:09.941060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:09.941060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:09.941060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:09.941060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:09.941060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:09.941922 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:09.941922 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:09.941922 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:09.941922 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:09.941922 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:28:09.941922 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:28:09.941922 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:28:09.941922 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:28:09.941922 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:28:09.941922 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:28:09.941922 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:28:09.941922 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:09.949947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 428/840] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:28:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:28:09.951172 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ec96c-c67f-467b-8764-14fc967a015b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:09.953027 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd28a5b-f7f4-4b31-859b-04c8c96d7e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:09.953790 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd28a5b-f7f4-4b31-859b-04c8c96d7e0d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:09.954188 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd28a5b-f7f4-4b31-859b-04c8c96d7e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:09.954568 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd28a5b-f7f4-4b31-859b-04c8c96d7e0d None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:09.955559 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd28a5b-f7f4-4b31-859b-04c8c96d7e0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:09.955970 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd28a5b-f7f4-4b31-859b-04c8c96d7e0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:09.956176 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:09.958608 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd28a5b-f7f4-4b31-859b-04c8c96d7e0d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:09.979985 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 413/841] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:09.981316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd28a5b-f7f4-4b31-859b-04c8c96d7e0d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:10.071581 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ec96c-c67f-467b-8764-14fc967a015b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:10.107066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd28a5b-f7f4-4b31-859b-04c8c96d7e0d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:10.115054 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b363f-f1d9-4a80-bd9b-b3ae1678f0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:10.116628 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b363f-f1d9-4a80-bd9b-b3ae1678f0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:10.117117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b363f-f1d9-4a80-bd9b-b3ae1678f0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:10.117641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b363f-f1d9-4a80-bd9b-b3ae1678f0f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:10.119084 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b363f-f1d9-4a80-bd9b-b3ae1678f0f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:10.119974 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b363f-f1d9-4a80-bd9b-b3ae1678f0f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:10.122631 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b363f-f1d9-4a80-bd9b-b3ae1678f0f5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:10.139492 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 429/842] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:28:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:10.141518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b363f-f1d9-4a80-bd9b-b3ae1678f0f5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:10.154179 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6f9bb-bfa3-4cc8-a8c0-afb6801c6037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:10.155924 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6f9bb-bfa3-4cc8-a8c0-afb6801c6037 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:10.156411 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6f9bb-bfa3-4cc8-a8c0-afb6801c6037 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:10.156910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6f9bb-bfa3-4cc8-a8c0-afb6801c6037 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:10.166997 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6f9bb-bfa3-4cc8-a8c0-afb6801c6037 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:10.169709 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6f9bb-bfa3-4cc8-a8c0-afb6801c6037 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:10.190455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-a3b6f9bb-bfa3-4cc8-a8c0-afb6801c6037 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:28:10.190455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:10.190455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:10.190455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:10.190455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:10.190455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:10.190455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:10.190455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:10.190455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:10.190455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:10.190455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:10.190455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:10.190455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:28:10.190455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:28:10.190455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:28:10.190455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:28:10.191438 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:10.191438 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:10.191438 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:28:10.191438 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:10.191438 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:28:10.191438 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:10.191438 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:10.191438 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:10.191438 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:10.191438 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:10.191438 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:10.191438 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:10.191438 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:10.191438 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:10.191438 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:10.191438 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:10.191438 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:10.191438 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:10.192406 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:10.192406 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:10.192406 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:28:10.192406 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:28:10.192406 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:28:10.192406 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:28:10.192406 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:28:10.192406 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:28:10.192406 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:28:10.192406 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:10.200308 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 414/843] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Jun 30 10:28:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:10.201483 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6f9bb-bfa3-4cc8-a8c0-afb6801c6037 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:10.219167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:10.224409 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:10.270178 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b363f-f1d9-4a80-bd9b-b3ae1678f0f5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:10.305627 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58dea3-cf5b-4733-95f1-3098f96afcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:10.306414 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58dea3-cf5b-4733-95f1-3098f96afcc8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:10.306696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58dea3-cf5b-4733-95f1-3098f96afcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:10.306968 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58dea3-cf5b-4733-95f1-3098f96afcc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:10.317746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58dea3-cf5b-4733-95f1-3098f96afcc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:10.319172 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58dea3-cf5b-4733-95f1-3098f96afcc8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:10.320809 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6f9bb-bfa3-4cc8-a8c0-afb6801c6037 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:10.336775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-af58dea3-cf5b-4733-95f1-3098f96afcc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:10.336775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:10.336775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:10.336775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:10.336775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:10.336775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:10.336775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:10.336775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:10.336775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:10.336775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:10.336775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:10.336775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:10.336775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:28:10.336775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:28:10.336775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:28:10.337651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:28:10.337651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:10.337651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:10.337651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:10.337651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:10.337651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:10.337651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:10.337651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:10.337651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:10.337651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:10.337651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:10.337651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:10.337651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:10.337651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:10.337651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:10.337651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:10.337651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:10.338546 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:28:10.338546 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:28:10.338546 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:10.338546 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:10.338546 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 430/844] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:10.339300 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de686d-0b22-40da-b183-c1f7851d66af None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:10.339647 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de686d-0b22-40da-b183-c1f7851d66af None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:10.339926 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de686d-0b22-40da-b183-c1f7851d66af None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:10.341458 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 431/845] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:10.345311 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de686d-0b22-40da-b183-c1f7851d66af None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:10.362145 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a85a38-2de9-4eaa-abe0-61f3b321070b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:10.362802 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a85a38-2de9-4eaa-abe0-61f3b321070b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:10.363083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a85a38-2de9-4eaa-abe0-61f3b321070b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:10.363352 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a85a38-2de9-4eaa-abe0-61f3b321070b None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:10.364171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a85a38-2de9-4eaa-abe0-61f3b321070b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:10.364476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a85a38-2de9-4eaa-abe0-61f3b321070b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:10.365942 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a85a38-2de9-4eaa-abe0-61f3b321070b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:10.383291 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 415/846] 10.222.0.59 () {56 vars in 1149 bytes} [Thu Jun 30 10:28:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:10.385920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a4e8b-2f77-4a3e-99fc-da338c8c01f6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:10.387559 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a4e8b-2f77-4a3e-99fc-da338c8c01f6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:10.388192 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a4e8b-2f77-4a3e-99fc-da338c8c01f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:10.405843 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ee0a4e8b-2f77-4a3e-99fc-da338c8c01f6 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:10.407639 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ee0a4e8b-2f77-4a3e-99fc-da338c8c01f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:10.464865 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de686d-0b22-40da-b183-c1f7851d66af None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:10.471767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:10.477798 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 416/847] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:10.485945 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:10.493037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a4e8b-2f77-4a3e-99fc-da338c8c01f6 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:10.508940 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cadb8-3b0d-4e1d-8dca-64439565ecb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:10.509956 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cadb8-3b0d-4e1d-8dca-64439565ecb8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:10.510246 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cadb8-3b0d-4e1d-8dca-64439565ecb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:10.510509 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cadb8-3b0d-4e1d-8dca-64439565ecb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:10.511561 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192cadb8-3b0d-4e1d-8dca-64439565ecb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:10.512027 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192cadb8-3b0d-4e1d-8dca-64439565ecb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:10.513419 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192cadb8-3b0d-4e1d-8dca-64439565ecb8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:10.526557 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 432/848] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:10.527469 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cadb8-3b0d-4e1d-8dca-64439565ecb8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:10.607664 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a4e8b-2f77-4a3e-99fc-da338c8c01f6 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:10.632147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cadb8-3b0d-4e1d-8dca-64439565ecb8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:10.644106 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb972af2-b2e0-47ee-aff1-4bcc9ae29245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:10.644847 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb972af2-b2e0-47ee-aff1-4bcc9ae29245 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:10.645127 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb972af2-b2e0-47ee-aff1-4bcc9ae29245 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:10.645396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb972af2-b2e0-47ee-aff1-4bcc9ae29245 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:10.670703 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2a0c0-05d2-4c2f-bbb8-bd66c62bc517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:10.671502 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2a0c0-05d2-4c2f-bbb8-bd66c62bc517 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:10.671789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2a0c0-05d2-4c2f-bbb8-bd66c62bc517 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:10.672246 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2a0c0-05d2-4c2f-bbb8-bd66c62bc517 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:10.672746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2a0c0-05d2-4c2f-bbb8-bd66c62bc517 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:10.674110 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2a0c0-05d2-4c2f-bbb8-bd66c62bc517 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:10.686696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-25c2a0c0-05d2-4c2f-bbb8-bd66c62bc517 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 10:28:10.686696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:10.686696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:28:10.686696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:28:10.686696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:28:10.686696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:28:10.686696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:28:10.686696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:10.686696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 10:28:10.686696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:10.686696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:28:10.686696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:10.686696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:10.686696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:10.686696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:10.686696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:10.686696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:10.687699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:10.687699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:10.687699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:10.687699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:10.687699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:10.687699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:10.687699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:28:10.687699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:28:10.687699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:28:10.687699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:28:10.687699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:10.687699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:10.687699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:10.687699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:10.687699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:10.687699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:10.689405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:10.689405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:10.689405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:10.689405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:10.689405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:10.689405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:10.689405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:10.689405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:10.689405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:10.689405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:10.689405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:28:10.689405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:10.689405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 10:28:10.689405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:10.689405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 433/849] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 30 10:28:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:10.690239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2a0c0-05d2-4c2f-bbb8-bd66c62bc517 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:10.717466 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:10.720732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb972af2-b2e0-47ee-aff1-4bcc9ae29245 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:10.722591 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb972af2-b2e0-47ee-aff1-4bcc9ae29245 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:10.735773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:10.796192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2a0c0-05d2-4c2f-bbb8-bd66c62bc517 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:10.829870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 417/850] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:28:10 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:28:10.830964 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb972af2-b2e0-47ee-aff1-4bcc9ae29245 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:10.837407 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ca6b4-aae1-40ec-b920-d4ee6aaaa331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:10.838199 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ca6b4-aae1-40ec-b920-d4ee6aaaa331 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:10.838477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ca6b4-aae1-40ec-b920-d4ee6aaaa331 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:10.838743 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ca6b4-aae1-40ec-b920-d4ee6aaaa331 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:10.848218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ca6b4-aae1-40ec-b920-d4ee6aaaa331 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:10.849930 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ca6b4-aae1-40ec-b920-d4ee6aaaa331 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:10.865366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-3f1ca6b4-aae1-40ec-b920-d4ee6aaaa331 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:28:10.865366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:10.865366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:10.865366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:10.865366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:10.865366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:10.865366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:10.865366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:10.865366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:10.865366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:10.865366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:10.865366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:10.865366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:28:10.865366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:28:10.865366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:28:10.865366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:28:10.866377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:10.866377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:10.866377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:28:10.866377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:10.866377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:28:10.866377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:10.866377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:10.866377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:10.866377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:10.866377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:10.866377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:10.866377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:10.866377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:10.866377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:10.866377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:10.866377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:10.866377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:10.866377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:10.867356 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:10.867356 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:10.867356 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:28:10.867356 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:28:10.867356 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:28:10.867356 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:28:10.867356 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:28:10.867356 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:28:10.867356 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:28:10.867356 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:10.867356 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 434/851] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:28:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:10.868598 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ca6b4-aae1-40ec-b920-d4ee6aaaa331 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:10.935221 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:10.939366 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb972af2-b2e0-47ee-aff1-4bcc9ae29245 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:10.970960 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ca6b4-aae1-40ec-b920-d4ee6aaaa331 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:10.972381 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:10.976787 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c426e7-70c9-4d7d-9f35-ddadaefcb6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:10.977452 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c426e7-70c9-4d7d-9f35-ddadaefcb6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:10.977735 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c426e7-70c9-4d7d-9f35-ddadaefcb6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:10.978011 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c426e7-70c9-4d7d-9f35-ddadaefcb6e2 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:10.978719 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c426e7-70c9-4d7d-9f35-ddadaefcb6e2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:10.979029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c426e7-70c9-4d7d-9f35-ddadaefcb6e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:10.980472 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c426e7-70c9-4d7d-9f35-ddadaefcb6e2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:10.985571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 418/852] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 30 10:28:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:10.986346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c426e7-70c9-4d7d-9f35-ddadaefcb6e2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:11.006982 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457ad9c-e1bd-48a8-890d-426521be12c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:11.007869 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457ad9c-e1bd-48a8-890d-426521be12c3 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:11.008219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457ad9c-e1bd-48a8-890d-426521be12c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:11.008598 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457ad9c-e1bd-48a8-890d-426521be12c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:11.020392 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457ad9c-e1bd-48a8-890d-426521be12c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:11.021858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457ad9c-e1bd-48a8-890d-426521be12c3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:11.038336 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-d457ad9c-e1bd-48a8-890d-426521be12c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:11.038336 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:11.038336 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:11.038336 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:11.038336 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:11.038336 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:11.038336 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:11.038336 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:11.038336 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:11.038336 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:11.038336 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:11.038336 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:11.038336 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:28:11.038336 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:28:11.038336 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:28:11.039228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:28:11.039228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:11.039228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:11.039228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:11.039228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:11.039228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:11.039228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:11.039228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:11.039228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:11.039228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:11.039228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:11.039228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:11.039228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:11.039228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:11.039228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:11.039228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:11.039228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:11.040152 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:28:11.040152 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:28:11.040152 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:11.040152 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:11.040152 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 435/853] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:11.040710 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245baed-2617-4ce5-8db8-458c18a2965e None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:11.040949 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245baed-2617-4ce5-8db8-458c18a2965e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:11.041227 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245baed-2617-4ce5-8db8-458c18a2965e None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:11.042489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 436/854] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:11.043165 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245baed-2617-4ce5-8db8-458c18a2965e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:11.093350 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c426e7-70c9-4d7d-9f35-ddadaefcb6e2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:11.129172 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6db2e-014b-4425-80b5-3025482e9fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:11.129849 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6db2e-014b-4425-80b5-3025482e9fde None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:11.130129 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6db2e-014b-4425-80b5-3025482e9fde None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:11.130403 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6db2e-014b-4425-80b5-3025482e9fde None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:11.131233 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6db2e-014b-4425-80b5-3025482e9fde None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:11.131540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6db2e-014b-4425-80b5-3025482e9fde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:11.133042 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6db2e-014b-4425-80b5-3025482e9fde None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:11.152599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 419/855] 10.222.0.59 () {56 vars in 1135 bytes} [Thu Jun 30 10:28:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:11.153439 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6db2e-014b-4425-80b5-3025482e9fde None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:11.179470 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:11.253648 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6db2e-014b-4425-80b5-3025482e9fde None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:11.255029 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245baed-2617-4ce5-8db8-458c18a2965e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:11.288399 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64145df-67dc-4dc7-9931-6580003b1185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:11.289080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64145df-67dc-4dc7-9931-6580003b1185 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:11.289362 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbd8fb-b3f2-426a-86db-6e1a85a6bf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:11.289472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64145df-67dc-4dc7-9931-6580003b1185 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:11.289631 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64145df-67dc-4dc7-9931-6580003b1185 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:11.290016 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbd8fb-b3f2-426a-86db-6e1a85a6bf85 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:11.290303 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbd8fb-b3f2-426a-86db-6e1a85a6bf85 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:11.290390 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64145df-67dc-4dc7-9931-6580003b1185 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:11.290583 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbd8fb-b3f2-426a-86db-6e1a85a6bf85 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:11.290671 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64145df-67dc-4dc7-9931-6580003b1185 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:11.291291 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbd8fb-b3f2-426a-86db-6e1a85a6bf85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:11.291603 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbd8fb-b3f2-426a-86db-6e1a85a6bf85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:11.291923 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64145df-67dc-4dc7-9931-6580003b1185 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:11.293511 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbd8fb-b3f2-426a-86db-6e1a85a6bf85 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:11.296766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 437/856] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 30 10:28:11 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:11.297897 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe57b28-063f-4c6e-a9fc-438874c008fe None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:11.298178 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe57b28-063f-4c6e-a9fc-438874c008fe None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:11.298447 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe57b28-063f-4c6e-a9fc-438874c008fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:11.305402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 420/857] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:11.306080 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbd8fb-b3f2-426a-86db-6e1a85a6bf85 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:11.328871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0fe57b28-063f-4c6e-a9fc-438874c008fe None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:11.330106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0fe57b28-063f-4c6e-a9fc-438874c008fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:11.344675 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:11.401243 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:11.414634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 438/858] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:11.415870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe57b28-063f-4c6e-a9fc-438874c008fe None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:11.428018 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbd8fb-b3f2-426a-86db-6e1a85a6bf85 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:11.469895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430df5c5-1b5e-4eef-97b2-59a4b3b9e847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:11.470547 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430df5c5-1b5e-4eef-97b2-59a4b3b9e847 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:11.470834 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430df5c5-1b5e-4eef-97b2-59a4b3b9e847 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:11.471111 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430df5c5-1b5e-4eef-97b2-59a4b3b9e847 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:11.530180 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe57b28-063f-4c6e-a9fc-438874c008fe None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:11.545059 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430df5c5-1b5e-4eef-97b2-59a4b3b9e847 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:11.546516 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430df5c5-1b5e-4eef-97b2-59a4b3b9e847 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:11.564376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce1780-179e-4365-9bc7-68d9e4a9b156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:11.565197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce1780-179e-4365-9bc7-68d9e4a9b156 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:11.565482 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce1780-179e-4365-9bc7-68d9e4a9b156 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:11.565759 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce1780-179e-4365-9bc7-68d9e4a9b156 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:11.573585 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce1780-179e-4365-9bc7-68d9e4a9b156 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:11.574153 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce1780-179e-4365-9bc7-68d9e4a9b156 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:11.587856 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-79ce1780-179e-4365-9bc7-68d9e4a9b156 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:11.587856 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:11.587856 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:11.587856 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:11.587856 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:11.587856 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:11.587856 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:11.587856 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:11.587856 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:11.587856 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:11.587856 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:11.587856 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:11.587856 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:28:11.587856 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:28:11.587856 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:28:11.588794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:28:11.588794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:11.588794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:11.588794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:11.588794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:11.588794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:11.588794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:11.588794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:11.588794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:11.588794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:11.588794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:11.588794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:11.588794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:11.588794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:11.588794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:11.588794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:11.588794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:11.590218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:28:11.590218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:28:11.590218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:28:11.590218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:28:11.590218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:28:11.590218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:28:11.590218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:11.590218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:11.590218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 439/859] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:28:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:11.591152 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce1780-179e-4365-9bc7-68d9e4a9b156 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:11.602187 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:11.636576 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:11.660554 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 421/860] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:28:11 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:28:11.660743 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430df5c5-1b5e-4eef-97b2-59a4b3b9e847 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:11.703581 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce1780-179e-4365-9bc7-68d9e4a9b156 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:11.738813 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6537a8a-8fda-44ef-88b0-7c214eeef493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:11.740031 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6537a8a-8fda-44ef-88b0-7c214eeef493 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:11.740312 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6537a8a-8fda-44ef-88b0-7c214eeef493 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:11.740618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6537a8a-8fda-44ef-88b0-7c214eeef493 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:11.741607 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6537a8a-8fda-44ef-88b0-7c214eeef493 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:11.743280 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6537a8a-8fda-44ef-88b0-7c214eeef493 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:11.756245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-b6537a8a-8fda-44ef-88b0-7c214eeef493 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 10:28:11.756245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:11.756245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:28:11.756245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:28:11.756245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:28:11.756245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:28:11.756245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:28:11.756245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:11.756245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 10:28:11.756245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:11.756245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:28:11.756245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:11.756245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:11.756245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:11.756245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:11.756245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:11.757370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:11.757370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:11.757370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:11.757370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:11.757370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:11.757370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:11.757370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:11.757370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:28:11.757370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:28:11.757370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:28:11.757370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:28:11.757370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:11.757370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:11.757370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:11.757370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:11.757370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:11.758489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:11.758489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:11.758489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:11.758489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:11.758489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:11.758489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:11.758489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:11.758489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:11.758489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:11.758489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:11.758489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:11.758489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:28:11.758489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:11.758489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 10:28:11.758489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:11.758489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 440/861] 10.222.0.59 () {56 vars in 1132 bytes} [Thu Jun 30 10:28:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:11.759371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6537a8a-8fda-44ef-88b0-7c214eeef493 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:11.768847 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430df5c5-1b5e-4eef-97b2-59a4b3b9e847 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:11.804128 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d43363-38e0-4976-b061-7d77b39abca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:11.805035 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d43363-38e0-4976-b061-7d77b39abca6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:11.805473 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d43363-38e0-4976-b061-7d77b39abca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:11.806278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d43363-38e0-4976-b061-7d77b39abca6 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:11.807216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d43363-38e0-4976-b061-7d77b39abca6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:11.808464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d43363-38e0-4976-b061-7d77b39abca6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:11.810159 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d43363-38e0-4976-b061-7d77b39abca6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:11.827232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 422/862] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:28:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:11.827232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d43363-38e0-4976-b061-7d77b39abca6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:11.842134 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:11.876251 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6537a8a-8fda-44ef-88b0-7c214eeef493 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:11.876717 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:11.912785 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81171580-d7fe-48e0-b011-7fd182da0e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:11.913570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81171580-d7fe-48e0-b011-7fd182da0e07 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:11.913850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81171580-d7fe-48e0-b011-7fd182da0e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:11.914124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81171580-d7fe-48e0-b011-7fd182da0e07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:11.924711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81171580-d7fe-48e0-b011-7fd182da0e07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:11.926136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81171580-d7fe-48e0-b011-7fd182da0e07 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:11.943641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-81171580-d7fe-48e0-b011-7fd182da0e07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:11.943641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:11.943641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:11.943641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:11.943641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:11.943641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:11.943641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:11.943641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:11.943641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:11.943641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:11.943641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:11.943641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:11.943641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:28:11.943641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:28:11.943641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:28:11.944589 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:28:11.944589 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:11.944589 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:11.944589 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:11.944589 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:11.944589 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:11.944589 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:11.944589 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:11.944589 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:11.944589 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:11.944589 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:11.944589 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:11.944589 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:11.944589 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:11.944589 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:11.944589 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:11.944589 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:11.945692 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:28:11.945692 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:28:11.945692 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:11.945692 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:11.947342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d43363-38e0-4976-b061-7d77b39abca6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:11.949325 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 441/863] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:11.950112 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81171580-d7fe-48e0-b011-7fd182da0e07 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:11.986148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc9ee4-be23-45c1-86ad-0d9c027b99a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:11.987133 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc9ee4-be23-45c1-86ad-0d9c027b99a3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:11.987569 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc9ee4-be23-45c1-86ad-0d9c027b99a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:11.988061 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc9ee4-be23-45c1-86ad-0d9c027b99a3 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:11.989014 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc9ee4-be23-45c1-86ad-0d9c027b99a3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:11.989472 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc9ee4-be23-45c1-86ad-0d9c027b99a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:11.991164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc9ee4-be23-45c1-86ad-0d9c027b99a3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:11.997705 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 423/864] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 30 10:28:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:11.998602 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc9ee4-be23-45c1-86ad-0d9c027b99a3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:12.055733 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81171580-d7fe-48e0-b011-7fd182da0e07 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:12.080392 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:12.091705 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad55183-e5d5-43e0-83b1-40fa8102eceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:12.092649 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad55183-e5d5-43e0-83b1-40fa8102eceb None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:12.092930 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad55183-e5d5-43e0-83b1-40fa8102eceb None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:12.093209 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad55183-e5d5-43e0-83b1-40fa8102eceb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:12.094021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad55183-e5d5-43e0-83b1-40fa8102eceb None admin] RBAC: Adding query filter params (role.id=1c667697d38a434fbb99c61bc846c4a5, scope.project.id=423854cc8f524ecb8d740d1cb0053856, user.id=a2bd48e6390241448fe2cf098ab64df3) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:12.094333 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad55183-e5d5-43e0-83b1-40fa8102eceb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:12.095743 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad55183-e5d5-43e0-83b1-40fa8102eceb None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:12.112534 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 442/865] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:28:11 2022] GET /identity/v3/role_assignments?user.id=a2bd48e6390241448fe2cf098ab64df3&scope.project.id=423854cc8f524ecb8d740d1cb0053856&role.id=1c667697d38a434fbb99c61bc846c4a5 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:12.112534 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad55183-e5d5-43e0-83b1-40fa8102eceb None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:12.117047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc9ee4-be23-45c1-86ad-0d9c027b99a3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:12.127830 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:12.156766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b003ff8-f71d-4249-961b-05b2d378cfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:12.157429 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b003ff8-f71d-4249-961b-05b2d378cfe7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:12.157718 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b003ff8-f71d-4249-961b-05b2d378cfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:12.157995 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b003ff8-f71d-4249-961b-05b2d378cfe7 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:12.158714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b003ff8-f71d-4249-961b-05b2d378cfe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:12.159029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b003ff8-f71d-4249-961b-05b2d378cfe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:12.160429 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b003ff8-f71d-4249-961b-05b2d378cfe7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:12.174687 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 424/866] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:12.180590 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b003ff8-f71d-4249-961b-05b2d378cfe7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:12.246878 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad55183-e5d5-43e0-83b1-40fa8102eceb None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:12.291594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b003ff8-f71d-4249-961b-05b2d378cfe7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:12.298807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5122f-e2fc-47e3-afd5-aca268b9614a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:12.299485 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5122f-e2fc-47e3-afd5-aca268b9614a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:12.299761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5122f-e2fc-47e3-afd5-aca268b9614a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:12.300032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5122f-e2fc-47e3-afd5-aca268b9614a None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:12.300759 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5122f-e2fc-47e3-afd5-aca268b9614a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:12.301538 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5122f-e2fc-47e3-afd5-aca268b9614a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:12.302901 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5122f-e2fc-47e3-afd5-aca268b9614a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:12.310113 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 443/867] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 30 10:28:12 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:12.340620 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560bb2c-a10c-4ecf-b3d9-95f762d77beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:12.341508 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560bb2c-a10c-4ecf-b3d9-95f762d77beb None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:12.341857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560bb2c-a10c-4ecf-b3d9-95f762d77beb None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:12.342200 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560bb2c-a10c-4ecf-b3d9-95f762d77beb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:12.352706 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560bb2c-a10c-4ecf-b3d9-95f762d77beb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:12.354285 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560bb2c-a10c-4ecf-b3d9-95f762d77beb None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:12.371048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-3560bb2c-a10c-4ecf-b3d9-95f762d77beb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:12.371048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:12.371048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:12.371048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:12.371048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:12.371048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:12.371048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:12.371048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:12.371048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:12.371048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:12.371048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:12.371048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:12.371048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:28:12.371048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:28:12.371048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:28:12.372030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:28:12.372030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:12.372030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:12.372030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:12.372030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:12.372030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:12.372030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:12.372030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:12.372030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:12.372030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:12.372030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:12.372030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:12.372030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:12.372030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:12.372030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:12.372030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:12.372030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:12.373041 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:28:12.373041 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:28:12.373041 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:28:12.373041 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:28:12.373041 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:28:12.373041 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:28:12.373041 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:12.373041 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:12.373041 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 425/868] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:28:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:12.379621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5122f-e2fc-47e3-afd5-aca268b9614a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:12.443855 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:12.500177 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5122f-e2fc-47e3-afd5-aca268b9614a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:12.535691 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743451c0-ddc6-4025-a662-dbcde8a39f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:12.536621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743451c0-ddc6-4025-a662-dbcde8a39f23 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:12.537040 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743451c0-ddc6-4025-a662-dbcde8a39f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:12.537483 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743451c0-ddc6-4025-a662-dbcde8a39f23 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:12.538457 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743451c0-ddc6-4025-a662-dbcde8a39f23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:12.538957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743451c0-ddc6-4025-a662-dbcde8a39f23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:12.540531 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743451c0-ddc6-4025-a662-dbcde8a39f23 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:12.553467 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 444/869] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:28:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:12.559971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560bb2c-a10c-4ecf-b3d9-95f762d77beb None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:12.590314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:12.665782 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560bb2c-a10c-4ecf-b3d9-95f762d77beb None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:12.701716 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff442fb0-b9bb-49ed-b38f-829e22e159b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:12.702608 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff442fb0-b9bb-49ed-b38f-829e22e159b2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:12.703061 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff442fb0-b9bb-49ed-b38f-829e22e159b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:12.703496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff442fb0-b9bb-49ed-b38f-829e22e159b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:12.704454 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff442fb0-b9bb-49ed-b38f-829e22e159b2 None admin] RBAC: Adding query filter params (role.id=ab64ea6d0475430195af26a049485569, scope.project.id=423854cc8f524ecb8d740d1cb0053856, user.id=c15327c36c8c49ac87a3b3e9ab49eea7) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:12.704932 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff442fb0-b9bb-49ed-b38f-829e22e159b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:12.706510 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff442fb0-b9bb-49ed-b38f-829e22e159b2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:12.712882 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 426/870] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:28:12 2022] GET /identity/v3/role_assignments?user.id=c15327c36c8c49ac87a3b3e9ab49eea7&scope.project.id=423854cc8f524ecb8d740d1cb0053856&role.id=ab64ea6d0475430195af26a049485569 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:13.379678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7082fc-d746-4f6e-b67c-ac8dd1d925c9 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:13.380184 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7082fc-d746-4f6e-b67c-ac8dd1d925c9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:13.380261 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7082fc-d746-4f6e-b67c-ac8dd1d925c9 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:13.381951 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 445/871] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:13.387356 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97eb425-a879-4299-949c-69246f0f19cc None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:13.387648 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97eb425-a879-4299-949c-69246f0f19cc None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:13.387929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97eb425-a879-4299-949c-69246f0f19cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:13.406161 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c97eb425-a879-4299-949c-69246f0f19cc None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:13.407363 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c97eb425-a879-4299-949c-69246f0f19cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:13.482483 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 427/872] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:13.505482 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7082fc-d746-4f6e-b67c-ac8dd1d925c9 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:13.610283 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7082fc-d746-4f6e-b67c-ac8dd1d925c9 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:13.624154 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:13.645419 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9197f2b-6e90-4792-a85a-53aa37aec205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:13.646116 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9197f2b-6e90-4792-a85a-53aa37aec205 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:13.646399 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9197f2b-6e90-4792-a85a-53aa37aec205 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:13.646673 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9197f2b-6e90-4792-a85a-53aa37aec205 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:13.647439 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9197f2b-6e90-4792-a85a-53aa37aec205 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:13.648821 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9197f2b-6e90-4792-a85a-53aa37aec205 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:13.664528 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 446/873] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 30 10:28:13 2022] POST /identity/v3/services => generated 251 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:28:14.340460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa4542-a3aa-446c-8d68-73358cd9599b None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:14.340997 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa4542-a3aa-446c-8d68-73358cd9599b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:14.341075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa4542-a3aa-446c-8d68-73358cd9599b None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:14.342676 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 428/874] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:14.347844 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dd13a-7104-40d0-93ce-1014ff03e408 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:14.348401 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dd13a-7104-40d0-93ce-1014ff03e408 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:14.348905 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dd13a-7104-40d0-93ce-1014ff03e408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:14.365843 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-7d4dd13a-7104-40d0-93ce-1014ff03e408 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:14.367307 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7d4dd13a-7104-40d0-93ce-1014ff03e408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:14.442107 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 447/875] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:14 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:28:14.451705 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d76f5-eb19-4e3c-afd5-7e81bf59edf5 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:14.451999 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d76f5-eb19-4e3c-afd5-7e81bf59edf5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:14.452283 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d76f5-eb19-4e3c-afd5-7e81bf59edf5 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:14.453951 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 429/876] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:14.459040 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51330a-664e-4f82-9532-0df2c0af9057 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:14.459593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51330a-664e-4f82-9532-0df2c0af9057 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:14.460063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51330a-664e-4f82-9532-0df2c0af9057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:14.470606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d76f5-eb19-4e3c-afd5-7e81bf59edf5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:14.480572 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-1c51330a-664e-4f82-9532-0df2c0af9057 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:14.481766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1c51330a-664e-4f82-9532-0df2c0af9057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:14.493423 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:14.561930 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 448/877] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:14 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:14.585233 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d76f5-eb19-4e3c-afd5-7e81bf59edf5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:14.585580 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51330a-664e-4f82-9532-0df2c0af9057 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:14.617305 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:14.646830 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac466e-557c-466d-91ff-374036283aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:14.647635 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac466e-557c-466d-91ff-374036283aee None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:14.647920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac466e-557c-466d-91ff-374036283aee None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:14.648197 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac466e-557c-466d-91ff-374036283aee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:14.659145 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac466e-557c-466d-91ff-374036283aee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:28:14.667612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-50ac466e-557c-466d-91ff-374036283aee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:28:14.667612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:14.667612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:14.667612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:14.667612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:14.667612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:14.667612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:14.667612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:14.667612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:14.667612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:14.667612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:14.667612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:14.667612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:28:14.667612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:28:14.667612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:28:14.667612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:28:14.668543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:28:14.668543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:28:14.668543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:28:14.668543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:28:14.668543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:14.668543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:14.668543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:14.668543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:14.668543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:14.668543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:14.668543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:14.668543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:14.668543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:14.668543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:14.668543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:14.668543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:14.669418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:14.669418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:14.669418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:14.669418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:14.669418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:28:14.669418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:28:14.669418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:28:14.669418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:28:14.669418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:28:14.669418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:28:14.669418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:28:14.669418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:14.674239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 430/878] 10.222.0.59 () {56 vars in 1120 bytes} [Thu Jun 30 10:28:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:28:14.675102 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac466e-557c-466d-91ff-374036283aee None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:14.713031 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51330a-664e-4f82-9532-0df2c0af9057 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:14.759398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba02c8e-4fee-4f0f-9b27-76b6e1307d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:14.760731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba02c8e-4fee-4f0f-9b27-76b6e1307d43 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:14.761851 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba02c8e-4fee-4f0f-9b27-76b6e1307d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:14.762730 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:14.762986 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba02c8e-4fee-4f0f-9b27-76b6e1307d43 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:14.765163 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba02c8e-4fee-4f0f-9b27-76b6e1307d43 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:14.767503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba02c8e-4fee-4f0f-9b27-76b6e1307d43 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:14.787579 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac466e-557c-466d-91ff-374036283aee None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:14.791845 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 449/879] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 30 10:28:14 2022] POST /identity/v3/services => generated 269 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:28:14.836121 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe391c-3d53-46a3-9fcf-46984ddb8e26 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:14.836422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe391c-3d53-46a3-9fcf-46984ddb8e26 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:14.836632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe391c-3d53-46a3-9fcf-46984ddb8e26 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:14.838376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 450/880] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:28:14.843858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f672a-b89f-43fe-8bdf-9e8fadf001d4 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:14.844136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f672a-b89f-43fe-8bdf-9e8fadf001d4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:14.844433 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f672a-b89f-43fe-8bdf-9e8fadf001d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:14.848132 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76e870-03db-4e01-8621-b1b48312271d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:14.848915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76e870-03db-4e01-8621-b1b48312271d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:14.849463 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76e870-03db-4e01-8621-b1b48312271d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:14.849970 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76e870-03db-4e01-8621-b1b48312271d None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:14.851699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76e870-03db-4e01-8621-b1b48312271d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:14.852030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76e870-03db-4e01-8621-b1b48312271d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:14.853566 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76e870-03db-4e01-8621-b1b48312271d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:14.862671 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0d5f672a-b89f-43fe-8bdf-9e8fadf001d4 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:14.863877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0d5f672a-b89f-43fe-8bdf-9e8fadf001d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:14.864846 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 431/881] 10.222.0.59 () {56 vars in 1115 bytes} [Thu Jun 30 10:28:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:14.871128 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76e870-03db-4e01-8621-b1b48312271d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:14.941909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 451/882] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:28:14.964852 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f672a-b89f-43fe-8bdf-9e8fadf001d4 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:14.984819 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:14.986531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76e870-03db-4e01-8621-b1b48312271d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:15.028015 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b19921-c6a0-4d6f-9829-e9cfcb9c7232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:15.028841 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b19921-c6a0-4d6f-9829-e9cfcb9c7232 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:15.029129 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b19921-c6a0-4d6f-9829-e9cfcb9c7232 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:15.029797 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b19921-c6a0-4d6f-9829-e9cfcb9c7232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:15.040094 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:15.045693 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b19921-c6a0-4d6f-9829-e9cfcb9c7232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:15.047551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b19921-c6a0-4d6f-9829-e9cfcb9c7232 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:15.071569 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-59b19921-c6a0-4d6f-9829-e9cfcb9c7232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:15.071569 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:15.071569 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:15.071569 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:15.071569 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:15.071569 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:15.071569 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:15.071569 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:15.071569 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:15.071569 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:15.071569 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:15.071569 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:15.071569 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:28:15.071569 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:28:15.071569 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:28:15.072774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:28:15.072774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:15.072774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:15.072774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:15.072774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:15.072774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:15.072774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:15.072774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:15.072774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:15.072774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:15.072774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:15.072774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:15.072774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:15.072774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:15.072774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:15.072774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:15.072774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:15.073903 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:28:15.073903 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:28:15.073903 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:15.073903 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:15.077096 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 432/883] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:28:15.079360 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b19921-c6a0-4d6f-9829-e9cfcb9c7232 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:15.085676 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f672a-b89f-43fe-8bdf-9e8fadf001d4 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:15.122144 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc5512-9b28-465f-9980-fe0ef762bbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:15.123168 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc5512-9b28-465f-9980-fe0ef762bbb8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:15.123600 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc5512-9b28-465f-9980-fe0ef762bbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:15.124041 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc5512-9b28-465f-9980-fe0ef762bbb8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:15.124890 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc5512-9b28-465f-9980-fe0ef762bbb8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:15.126398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc5512-9b28-465f-9980-fe0ef762bbb8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:15.139124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-d7cc5512-9b28-465f-9980-fe0ef762bbb8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:28:15.139124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:15.139124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:28:15.139124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:28:15.139124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:28:15.139124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:28:15.139124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:28:15.139124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:15.139124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:28:15.139124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:15.139124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:28:15.139124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:15.139124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:15.139124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:15.139124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:15.139124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:15.139124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:15.140206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:15.140206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:15.140206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:15.140206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:15.140206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:15.140206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:15.140206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:28:15.140206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:28:15.140206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:28:15.140206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:28:15.140206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:15.140206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:15.140206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:15.140206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:15.140206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:15.140206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:15.141091 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:15.141091 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:15.141091 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:15.141091 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:15.141091 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:15.141091 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:15.141091 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:15.141091 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:15.141091 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:15.141091 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:15.141091 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:28:15.141091 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:15.141091 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:28:15.141091 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:15.143843 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 452/884] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 30 10:28:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:28:15.149360 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc5512-9b28-465f-9980-fe0ef762bbb8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:15.188374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b19921-c6a0-4d6f-9829-e9cfcb9c7232 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:15.226461 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292b897-e3c7-40d3-9d92-1bbfdbcaeb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:15.227143 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292b897-e3c7-40d3-9d92-1bbfdbcaeb44 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:15.227448 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292b897-e3c7-40d3-9d92-1bbfdbcaeb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:15.227718 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292b897-e3c7-40d3-9d92-1bbfdbcaeb44 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:15.228516 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292b897-e3c7-40d3-9d92-1bbfdbcaeb44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:15.228792 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292b897-e3c7-40d3-9d92-1bbfdbcaeb44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:15.230746 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292b897-e3c7-40d3-9d92-1bbfdbcaeb44 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:15.249565 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 433/885] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:15.251034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292b897-e3c7-40d3-9d92-1bbfdbcaeb44 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:15.253036 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:15.266905 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc5512-9b28-465f-9980-fe0ef762bbb8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:15.303629 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee561185-6428-4ccf-a8c0-2ebed0844344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:15.305049 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee561185-6428-4ccf-a8c0-2ebed0844344 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:15.305517 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee561185-6428-4ccf-a8c0-2ebed0844344 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:15.305968 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee561185-6428-4ccf-a8c0-2ebed0844344 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:15.306960 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee561185-6428-4ccf-a8c0-2ebed0844344 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:15.307450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee561185-6428-4ccf-a8c0-2ebed0844344 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:15.309089 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee561185-6428-4ccf-a8c0-2ebed0844344 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:15.314603 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 453/886] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Jun 30 10:28:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:15.319402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:15.320233 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee561185-6428-4ccf-a8c0-2ebed0844344 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:15.375627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292b897-e3c7-40d3-9d92-1bbfdbcaeb44 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:15.414682 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532fc44-3a6a-4e71-96fc-4f95d76d1924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:15.415791 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532fc44-3a6a-4e71-96fc-4f95d76d1924 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:15.416249 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532fc44-3a6a-4e71-96fc-4f95d76d1924 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:15.416762 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532fc44-3a6a-4e71-96fc-4f95d76d1924 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:15.425055 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532fc44-3a6a-4e71-96fc-4f95d76d1924 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:15.426740 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532fc44-3a6a-4e71-96fc-4f95d76d1924 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:15.432811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee561185-6428-4ccf-a8c0-2ebed0844344 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:15.442461 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-2532fc44-3a6a-4e71-96fc-4f95d76d1924 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:28:15.442461 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:15.442461 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:15.442461 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:15.442461 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:15.442461 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:15.442461 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:15.442461 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:15.442461 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:15.442461 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:15.442461 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:15.442461 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:15.442461 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:28:15.442461 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:28:15.442461 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:28:15.442461 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:28:15.443402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:15.443402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:15.443402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:28:15.443402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:15.443402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:28:15.443402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:15.443402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:15.443402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:15.443402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:15.443402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:15.443402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:15.443402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:15.443402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:15.443402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:15.443402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:15.443402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:15.443402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:15.443402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:15.444364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:15.444364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:15.444364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:28:15.444364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:28:15.444364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:28:15.444364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:28:15.444364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:28:15.444364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:28:15.444364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:28:15.444364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:15.447088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 434/887] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Jun 30 10:28:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:28:15.453426 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532fc44-3a6a-4e71-96fc-4f95d76d1924 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:15.475742 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c07f4d-8c7e-40e5-b535-ac6400b716a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:15.477123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c07f4d-8c7e-40e5-b535-ac6400b716a3 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:15.477577 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c07f4d-8c7e-40e5-b535-ac6400b716a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:15.478164 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c07f4d-8c7e-40e5-b535-ac6400b716a3 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:15.479309 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c07f4d-8c7e-40e5-b535-ac6400b716a3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:15.479828 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c07f4d-8c7e-40e5-b535-ac6400b716a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:15.481353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c07f4d-8c7e-40e5-b535-ac6400b716a3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:15.492925 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 454/888] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Jun 30 10:28:15 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:15.577014 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532fc44-3a6a-4e71-96fc-4f95d76d1924 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:15.590196 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:15.619451 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489977ae-d14d-4469-92ee-55cd90be55a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:15.620138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489977ae-d14d-4469-92ee-55cd90be55a8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:15.620554 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489977ae-d14d-4469-92ee-55cd90be55a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:15.620847 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489977ae-d14d-4469-92ee-55cd90be55a8 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:15.621753 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489977ae-d14d-4469-92ee-55cd90be55a8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:15.622075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489977ae-d14d-4469-92ee-55cd90be55a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:15.623540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489977ae-d14d-4469-92ee-55cd90be55a8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:15.648345 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 435/889] 10.222.0.59 () {56 vars in 1149 bytes} [Thu Jun 30 10:28:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:15.649816 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c07f4d-8c7e-40e5-b535-ac6400b716a3 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:15.674741 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:15.758245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c07f4d-8c7e-40e5-b535-ac6400b716a3 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:15.792632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c699e-1729-48d2-bc48-454c302de6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:15.792836 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437ade2-a553-4efe-a5dc-70bfa7674f44 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:15.793099 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437ade2-a553-4efe-a5dc-70bfa7674f44 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:15.793266 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c699e-1729-48d2-bc48-454c302de6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:15.793361 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437ade2-a553-4efe-a5dc-70bfa7674f44 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:15.793545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c699e-1729-48d2-bc48-454c302de6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:15.793813 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c699e-1729-48d2-bc48-454c302de6d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:15.796611 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 436/890] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:15.800459 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d79494-9e1f-4358-906e-555791df3a7d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:15.800807 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d79494-9e1f-4358-906e-555791df3a7d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:15.801090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d79494-9e1f-4358-906e-555791df3a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:15.820433 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-96d79494-9e1f-4358-906e-555791df3a7d None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:15.822141 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-96d79494-9e1f-4358-906e-555791df3a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:15.866370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c699e-1729-48d2-bc48-454c302de6d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:15.867940 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c699e-1729-48d2-bc48-454c302de6d6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:15.880688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:15.928681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 437/891] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:28:15.952130 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d79494-9e1f-4358-906e-555791df3a7d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:15.991703 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 455/892] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:28:15 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:28:15.993364 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c699e-1729-48d2-bc48-454c302de6d6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:16.066411 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:16.070580 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d79494-9e1f-4358-906e-555791df3a7d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:16.120122 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59e4f1-5c53-43bf-a196-2ff9c327407e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:16.120523 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c699e-1729-48d2-bc48-454c302de6d6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:16.121533 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59e4f1-5c53-43bf-a196-2ff9c327407e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:16.122272 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59e4f1-5c53-43bf-a196-2ff9c327407e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:16.123611 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59e4f1-5c53-43bf-a196-2ff9c327407e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:16.124481 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59e4f1-5c53-43bf-a196-2ff9c327407e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:16.126135 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59e4f1-5c53-43bf-a196-2ff9c327407e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:16.131821 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:16.144572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-db59e4f1-5c53-43bf-a196-2ff9c327407e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 10:28:16.144572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:16.144572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:28:16.144572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:28:16.144572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:28:16.144572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:28:16.144572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:28:16.144572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:16.144572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 10:28:16.144572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:16.144572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:28:16.144572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:16.144572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:16.144572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:16.144572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:16.144572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:16.144572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:16.145572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:16.145572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:16.145572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:16.145572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:16.145572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:16.145572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:16.145572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:28:16.145572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:28:16.145572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:28:16.145572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:28:16.145572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:16.145572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:16.145572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:16.145572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:16.145572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:16.145572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:16.146415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:16.146415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:16.146415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:16.146415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:16.146415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:16.146415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:16.146415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:16.146415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:16.146415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:16.146415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:16.146415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:28:16.146415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:16.146415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 10:28:16.146415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:16.154670 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 438/893] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 30 10:28:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:28:16.156458 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59e4f1-5c53-43bf-a196-2ff9c327407e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:16.165790 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75122454-2851-459d-b542-04fdec9ff69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:16.166707 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75122454-2851-459d-b542-04fdec9ff69b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:16.167085 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75122454-2851-459d-b542-04fdec9ff69b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:16.168011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75122454-2851-459d-b542-04fdec9ff69b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:16.179309 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75122454-2851-459d-b542-04fdec9ff69b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:16.180842 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75122454-2851-459d-b542-04fdec9ff69b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:16.199320 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-75122454-2851-459d-b542-04fdec9ff69b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:16.199320 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:16.199320 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:16.199320 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:16.199320 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:16.199320 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:16.199320 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:16.199320 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:16.199320 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:16.199320 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:16.199320 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:16.199320 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:16.199320 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:28:16.199320 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:28:16.199320 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:28:16.200459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:28:16.200459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:16.200459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:16.200459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:16.200459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:16.200459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:16.200459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:16.200459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:16.200459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:16.200459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:16.200459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:16.200459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:16.200459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:16.200459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:16.200459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:16.200459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:16.200459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:16.201621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:28:16.201621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:28:16.201621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:16.201621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:16.207346 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 456/894] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:16.209814 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75122454-2851-459d-b542-04fdec9ff69b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:16.291080 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59e4f1-5c53-43bf-a196-2ff9c327407e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:16.331012 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6ec8c-d627-41fd-b809-c2c036c7bd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:16.331815 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6ec8c-d627-41fd-b809-c2c036c7bd7d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:16.332200 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6ec8c-d627-41fd-b809-c2c036c7bd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:16.332881 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6ec8c-d627-41fd-b809-c2c036c7bd7d None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:16.333410 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6ec8c-d627-41fd-b809-c2c036c7bd7d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:16.333814 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6ec8c-d627-41fd-b809-c2c036c7bd7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:16.335352 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6ec8c-d627-41fd-b809-c2c036c7bd7d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:16.341342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 439/895] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 30 10:28:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:16.350330 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6ec8c-d627-41fd-b809-c2c036c7bd7d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:16.366315 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75122454-2851-459d-b542-04fdec9ff69b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:16.387816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:16.407161 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50ae29-6119-4acf-96a1-d01a8dffa1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:16.408391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50ae29-6119-4acf-96a1-d01a8dffa1cb None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:16.408851 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50ae29-6119-4acf-96a1-d01a8dffa1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:16.409277 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50ae29-6119-4acf-96a1-d01a8dffa1cb None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:16.410824 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50ae29-6119-4acf-96a1-d01a8dffa1cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:16.411314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50ae29-6119-4acf-96a1-d01a8dffa1cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:16.413027 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50ae29-6119-4acf-96a1-d01a8dffa1cb None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:16.433740 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 457/896] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:16.436827 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50ae29-6119-4acf-96a1-d01a8dffa1cb None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:16.469726 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:16.475516 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6ec8c-d627-41fd-b809-c2c036c7bd7d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:16.510956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e6e34-cea1-4b1e-8c5c-9156c25227a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:16.512318 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e6e34-cea1-4b1e-8c5c-9156c25227a5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:16.512824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e6e34-cea1-4b1e-8c5c-9156c25227a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:16.513174 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e6e34-cea1-4b1e-8c5c-9156c25227a5 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:16.514048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e6e34-cea1-4b1e-8c5c-9156c25227a5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:16.514377 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e6e34-cea1-4b1e-8c5c-9156c25227a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:16.515854 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e6e34-cea1-4b1e-8c5c-9156c25227a5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:16.526159 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 440/897] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 30 10:28:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:16.528198 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e6e34-cea1-4b1e-8c5c-9156c25227a5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:16.571310 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50ae29-6119-4acf-96a1-d01a8dffa1cb None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:16.610672 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a59555-475e-49db-9b8b-62d6535ff64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:16.611823 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a59555-475e-49db-9b8b-62d6535ff64e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:16.612106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a59555-475e-49db-9b8b-62d6535ff64e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:16.612460 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a59555-475e-49db-9b8b-62d6535ff64e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:16.620565 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a59555-475e-49db-9b8b-62d6535ff64e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:16.622012 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a59555-475e-49db-9b8b-62d6535ff64e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:16.637451 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:16.643594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-e3a59555-475e-49db-9b8b-62d6535ff64e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:16.643594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:16.643594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:16.643594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:16.643594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:16.643594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:16.643594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:16.643594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:16.643594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:16.643594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:16.643594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:16.643594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:16.643594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:28:16.643594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:28:16.643594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:28:16.644536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:28:16.644536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:16.644536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:16.644536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:16.644536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:16.644536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:16.644536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:16.644536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:16.644536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:16.644536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:16.644536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:16.644536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:16.644536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:16.644536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:16.644536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:16.644536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:16.644536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:16.650349 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:28:16.650349 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:28:16.650349 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:28:16.650349 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:28:16.650349 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:28:16.650349 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:28:16.650349 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:16.650349 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:16.650349 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 458/898] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:28:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:16.653970 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a59555-475e-49db-9b8b-62d6535ff64e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:16.662385 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e6e34-cea1-4b1e-8c5c-9156c25227a5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:16.701258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64b3ab-7016-4852-978f-ccfb5ad35a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:16.701912 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64b3ab-7016-4852-978f-ccfb5ad35a13 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:16.702199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64b3ab-7016-4852-978f-ccfb5ad35a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:16.702477 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64b3ab-7016-4852-978f-ccfb5ad35a13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:16.703320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64b3ab-7016-4852-978f-ccfb5ad35a13 None admin] RBAC: Adding query filter params (interface=public, service_id=fbcb4642bbd54602a847d54ad2766d5c, region_id=RegionOne) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:16.704327 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64b3ab-7016-4852-978f-ccfb5ad35a13 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:16.705054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64b3ab-7016-4852-978f-ccfb5ad35a13 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:16.718316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 441/899] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Jun 30 10:28:16 2022] GET /identity/v3/endpoints?service_id=fbcb4642bbd54602a847d54ad2766d5c&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:16.720402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64b3ab-7016-4852-978f-ccfb5ad35a13 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:16.760539 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:16.785771 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a59555-475e-49db-9b8b-62d6535ff64e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:16.834077 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f071228-0a66-49bb-96cb-93c1b54ea658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:16.835294 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f071228-0a66-49bb-96cb-93c1b54ea658 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:16.836099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f071228-0a66-49bb-96cb-93c1b54ea658 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:16.836833 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f071228-0a66-49bb-96cb-93c1b54ea658 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:16.838032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f071228-0a66-49bb-96cb-93c1b54ea658 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:16.838497 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f071228-0a66-49bb-96cb-93c1b54ea658 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:16.840842 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f071228-0a66-49bb-96cb-93c1b54ea658 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:16.841961 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64b3ab-7016-4852-978f-ccfb5ad35a13 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:16.855135 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 459/900] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:28:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:16.861527 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f071228-0a66-49bb-96cb-93c1b54ea658 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:16.890266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95cd0c-2072-4a33-bfc7-b3b27b5d13b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:16.891404 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95cd0c-2072-4a33-bfc7-b3b27b5d13b3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:16.892090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95cd0c-2072-4a33-bfc7-b3b27b5d13b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:16.892541 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95cd0c-2072-4a33-bfc7-b3b27b5d13b3 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:16.893960 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95cd0c-2072-4a33-bfc7-b3b27b5d13b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:16.895904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95cd0c-2072-4a33-bfc7-b3b27b5d13b3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:16.909209 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 442/901] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Jun 30 10:28:16 2022] GET /identity/v3/services => generated 1268 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:28:16.967877 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d30c9-7705-45c1-84e7-7f30cb7454a5 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:16.968088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d30c9-7705-45c1-84e7-7f30cb7454a5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:16.968370 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d30c9-7705-45c1-84e7-7f30cb7454a5 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:16.970055 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 443/902] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:28:16.978411 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b00154-e542-4d93-8a4e-5f10c723404c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:16.978721 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b00154-e542-4d93-8a4e-5f10c723404c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:16.978972 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b00154-e542-4d93-8a4e-5f10c723404c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:16.995879 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f071228-0a66-49bb-96cb-93c1b54ea658 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:17.002977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c5b00154-e542-4d93-8a4e-5f10c723404c None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:17.004301 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c5b00154-e542-4d93-8a4e-5f10c723404c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:17.026285 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:17.038544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ab17b-6e2e-4aa5-87e4-0c9ed4b7716e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:17.039605 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ab17b-6e2e-4aa5-87e4-0c9ed4b7716e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:17.040097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ab17b-6e2e-4aa5-87e4-0c9ed4b7716e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:17.040605 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ab17b-6e2e-4aa5-87e4-0c9ed4b7716e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:17.041603 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ab17b-6e2e-4aa5-87e4-0c9ed4b7716e None admin] RBAC: Adding query filter params (role.id=8cda5b4c7265463f8caa1f85608653ec, scope.project.id=423854cc8f524ecb8d740d1cb0053856, user.id=a2bd48e6390241448fe2cf098ab64df3) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:17.041923 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ab17b-6e2e-4aa5-87e4-0c9ed4b7716e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:17.043444 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ab17b-6e2e-4aa5-87e4-0c9ed4b7716e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:17.056567 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 460/903] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:28:16 2022] GET /identity/v3/role_assignments?user.id=a2bd48e6390241448fe2cf098ab64df3&scope.project.id=423854cc8f524ecb8d740d1cb0053856&role.id=8cda5b4c7265463f8caa1f85608653ec => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:17.098971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 444/904] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:16 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:28:17.123224 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ab17b-6e2e-4aa5-87e4-0c9ed4b7716e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:17.134931 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:17.239751 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ab17b-6e2e-4aa5-87e4-0c9ed4b7716e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:17.276455 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e61ea8-cd76-4376-aca3-6fcf91753e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:17.277324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e61ea8-cd76-4376-aca3-6fcf91753e12 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:17.277604 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e61ea8-cd76-4376-aca3-6fcf91753e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:17.277877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e61ea8-cd76-4376-aca3-6fcf91753e12 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:17.278530 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e61ea8-cd76-4376-aca3-6fcf91753e12 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:17.279947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e61ea8-cd76-4376-aca3-6fcf91753e12 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:17.293279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-e2e61ea8-cd76-4376-aca3-6fcf91753e12 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 10:28:17.293279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:17.293279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:28:17.293279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:28:17.293279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:28:17.293279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:28:17.293279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:28:17.293279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:17.293279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 10:28:17.293279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:17.293279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:28:17.293279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:17.293279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:17.293279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:17.293279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:17.293279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:17.294239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:17.294239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:17.294239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:17.294239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:17.294239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:17.294239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:17.294239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:17.294239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:28:17.294239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:28:17.294239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:28:17.294239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:28:17.294239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:17.294239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:17.294239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:17.294239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:17.294239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:17.295051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:17.295051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:17.295051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:17.295051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:17.295051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:17.295051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:17.295051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:17.295051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:17.295051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:17.295051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:17.295051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:17.295051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:28:17.295051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:17.295051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 10:28:17.295051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:17.295051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 461/905] 10.222.0.59 () {56 vars in 1132 bytes} [Thu Jun 30 10:28:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:17.300703 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b00154-e542-4d93-8a4e-5f10c723404c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:17.406255 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b00154-e542-4d93-8a4e-5f10c723404c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:17.442585 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9ef1d-dbf2-4602-9d9e-5cb232f38971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:17.443246 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9ef1d-dbf2-4602-9d9e-5cb232f38971 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:17.443533 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9ef1d-dbf2-4602-9d9e-5cb232f38971 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:17.443810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9ef1d-dbf2-4602-9d9e-5cb232f38971 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:17.444534 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9ef1d-dbf2-4602-9d9e-5cb232f38971 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:17.444855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9ef1d-dbf2-4602-9d9e-5cb232f38971 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:17.446228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9ef1d-dbf2-4602-9d9e-5cb232f38971 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:17.452996 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 445/906] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 30 10:28:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:17.456590 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e61ea8-cd76-4376-aca3-6fcf91753e12 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:17.533161 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:17.566798 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e61ea8-cd76-4376-aca3-6fcf91753e12 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:17.602670 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41310602-8e31-413d-9403-fd7eb93d6f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:17.604190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41310602-8e31-413d-9403-fd7eb93d6f7d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:17.604738 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41310602-8e31-413d-9403-fd7eb93d6f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:17.605748 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41310602-8e31-413d-9403-fd7eb93d6f7d None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:17.606641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41310602-8e31-413d-9403-fd7eb93d6f7d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:17.607177 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41310602-8e31-413d-9403-fd7eb93d6f7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:17.608775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41310602-8e31-413d-9403-fd7eb93d6f7d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:17.614639 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 462/907] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 30 10:28:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:17.622876 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9ef1d-dbf2-4602-9d9e-5cb232f38971 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:17.624386 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03adf0f3-ab20-4836-88ec-715b8f22a31f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:17.624716 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03adf0f3-ab20-4836-88ec-715b8f22a31f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:17.624995 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03adf0f3-ab20-4836-88ec-715b8f22a31f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:17.626442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 463/908] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:17.633794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30081ec-6ba3-4903-a85a-cdb9049d1bed None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:17.634343 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30081ec-6ba3-4903-a85a-cdb9049d1bed None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:17.634824 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30081ec-6ba3-4903-a85a-cdb9049d1bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:17.640017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:17.653790 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b30081ec-6ba3-4903-a85a-cdb9049d1bed None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:17.655262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b30081ec-6ba3-4903-a85a-cdb9049d1bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:17.732848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 464/909] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:28:17.733053 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9ef1d-dbf2-4602-9d9e-5cb232f38971 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:17.751895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30081ec-6ba3-4903-a85a-cdb9049d1bed None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:17.771738 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953c571-5d9b-48b6-b9a2-3c3a1ab6fef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:17.772369 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953c571-5d9b-48b6-b9a2-3c3a1ab6fef8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:17.772698 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953c571-5d9b-48b6-b9a2-3c3a1ab6fef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:17.772981 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953c571-5d9b-48b6-b9a2-3c3a1ab6fef8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:17.773771 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953c571-5d9b-48b6-b9a2-3c3a1ab6fef8 None admin] RBAC: Adding query filter params (interface=public, service_id=59f977682cc74af1bd41fb16b96e1eae, region_id=RegionOne) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:17.774089 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953c571-5d9b-48b6-b9a2-3c3a1ab6fef8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:17.775524 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953c571-5d9b-48b6-b9a2-3c3a1ab6fef8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:17.785821 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 446/910] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Jun 30 10:28:17 2022] GET /identity/v3/endpoints?service_id=59f977682cc74af1bd41fb16b96e1eae&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:17.787748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953c571-5d9b-48b6-b9a2-3c3a1ab6fef8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:17.828993 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:17.870392 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30081ec-6ba3-4903-a85a-cdb9049d1bed None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:17.873482 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:17.899361 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953c571-5d9b-48b6-b9a2-3c3a1ab6fef8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:17.906151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b139ee-858b-4826-8c7b-64456bdd7aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:17.906923 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b139ee-858b-4826-8c7b-64456bdd7aed None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:17.907306 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b139ee-858b-4826-8c7b-64456bdd7aed None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:17.907696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b139ee-858b-4826-8c7b-64456bdd7aed None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:17.908548 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b139ee-858b-4826-8c7b-64456bdd7aed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:17.910000 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b139ee-858b-4826-8c7b-64456bdd7aed None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:17.933353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 465/911] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 30 10:28:17 2022] POST /identity/v3/services => generated 241 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:28:17.946036 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405dd02-6103-4b00-ab05-bc44cbb24443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:17.946770 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405dd02-6103-4b00-ab05-bc44cbb24443 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:17.947063 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405dd02-6103-4b00-ab05-bc44cbb24443 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:17.947346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405dd02-6103-4b00-ab05-bc44cbb24443 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:17.948044 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405dd02-6103-4b00-ab05-bc44cbb24443 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:17.950082 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405dd02-6103-4b00-ab05-bc44cbb24443 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:17.957622 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 447/912] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Jun 30 10:28:17 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:28:19.040197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c251a0-ce97-49e6-9264-b5b133fb26d8 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:19.040752 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c251a0-ce97-49e6-9264-b5b133fb26d8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:19.040752 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c251a0-ce97-49e6-9264-b5b133fb26d8 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:19.042318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 466/913] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:19.047598 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210baf4-2540-435e-b0c8-1cbc7ddc1f3c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:19.047995 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210baf4-2540-435e-b0c8-1cbc7ddc1f3c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:19.048161 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210baf4-2540-435e-b0c8-1cbc7ddc1f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:19.065517 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6210baf4-2540-435e-b0c8-1cbc7ddc1f3c None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:19.066777 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6210baf4-2540-435e-b0c8-1cbc7ddc1f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:19.128487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3484d62-fef6-42e6-88f3-567cd06fece0 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:19.128815 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3484d62-fef6-42e6-88f3-567cd06fece0 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:19.129077 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3484d62-fef6-42e6-88f3-567cd06fece0 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:19.130687 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 467/914] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:19.135709 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0aebff-1cf0-4a41-ba60-2a6685b67948 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:19.136075 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0aebff-1cf0-4a41-ba60-2a6685b67948 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:19.136857 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0aebff-1cf0-4a41-ba60-2a6685b67948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:19.144172 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 448/915] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:19.154201 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-cc0aebff-1cf0-4a41-ba60-2a6685b67948 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:19.155396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-cc0aebff-1cf0-4a41-ba60-2a6685b67948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:19.167032 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210baf4-2540-435e-b0c8-1cbc7ddc1f3c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:19.232624 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 468/916] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:28:19.247490 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:19.252943 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0aebff-1cf0-4a41-ba60-2a6685b67948 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:19.291867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210baf4-2540-435e-b0c8-1cbc7ddc1f3c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:19.314297 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:19.328146 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e751330-d16e-4beb-bd0a-2b69bc97e53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:19.329263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e751330-d16e-4beb-bd0a-2b69bc97e53c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:19.329760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e751330-d16e-4beb-bd0a-2b69bc97e53c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:19.330266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e751330-d16e-4beb-bd0a-2b69bc97e53c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:19.331118 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e751330-d16e-4beb-bd0a-2b69bc97e53c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:19.332722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e751330-d16e-4beb-bd0a-2b69bc97e53c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:19.345148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-1e751330-d16e-4beb-bd0a-2b69bc97e53c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 10:28:19.345148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:19.345148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:28:19.345148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:28:19.345148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:28:19.345148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:28:19.345148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:28:19.345148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:19.345148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 10:28:19.345148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:19.345148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:28:19.345148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:19.345148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:19.345148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:19.345148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:19.345148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:19.345148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:19.346138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:19.346138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:19.346138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:19.346138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:19.346138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:19.346138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:19.346138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:28:19.346138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:28:19.346138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:28:19.346138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:28:19.346138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:19.346138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:19.346138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:19.346138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:19.346138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:19.346138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:19.346978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:19.346978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:19.346978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:19.346978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:19.346978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:19.346978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:19.346978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:19.346978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:19.346978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:19.346978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:19.346978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:28:19.346978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:19.346978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 10:28:19.346978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:19.350021 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 449/917] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 30 10:28:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:28:19.360544 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e751330-d16e-4beb-bd0a-2b69bc97e53c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:19.364463 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0aebff-1cf0-4a41-ba60-2a6685b67948 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:19.401923 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb647d-d983-4345-a47f-c380dec0892f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:19.402960 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb647d-d983-4345-a47f-c380dec0892f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:19.403386 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb647d-d983-4345-a47f-c380dec0892f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:19.403800 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb647d-d983-4345-a47f-c380dec0892f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:19.421595 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb647d-d983-4345-a47f-c380dec0892f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:28:19.433854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-d4bb647d-d983-4345-a47f-c380dec0892f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:28:19.433854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:19.433854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:19.433854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:19.433854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:19.433854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:19.433854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:19.433854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:19.433854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:19.433854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:19.433854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:19.433854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:19.433854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:28:19.433854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:28:19.433854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:28:19.433854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:28:19.434973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:28:19.434973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:28:19.434973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:28:19.434973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:28:19.434973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:19.434973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:19.434973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:19.434973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:19.434973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:19.434973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:19.434973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:19.434973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:19.434973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:19.434973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:19.434973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:19.434973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:19.435829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:19.435829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:19.435829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:19.435829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:19.435829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:28:19.435829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:28:19.435829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:28:19.435829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:28:19.435829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:28:19.435829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:28:19.435829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:28:19.435829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:19.435829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 469/918] 10.222.0.59 () {56 vars in 1120 bytes} [Thu Jun 30 10:28:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:19.441381 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb647d-d983-4345-a47f-c380dec0892f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:19.477376 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e751330-d16e-4beb-bd0a-2b69bc97e53c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:19.515927 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:19.524087 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217b99e-9a2d-4869-b668-b926a2d1028a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:19.525423 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217b99e-9a2d-4869-b668-b926a2d1028a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:19.526121 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217b99e-9a2d-4869-b668-b926a2d1028a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:19.526791 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217b99e-9a2d-4869-b668-b926a2d1028a None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:19.528165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217b99e-9a2d-4869-b668-b926a2d1028a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:19.528488 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217b99e-9a2d-4869-b668-b926a2d1028a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:19.530165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217b99e-9a2d-4869-b668-b926a2d1028a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:19.536589 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 450/919] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 30 10:28:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:19.541486 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217b99e-9a2d-4869-b668-b926a2d1028a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:19.571550 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb647d-d983-4345-a47f-c380dec0892f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:19.589402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:19.616600 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad36488-b71b-4375-8197-130a165437d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:19.617274 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad36488-b71b-4375-8197-130a165437d8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:19.617558 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad36488-b71b-4375-8197-130a165437d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:19.617835 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad36488-b71b-4375-8197-130a165437d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:19.618760 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad36488-b71b-4375-8197-130a165437d8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:19.619062 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad36488-b71b-4375-8197-130a165437d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:19.621737 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad36488-b71b-4375-8197-130a165437d8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:19.636662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 470/920] 10.222.0.59 () {56 vars in 1115 bytes} [Thu Jun 30 10:28:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:19.643080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad36488-b71b-4375-8197-130a165437d8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:19.659769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217b99e-9a2d-4869-b668-b926a2d1028a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:19.698441 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006b981-743d-45b5-85b5-ad8880fed584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:19.699463 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006b981-743d-45b5-85b5-ad8880fed584 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:19.700009 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006b981-743d-45b5-85b5-ad8880fed584 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:19.700489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006b981-743d-45b5-85b5-ad8880fed584 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:19.701647 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006b981-743d-45b5-85b5-ad8880fed584 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:19.702164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006b981-743d-45b5-85b5-ad8880fed584 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:19.703768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006b981-743d-45b5-85b5-ad8880fed584 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:19.709861 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 451/921] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 30 10:28:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:19.720555 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006b981-743d-45b5-85b5-ad8880fed584 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:19.766922 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad36488-b71b-4375-8197-130a165437d8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:19.781079 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:19.811965 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bad936-7c46-47bd-88f5-6eedd87abbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:19.812788 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bad936-7c46-47bd-88f5-6eedd87abbfc None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:19.813075 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bad936-7c46-47bd-88f5-6eedd87abbfc None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:19.813355 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bad936-7c46-47bd-88f5-6eedd87abbfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:19.828041 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bad936-7c46-47bd-88f5-6eedd87abbfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:19.828191 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006b981-743d-45b5-85b5-ad8880fed584 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:19.829449 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bad936-7c46-47bd-88f5-6eedd87abbfc None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:19.853934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-64bad936-7c46-47bd-88f5-6eedd87abbfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:19.853934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:19.853934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:19.853934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:19.853934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:19.853934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:19.853934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:19.853934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:19.853934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:19.853934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:19.853934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:19.853934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:19.853934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:28:19.853934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:28:19.853934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:28:19.855610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:28:19.855610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:19.855610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:19.855610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:19.855610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:19.855610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:19.855610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:19.855610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:19.855610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:19.855610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:19.855610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:19.855610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:19.855610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:19.855610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:19.855610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:19.855610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:19.855610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:19.856604 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:28:19.856604 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:28:19.856604 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:19.856604 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:19.860898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 471/922] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:19.862005 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bad936-7c46-47bd-88f5-6eedd87abbfc None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:19.872443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d73fa-2ad0-40d2-83af-6e6ce13c7a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:19.873499 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d73fa-2ad0-40d2-83af-6e6ce13c7a03 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:19.874049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d73fa-2ad0-40d2-83af-6e6ce13c7a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:19.874522 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d73fa-2ad0-40d2-83af-6e6ce13c7a03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:19.875602 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d73fa-2ad0-40d2-83af-6e6ce13c7a03 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:19.877375 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d73fa-2ad0-40d2-83af-6e6ce13c7a03 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:19.897016 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:19.912800 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 452/923] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Jun 30 10:28:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:28:19.991361 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bad936-7c46-47bd-88f5-6eedd87abbfc None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:20.037840 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f746fd-33b1-4fe1-bba1-8c9422dee349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:20.038516 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f746fd-33b1-4fe1-bba1-8c9422dee349 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:20.038795 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f746fd-33b1-4fe1-bba1-8c9422dee349 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:20.039065 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f746fd-33b1-4fe1-bba1-8c9422dee349 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:20.039845 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f746fd-33b1-4fe1-bba1-8c9422dee349 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:20.040148 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f746fd-33b1-4fe1-bba1-8c9422dee349 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:20.041652 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f746fd-33b1-4fe1-bba1-8c9422dee349 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:20.055286 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 472/924] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:20.061227 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d73fa-2ad0-40d2-83af-6e6ce13c7a03 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:20.070184 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd48a5e-1e51-40e3-9fea-e6606156bca5 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:20.070492 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd48a5e-1e51-40e3-9fea-e6606156bca5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:20.070791 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd48a5e-1e51-40e3-9fea-e6606156bca5 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:20.072576 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 473/925] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:20.078198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ee38f-5ca4-47d5-837e-29abda232208 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:20.078477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ee38f-5ca4-47d5-837e-29abda232208 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:20.078684 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ee38f-5ca4-47d5-837e-29abda232208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:20.096638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-665ee38f-5ca4-47d5-837e-29abda232208 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:20.098044 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-665ee38f-5ca4-47d5-837e-29abda232208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:20.174105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 474/926] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:20.175522 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9929bab-8430-4dff-9c4c-bf32a83bd694 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:20.175816 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9929bab-8430-4dff-9c4c-bf32a83bd694 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:20.176095 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9929bab-8430-4dff-9c4c-bf32a83bd694 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:20.177404 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 475/927] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:20.179841 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d73fa-2ad0-40d2-83af-6e6ce13c7a03 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:20.183621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a5331-17e7-4e28-b636-619a39507c22 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:20.184085 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a5331-17e7-4e28-b636-619a39507c22 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:20.184440 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a5331-17e7-4e28-b636-619a39507c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:20.199022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:20.202969 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-2c5a5331-17e7-4e28-b636-619a39507c22 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:20.204155 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2c5a5331-17e7-4e28-b636-619a39507c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:20.215329 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:20.227794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedb758-788d-4ae7-91f6-6edb14f5139c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:20.228451 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedb758-788d-4ae7-91f6-6edb14f5139c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:20.228786 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedb758-788d-4ae7-91f6-6edb14f5139c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:20.229092 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedb758-788d-4ae7-91f6-6edb14f5139c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:20.236917 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dedb758-788d-4ae7-91f6-6edb14f5139c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:20.238390 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dedb758-788d-4ae7-91f6-6edb14f5139c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:20.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-7dedb758-788d-4ae7-91f6-6edb14f5139c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:28:20.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:20.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:20.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:20.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:20.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:20.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:20.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:20.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:20.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:20.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:20.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:20.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:28:20.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:28:20.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:28:20.256088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:28:20.257346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:20.257346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:20.257346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:28:20.257346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:20.257346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:28:20.257346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:20.257346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:20.257346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:20.257346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:20.257346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:20.257346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:20.257346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:20.257346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:20.257346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:20.257346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:20.257346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:20.257346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:20.257346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:20.258312 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:20.258312 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:20.258312 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:28:20.258312 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:28:20.258312 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:28:20.258312 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:28:20.258312 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:28:20.258312 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:28:20.258312 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:28:20.258312 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:20.258312 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 453/928] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Jun 30 10:28:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:20.258312 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedb758-788d-4ae7-91f6-6edb14f5139c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:20.289378 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 476/929] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:20.290051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a5331-17e7-4e28-b636-619a39507c22 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:20.382280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedb758-788d-4ae7-91f6-6edb14f5139c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:20.395708 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a5331-17e7-4e28-b636-619a39507c22 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:20.419142 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a7a45-3c6c-4040-8af3-6157f916fe2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:20.420244 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a7a45-3c6c-4040-8af3-6157f916fe2c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:20.420564 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a7a45-3c6c-4040-8af3-6157f916fe2c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:20.420829 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a7a45-3c6c-4040-8af3-6157f916fe2c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:20.421471 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a7a45-3c6c-4040-8af3-6157f916fe2c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:20.423087 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a7a45-3c6c-4040-8af3-6157f916fe2c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:20.429967 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eec1e8-16f9-44db-8bef-66d0482501f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:20.430632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eec1e8-16f9-44db-8bef-66d0482501f7 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:20.430913 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eec1e8-16f9-44db-8bef-66d0482501f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:20.431188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eec1e8-16f9-44db-8bef-66d0482501f7 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:20.432008 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eec1e8-16f9-44db-8bef-66d0482501f7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:20.432316 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eec1e8-16f9-44db-8bef-66d0482501f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:20.433809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eec1e8-16f9-44db-8bef-66d0482501f7 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:20.435618 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-9d1a7a45-3c6c-4040-8af3-6157f916fe2c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:28:20.435618 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:20.435618 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:28:20.435618 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:28:20.435618 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:28:20.435618 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:28:20.435618 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:28:20.435618 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:20.435618 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:28:20.435618 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:20.435618 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:28:20.435618 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:20.435618 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:20.435618 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:20.435618 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:20.435618 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:20.435618 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:20.436677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:20.436677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:20.436677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:20.436677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:20.436677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:20.436677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:20.436677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:28:20.436677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:28:20.436677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:28:20.436677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:28:20.436677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:20.436677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:20.436677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:20.436677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:20.436677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:20.436677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:20.438247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:20.438247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:20.438247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:20.438247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:20.438247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:20.438247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:20.438247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:20.438247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:20.438247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:20.438247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:20.438247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:28:20.438247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:20.438247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:28:20.438247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:20.438247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 454/930] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 30 10:28:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:20.439065 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a7a45-3c6c-4040-8af3-6157f916fe2c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:20.457416 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 477/931] 10.222.0.59 () {56 vars in 1149 bytes} [Thu Jun 30 10:28:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:20.458244 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eec1e8-16f9-44db-8bef-66d0482501f7 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:20.460914 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:20.491494 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:20.559921 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a7a45-3c6c-4040-8af3-6157f916fe2c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:20.566325 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eec1e8-16f9-44db-8bef-66d0482501f7 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:20.596980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba8f97-5723-43a8-b840-51fd1e34a41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:20.597873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba8f97-5723-43a8-b840-51fd1e34a41d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:20.598226 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba8f97-5723-43a8-b840-51fd1e34a41d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:20.598596 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba8f97-5723-43a8-b840-51fd1e34a41d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:20.599594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba8f97-5723-43a8-b840-51fd1e34a41d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:20.600179 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ed088-1591-4ca1-a743-6b623f598e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:20.600938 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ed088-1591-4ca1-a743-6b623f598e0d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:20.601042 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba8f97-5723-43a8-b840-51fd1e34a41d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:20.601331 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ed088-1591-4ca1-a743-6b623f598e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:20.601675 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ed088-1591-4ca1-a743-6b623f598e0d None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:20.602437 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ed088-1591-4ca1-a743-6b623f598e0d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:20.602814 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ed088-1591-4ca1-a743-6b623f598e0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:20.604221 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ed088-1591-4ca1-a743-6b623f598e0d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:20.613539 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 478/932] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Jun 30 10:28:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:20.613539 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ed088-1591-4ca1-a743-6b623f598e0d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:20.614029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-08ba8f97-5723-43a8-b840-51fd1e34a41d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 10:28:20.614029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:20.614029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:28:20.614029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:28:20.614029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:28:20.614029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:28:20.614029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:28:20.614029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:20.614029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 10:28:20.614029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:20.614029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:28:20.614029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:20.614029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:20.614029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:20.614029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:20.614029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:20.615136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:20.615136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:20.615136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:20.615136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:20.615136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:20.615136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:20.615136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:20.615136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:28:20.615136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:28:20.615136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:28:20.615136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:28:20.615136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:20.615136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:20.615136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:20.615136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:20.615136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:20.616165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:20.616165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:20.616165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:20.616165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:20.616165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:20.616165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:20.616165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:20.616165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:20.616165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:20.616165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:20.616165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:20.616165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:28:20.616165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:20.616165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 10:28:20.616165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:20.620837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 455/933] 10.222.0.59 () {56 vars in 1132 bytes} [Thu Jun 30 10:28:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:20.621630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba8f97-5723-43a8-b840-51fd1e34a41d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:20.681222 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:20.720740 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ed088-1591-4ca1-a743-6b623f598e0d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:20.729102 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba8f97-5723-43a8-b840-51fd1e34a41d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:20.730921 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:20.756237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce63a1-d887-472f-9add-1296f1c62f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:20.757145 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce63a1-d887-472f-9add-1296f1c62f97 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:20.757492 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce63a1-d887-472f-9add-1296f1c62f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:20.757840 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce63a1-d887-472f-9add-1296f1c62f97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:20.768176 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce63a1-d887-472f-9add-1296f1c62f97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:20.768542 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81caad-93e8-4527-8181-f89fc3944655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:20.769294 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81caad-93e8-4527-8181-f89fc3944655 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:20.769641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce63a1-d887-472f-9add-1296f1c62f97 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:20.769763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81caad-93e8-4527-8181-f89fc3944655 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:20.770110 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81caad-93e8-4527-8181-f89fc3944655 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:20.770884 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81caad-93e8-4527-8181-f89fc3944655 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:20.771361 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81caad-93e8-4527-8181-f89fc3944655 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:20.772859 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81caad-93e8-4527-8181-f89fc3944655 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:20.782673 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 456/934] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Jun 30 10:28:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:20.782673 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81caad-93e8-4527-8181-f89fc3944655 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:20.792080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-73ce63a1-d887-472f-9add-1296f1c62f97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:20.792080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:20.792080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:20.792080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:20.792080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:20.792080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:20.792080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:20.792080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:20.792080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:20.792080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:20.792080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:20.792080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:20.792080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:28:20.792080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:28:20.792080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:28:20.793257 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:28:20.793257 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:20.793257 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:20.793257 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:20.793257 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:20.793257 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:20.793257 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:20.793257 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:20.793257 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:20.793257 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:20.793257 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:20.793257 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:20.793257 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:20.793257 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:20.793257 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:20.793257 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:20.793257 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:20.794390 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:28:20.794390 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:28:20.794390 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:20.794390 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:20.799312 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 479/935] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:20.799312 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce63a1-d887-472f-9add-1296f1c62f97 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:20.896860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81caad-93e8-4527-8181-f89fc3944655 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:20.905040 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce63a1-d887-472f-9add-1296f1c62f97 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:20.932196 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed997f-a196-4c64-a5a0-4c75b7e3e5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:20.932396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:20.933796 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed997f-a196-4c64-a5a0-4c75b7e3e5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:20.934051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed997f-a196-4c64-a5a0-4c75b7e3e5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:20.934381 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed997f-a196-4c64-a5a0-4c75b7e3e5f9 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:20.935100 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed997f-a196-4c64-a5a0-4c75b7e3e5f9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:20.935413 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed997f-a196-4c64-a5a0-4c75b7e3e5f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:20.936835 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed997f-a196-4c64-a5a0-4c75b7e3e5f9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:20.941852 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 457/936] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 30 10:28:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:20.942646 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed997f-a196-4c64-a5a0-4c75b7e3e5f9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:20.963000 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afbaa5-23aa-4c33-b575-d500788f6e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:20.963667 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afbaa5-23aa-4c33-b575-d500788f6e07 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:20.963953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afbaa5-23aa-4c33-b575-d500788f6e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:20.964259 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afbaa5-23aa-4c33-b575-d500788f6e07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:20.965073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afbaa5-23aa-4c33-b575-d500788f6e07 None admin] RBAC: Adding query filter params (interface=public, service_id=896612da3f88490c948d92c58668a704, region_id=RegionOne) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:20.965421 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afbaa5-23aa-4c33-b575-d500788f6e07 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:20.966756 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afbaa5-23aa-4c33-b575-d500788f6e07 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:20.977210 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 480/937] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Jun 30 10:28:20 2022] GET /identity/v3/endpoints?service_id=896612da3f88490c948d92c58668a704&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:20.977210 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afbaa5-23aa-4c33-b575-d500788f6e07 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:20.991554 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:21.074955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed997f-a196-4c64-a5a0-4c75b7e3e5f9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:21.084067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afbaa5-23aa-4c33-b575-d500788f6e07 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:21.110577 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48c592-8c28-4e08-acb7-0874768efd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:21.111234 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48c592-8c28-4e08-acb7-0874768efd5d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:21.111512 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48c592-8c28-4e08-acb7-0874768efd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:21.111784 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48c592-8c28-4e08-acb7-0874768efd5d None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:21.112484 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48c592-8c28-4e08-acb7-0874768efd5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:21.112834 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48c592-8c28-4e08-acb7-0874768efd5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:21.114192 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48c592-8c28-4e08-acb7-0874768efd5d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:21.122911 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693fef1-0e6f-43fb-8a97-96c5149084d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:21.123576 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693fef1-0e6f-43fb-8a97-96c5149084d2 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:21.123857 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693fef1-0e6f-43fb-8a97-96c5149084d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:21.124131 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693fef1-0e6f-43fb-8a97-96c5149084d2 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:21.124859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693fef1-0e6f-43fb-8a97-96c5149084d2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:21.125166 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693fef1-0e6f-43fb-8a97-96c5149084d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:21.130938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 458/938] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:21.131092 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693fef1-0e6f-43fb-8a97-96c5149084d2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:21.131206 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48c592-8c28-4e08-acb7-0874768efd5d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:21.135528 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 481/939] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 30 10:28:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:21.140112 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693fef1-0e6f-43fb-8a97-96c5149084d2 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:21.190223 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:21.226538 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:21.238754 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48c592-8c28-4e08-acb7-0874768efd5d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:21.246034 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693fef1-0e6f-43fb-8a97-96c5149084d2 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:21.284622 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555c0b6-6317-47f6-bd6e-2b9657ece55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:21.285414 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555c0b6-6317-47f6-bd6e-2b9657ece55d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:21.285768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555c0b6-6317-47f6-bd6e-2b9657ece55d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:21.286209 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555c0b6-6317-47f6-bd6e-2b9657ece55d None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:21.286853 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555c0b6-6317-47f6-bd6e-2b9657ece55d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:21.288312 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555c0b6-6317-47f6-bd6e-2b9657ece55d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:21.292820 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530998f6-353b-4743-9476-ebf77113b1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:21.293616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530998f6-353b-4743-9476-ebf77113b1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:21.293896 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530998f6-353b-4743-9476-ebf77113b1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:21.294169 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530998f6-353b-4743-9476-ebf77113b1a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:21.301037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 459/940] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Jun 30 10:28:21 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:28:21.301037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555c0b6-6317-47f6-bd6e-2b9657ece55d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:21.314807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530998f6-353b-4743-9476-ebf77113b1a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:21.316406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530998f6-353b-4743-9476-ebf77113b1a5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:21.332541 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-530998f6-353b-4743-9476-ebf77113b1a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:21.332541 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:21.332541 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:21.332541 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:21.332541 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:21.332541 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:21.332541 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:21.332541 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:21.332541 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:21.332541 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:21.332541 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:21.332541 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:21.332541 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:28:21.332541 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:28:21.332541 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:28:21.333593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:28:21.333593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:21.333593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:21.333593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:21.333593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:21.333593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:21.333593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:21.333593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:21.333593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:21.333593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:21.333593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:21.333593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:21.333593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:21.333593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:21.333593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:21.333593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:21.333593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:21.334559 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:28:21.334559 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:28:21.334559 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:28:21.334559 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:28:21.334559 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:28:21.334559 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:28:21.334559 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:21.334559 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:21.334559 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 482/941] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:28:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:21.341306 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530998f6-353b-4743-9476-ebf77113b1a5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:21.443790 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555c0b6-6317-47f6-bd6e-2b9657ece55d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:21.478676 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530998f6-353b-4743-9476-ebf77113b1a5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:21.488183 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:21.493815 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d8269-b889-4bcd-b1b2-a6603c3c02aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:21.494811 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d8269-b889-4bcd-b1b2-a6603c3c02aa None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:21.495103 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d8269-b889-4bcd-b1b2-a6603c3c02aa None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:21.495409 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d8269-b889-4bcd-b1b2-a6603c3c02aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:21.496130 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d8269-b889-4bcd-b1b2-a6603c3c02aa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:21.497864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d8269-b889-4bcd-b1b2-a6603c3c02aa None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:21.527489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 460/942] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Jun 30 10:28:21 2022] POST /identity/v3/endpoints => generated 347 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:28:21.533749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8004cf-24cf-45c8-9dad-1c8e025b8230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:21.534420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8004cf-24cf-45c8-9dad-1c8e025b8230 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:21.534704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8004cf-24cf-45c8-9dad-1c8e025b8230 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:21.534981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8004cf-24cf-45c8-9dad-1c8e025b8230 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:21.535841 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8004cf-24cf-45c8-9dad-1c8e025b8230 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:21.536166 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8004cf-24cf-45c8-9dad-1c8e025b8230 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:21.537815 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8004cf-24cf-45c8-9dad-1c8e025b8230 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:21.552528 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 483/943] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:28:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:21.558841 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d8269-b889-4bcd-b1b2-a6603c3c02aa None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:21.573979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:21.678440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d8269-b889-4bcd-b1b2-a6603c3c02aa None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:21.717447 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e277dc-68fc-4dc0-bce4-4e2b0f8fd00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:21.718282 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e277dc-68fc-4dc0-bce4-4e2b0f8fd00a None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:21.718558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e277dc-68fc-4dc0-bce4-4e2b0f8fd00a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:21.718950 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e277dc-68fc-4dc0-bce4-4e2b0f8fd00a None admin] PATH_INFO: `/v3/projects/423854cc8f524ecb8d740d1cb0053856/users/a2bd48e6390241448fe2cf098ab64df3/roles/8cda5b4c7265463f8caa1f85608653ec` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:21.722014 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e277dc-68fc-4dc0-bce4-4e2b0f8fd00a None admin] RBAC: Authorizing `identity:create_grant(project_id=423854cc8f524ecb8d740d1cb0053856, user_id=a2bd48e6390241448fe2cf098ab64df3, role_id=8cda5b4c7265463f8caa1f85608653ec)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:21.723469 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e277dc-68fc-4dc0-bce4-4e2b0f8fd00a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:21.738305 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 461/944] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 30 10:28:21 2022] PUT /identity/v3/projects/423854cc8f524ecb8d740d1cb0053856/users/a2bd48e6390241448fe2cf098ab64df3/roles/8cda5b4c7265463f8caa1f85608653ec => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:22.034171 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae74425-858b-41a9-be3c-c2e1cf1b35aa None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:22.034515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae74425-858b-41a9-be3c-c2e1cf1b35aa None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:22.034699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae74425-858b-41a9-be3c-c2e1cf1b35aa None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:22.036273 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 484/945] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:22.041807 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bafe4-3624-4cdc-bce6-96486e2110f7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:22.042095 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bafe4-3624-4cdc-bce6-96486e2110f7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:22.042434 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bafe4-3624-4cdc-bce6-96486e2110f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:22.060293 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3f2bafe4-3624-4cdc-bce6-96486e2110f7 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:22.061539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3f2bafe4-3624-4cdc-bce6-96486e2110f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:22.130672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:22.138586 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 462/946] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:28:22.162265 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae74425-858b-41a9-be3c-c2e1cf1b35aa None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:22.268783 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae74425-858b-41a9-be3c-c2e1cf1b35aa None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:22.304327 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e590a4-0647-4ac8-87a8-7a9dde5b17a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:22.304933 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e590a4-0647-4ac8-87a8-7a9dde5b17a2 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:22.305219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e590a4-0647-4ac8-87a8-7a9dde5b17a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:22.305527 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e590a4-0647-4ac8-87a8-7a9dde5b17a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:22.306234 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e590a4-0647-4ac8-87a8-7a9dde5b17a2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:22.307650 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e590a4-0647-4ac8-87a8-7a9dde5b17a2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:22.309062 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: WARNING keystone.server.flask.common [None req-b9e590a4-0647-4ac8-87a8-7a9dde5b17a2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 30 10:28:22.328370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.sql.core [None req-b9e590a4-0647-4ac8-87a8-7a9dde5b17a2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 30 10:28:22.328370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 30 10:28:22.328370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [parameters: {'id': '1b4641c455624ac18f6b4f290d72b5f9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 30 10:28:22.328370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80263) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 30 10:28:22.336245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-b9e590a4-0647-4ac8-87a8-7a9dde5b17a2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1b4641c455624ac18f6b4f290d72b5f9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1b4641c455624ac18f6b4f290d72b5f9. Jun 30 10:28:22.336245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:22.336245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 10:28:22.336245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 10:28:22.336245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 10:28:22.336245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 10:28:22.336245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 10:28:22.336245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 10:28:22.336245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 10:28:22.336245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application conn.query(q) Jun 30 10:28:22.336245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 10:28:22.336245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 10:28:22.336245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 10:28:22.337073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application result.read() Jun 30 10:28:22.337073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 10:28:22.337073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 10:28:22.337073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 10:28:22.337073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 10:28:22.337073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 10:28:22.337073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 10:28:22.337073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 10:28:22.337073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 10:28:22.337073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 30 10:28:22.337073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:22.337073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 30 10:28:22.337073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:22.337073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:22.337073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 30 10:28:22.337073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 30 10:28:22.337073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 30 10:28:22.337073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 30 10:28:22.338038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 10:28:22.338038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application next(self.gen) Jun 30 10:28:22.338038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 30 10:28:22.338038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application yield resource Jun 30 10:28:22.338038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 10:28:22.338038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application next(self.gen) Jun 30 10:28:22.338038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 30 10:28:22.338038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self.session.rollback() Jun 30 10:28:22.338038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 30 10:28:22.338038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self.force_reraise() Jun 30 10:28:22.338038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 30 10:28:22.338038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise self.value Jun 30 10:28:22.338038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 30 10:28:22.338038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 30 10:28:22.338038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 30 10:28:22.338038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application session.commit() Jun 30 10:28:22.338038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 30 10:28:22.340039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 30 10:28:22.340039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 30 10:28:22.340039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._prepare_impl() Jun 30 10:28:22.340039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 30 10:28:22.340039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self.session.flush() Jun 30 10:28:22.340039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 30 10:28:22.340039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._flush(objects) Jun 30 10:28:22.340039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 30 10:28:22.340039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 30 10:28:22.340039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 30 10:28:22.340039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application compat.raise_( Jun 30 10:28:22.340039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 10:28:22.340039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception Jun 30 10:28:22.340039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 30 10:28:22.340039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application flush_context.execute() Jun 30 10:28:22.340039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 30 10:28:22.340039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rec.execute(self) Jun 30 10:28:22.341083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 30 10:28:22.341083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 30 10:28:22.341083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 30 10:28:22.341083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 30 10:28:22.341083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 30 10:28:22.341083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 30 10:28:22.341083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 30 10:28:22.341083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 30 10:28:22.341083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 30 10:28:22.341083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 30 10:28:22.341083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 30 10:28:22.341083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 30 10:28:22.341083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 30 10:28:22.341083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 30 10:28:22.341083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 30 10:28:22.341875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 30 10:28:22.341875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 10:28:22.341875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception Jun 30 10:28:22.341875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 10:28:22.341875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 10:28:22.341875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 10:28:22.341875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 10:28:22.341875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 10:28:22.341875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 10:28:22.341875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 10:28:22.341875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application conn.query(q) Jun 30 10:28:22.341875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 10:28:22.341875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 10:28:22.341875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 10:28:22.341875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application result.read() Jun 30 10:28:22.341875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 10:28:22.341875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 10:28:22.342750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 10:28:22.342750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 10:28:22.342750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 10:28:22.342750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 10:28:22.342750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 10:28:22.342750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 10:28:22.342750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 30 10:28:22.342750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 30 10:28:22.342750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [parameters: {'id': '1b4641c455624ac18f6b4f290d72b5f9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 30 10:28:22.342750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 30 10:28:22.342750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:22.342750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:28:22.342750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:22.342750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:22.342750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 30 10:28:22.343564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 30 10:28:22.343564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 30 10:28:22.343564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 30 10:28:22.343564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 30 10:28:22.343564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:22.343564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:28:22.343564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:22.343564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:22.343564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:22.343564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:22.343564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:22.343564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:22.343564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:22.343564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:22.343564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:22.343564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:22.343564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:22.344453 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:22.344453 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 30 10:28:22.344453 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 30 10:28:22.344453 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:22.344453 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:22.344453 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 30 10:28:22.344453 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 30 10:28:22.344453 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1b4641c455624ac18f6b4f290d72b5f9. Jun 30 10:28:22.344453 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:22.344453 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 485/947] 10.222.0.59 () {60 vars in 1140 bytes} [Thu Jun 30 10:28:22 2022] POST /identity/v3/projects => generated 262 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:22.349783 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bafe4-3624-4cdc-bce6-96486e2110f7 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:22.450287 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bafe4-3624-4cdc-bce6-96486e2110f7 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:22.487483 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67b29c-3aa4-4767-a8af-ba52464aa1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:22.488625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67b29c-3aa4-4767-a8af-ba52464aa1fd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:22.489072 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67b29c-3aa4-4767-a8af-ba52464aa1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:22.489522 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67b29c-3aa4-4767-a8af-ba52464aa1fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:22.497582 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67b29c-3aa4-4767-a8af-ba52464aa1fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:22.499287 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67b29c-3aa4-4767-a8af-ba52464aa1fd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:22.514038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-df67b29c-3aa4-4767-a8af-ba52464aa1fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:22.514038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:22.514038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:22.514038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:22.514038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:22.514038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:22.514038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:22.514038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:22.514038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:22.514038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:22.514038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:22.514038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:22.514038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:28:22.514038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:28:22.514038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:28:22.515117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:28:22.515117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:22.515117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:22.515117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:22.515117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:22.515117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:22.515117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:22.515117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:22.515117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:22.515117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:22.515117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:22.515117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:22.515117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:22.515117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:22.515117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:22.515117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:22.515117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:22.516216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:28:22.516216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:28:22.516216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:28:22.516216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:28:22.516216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:28:22.516216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:28:22.516216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:22.516216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:22.518310 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 463/948] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:28:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:22.528296 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e590a4-0647-4ac8-87a8-7a9dde5b17a2 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:22.544974 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:22.630301 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e590a4-0647-4ac8-87a8-7a9dde5b17a2 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:22.665460 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2d9ae-d9dc-4a3f-b7c8-895ed9a1f05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:22.666119 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2d9ae-d9dc-4a3f-b7c8-895ed9a1f05c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:22.666411 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2d9ae-d9dc-4a3f-b7c8-895ed9a1f05c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:22.666691 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2d9ae-d9dc-4a3f-b7c8-895ed9a1f05c None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:22.667473 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2d9ae-d9dc-4a3f-b7c8-895ed9a1f05c None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:22.667787 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2d9ae-d9dc-4a3f-b7c8-895ed9a1f05c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:22.669498 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2d9ae-d9dc-4a3f-b7c8-895ed9a1f05c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:22.690228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 486/949] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 30 10:28:22 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:23.436282 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fffea1-e9a1-4b91-93d2-c470740b286b None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:23.437497 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fffea1-e9a1-4b91-93d2-c470740b286b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:23.438022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fffea1-e9a1-4b91-93d2-c470740b286b None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:23.439861 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 464/950] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:23.445344 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89537393-da3f-43d5-8479-8c5cf8fc6b66 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:23.446157 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89537393-da3f-43d5-8479-8c5cf8fc6b66 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:23.446723 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89537393-da3f-43d5-8479-8c5cf8fc6b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:23.464632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-89537393-da3f-43d5-8479-8c5cf8fc6b66 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:23.466497 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-89537393-da3f-43d5-8479-8c5cf8fc6b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:23.538724 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 487/951] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:23.562316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fffea1-e9a1-4b91-93d2-c470740b286b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:23.626321 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:23.670236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fffea1-e9a1-4b91-93d2-c470740b286b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:23.707993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa4c81-4b25-4804-bc7c-b01998d5a360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:23.708830 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa4c81-4b25-4804-bc7c-b01998d5a360 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:23.709111 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa4c81-4b25-4804-bc7c-b01998d5a360 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:23.709384 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa4c81-4b25-4804-bc7c-b01998d5a360 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:23.710035 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa4c81-4b25-4804-bc7c-b01998d5a360 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:23.711405 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa4c81-4b25-4804-bc7c-b01998d5a360 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:23.723520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-72fa4c81-4b25-4804-bc7c-b01998d5a360 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:28:23.723520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:23.723520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:28:23.723520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:28:23.723520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:28:23.723520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:28:23.723520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:28:23.723520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:23.723520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:28:23.723520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:23.723520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:28:23.723520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:23.723520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:23.723520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:23.723520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:23.723520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:23.723520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:23.724870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:23.724870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:23.724870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:23.724870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:23.724870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:23.724870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:23.724870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:28:23.724870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:28:23.724870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:28:23.724870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:28:23.724870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:23.724870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:23.724870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:23.724870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:23.724870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:23.724870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:23.725724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:23.725724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:23.725724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:23.725724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:23.725724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:23.725724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:23.725724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:23.725724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:23.725724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:23.725724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:23.725724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:28:23.725724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:23.725724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:28:23.725724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:23.725724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 465/952] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 30 10:28:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:23.731056 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787102e4-619c-4d71-a835-23520f7a2472 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:23.731406 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa4c81-4b25-4804-bc7c-b01998d5a360 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:23.731574 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787102e4-619c-4d71-a835-23520f7a2472 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:23.731742 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787102e4-619c-4d71-a835-23520f7a2472 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:23.737554 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 488/953] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:23.739155 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d4110-e9ea-4647-9825-7574138a9ee3 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:23.739440 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d4110-e9ea-4647-9825-7574138a9ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:23.739715 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d4110-e9ea-4647-9825-7574138a9ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:23.757328 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0e1d4110-e9ea-4647-9825-7574138a9ee3 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:23.758598 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0e1d4110-e9ea-4647-9825-7574138a9ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:23.768935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:23.842534 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa4c81-4b25-4804-bc7c-b01998d5a360 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:23.861954 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 489/954] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:28:23.876862 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:23.880809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf942e-e136-4289-b0e2-a3748e83ab36 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:23.880809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf942e-e136-4289-b0e2-a3748e83ab36 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:23.881110 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf942e-e136-4289-b0e2-a3748e83ab36 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:23.882752 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 490/955] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:23.883556 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf942e-e136-4289-b0e2-a3748e83ab36 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:23.888720 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689a0f0-0116-49b3-84d8-2f7fbcf05a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:23.889472 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689a0f0-0116-49b3-84d8-2f7fbcf05a61 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:23.889761 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689a0f0-0116-49b3-84d8-2f7fbcf05a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:23.890038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689a0f0-0116-49b3-84d8-2f7fbcf05a61 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:23.890754 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689a0f0-0116-49b3-84d8-2f7fbcf05a61 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:23.891065 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689a0f0-0116-49b3-84d8-2f7fbcf05a61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:23.892497 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689a0f0-0116-49b3-84d8-2f7fbcf05a61 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:23.898070 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 466/956] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Jun 30 10:28:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:23.899211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799d162-2741-490e-b378-ad97111a9eb8 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:23.899462 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799d162-2741-490e-b378-ad97111a9eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:23.899695 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799d162-2741-490e-b378-ad97111a9eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:23.921335 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b799d162-2741-490e-b378-ad97111a9eb8 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:23.922518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b799d162-2741-490e-b378-ad97111a9eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:23.991479 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 467/957] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:23.992381 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799d162-2741-490e-b378-ad97111a9eb8 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:24.001011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf942e-e136-4289-b0e2-a3748e83ab36 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:24.049048 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda69f3-4b53-471f-b43c-408bcd96b4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:24.050167 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda69f3-4b53-471f-b43c-408bcd96b4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:24.050445 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda69f3-4b53-471f-b43c-408bcd96b4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:24.050720 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda69f3-4b53-471f-b43c-408bcd96b4b2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:24.051357 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda69f3-4b53-471f-b43c-408bcd96b4b2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:24.052732 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda69f3-4b53-471f-b43c-408bcd96b4b2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:24.064829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-6fda69f3-4b53-471f-b43c-408bcd96b4b2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 10:28:24.064829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:24.064829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:28:24.064829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:28:24.064829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:28:24.064829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:28:24.064829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:28:24.064829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:24.064829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 10:28:24.064829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:24.064829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:28:24.064829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:24.064829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:24.064829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:24.064829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:24.064829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:24.064829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:24.066019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:24.066019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:24.066019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:24.066019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:24.066019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:24.066019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:24.066019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:28:24.066019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:28:24.066019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:28:24.066019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:28:24.066019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:24.066019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:24.066019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:24.066019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:24.066019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:24.066019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:24.066944 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:24.066944 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:24.066944 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:24.066944 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:24.066944 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:24.066944 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:24.066944 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:24.066944 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:24.066944 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:24.066944 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:24.066944 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:28:24.066944 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:24.066944 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 10:28:24.066944 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:24.070760 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 491/958] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:28:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:24.071471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda69f3-4b53-471f-b43c-408bcd96b4b2 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:24.075016 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:24.094031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799d162-2741-490e-b378-ad97111a9eb8 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:24.112093 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:24.129911 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84a6d2-06e8-4426-9914-610cfb6db64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:24.130652 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84a6d2-06e8-4426-9914-610cfb6db64d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:24.130940 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84a6d2-06e8-4426-9914-610cfb6db64d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:24.131215 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84a6d2-06e8-4426-9914-610cfb6db64d None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:24.131913 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84a6d2-06e8-4426-9914-610cfb6db64d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:24.132221 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84a6d2-06e8-4426-9914-610cfb6db64d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:24.133617 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84a6d2-06e8-4426-9914-610cfb6db64d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:24.138759 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 468/959] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Jun 30 10:28:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:24.139535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84a6d2-06e8-4426-9914-610cfb6db64d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:24.180934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda69f3-4b53-471f-b43c-408bcd96b4b2 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:24.216941 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66cc35-c23f-4464-bbd2-dc50cd88ee19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:24.217875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66cc35-c23f-4464-bbd2-dc50cd88ee19 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:24.218157 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66cc35-c23f-4464-bbd2-dc50cd88ee19 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:24.218429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66cc35-c23f-4464-bbd2-dc50cd88ee19 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:24.229278 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66cc35-c23f-4464-bbd2-dc50cd88ee19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:28:24.237669 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-db66cc35-c23f-4464-bbd2-dc50cd88ee19 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:28:24.237669 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:24.237669 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:24.237669 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:24.237669 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:24.237669 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:24.237669 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:24.237669 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:24.237669 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:24.237669 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:24.237669 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:24.237669 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:24.237669 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:28:24.237669 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:28:24.237669 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:28:24.237669 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:28:24.238622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:28:24.238622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:28:24.238622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:28:24.238622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:28:24.238622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:24.238622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:24.238622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:24.238622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:24.238622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:24.238622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:24.238622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:24.238622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:24.238622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:24.238622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:24.238622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:24.238622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:24.239472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:24.239472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:24.239472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:24.239472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:24.239472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:28:24.239472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:28:24.239472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:28:24.239472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:28:24.239472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:28:24.239472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:28:24.239472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:28:24.239472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:24.239472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 492/960] 10.222.0.59 () {56 vars in 1120 bytes} [Thu Jun 30 10:28:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:24.240198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66cc35-c23f-4464-bbd2-dc50cd88ee19 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:24.251370 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84a6d2-06e8-4426-9914-610cfb6db64d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:24.286643 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ca351-2726-4892-b405-2e8ffe5b2ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:24.287297 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ca351-2726-4892-b405-2e8ffe5b2ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:24.287577 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ca351-2726-4892-b405-2e8ffe5b2ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:24.287851 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ca351-2726-4892-b405-2e8ffe5b2ee1 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:24.288558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ca351-2726-4892-b405-2e8ffe5b2ee1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:24.288865 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ca351-2726-4892-b405-2e8ffe5b2ee1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:24.290234 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ca351-2726-4892-b405-2e8ffe5b2ee1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:24.295392 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 469/961] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 30 10:28:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:24.296153 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ca351-2726-4892-b405-2e8ffe5b2ee1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:24.318291 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:24.349748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:24.361573 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66cc35-c23f-4464-bbd2-dc50cd88ee19 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:24.397686 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b850d-22b3-46b1-a5a4-a0d40d8742f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:24.398340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b850d-22b3-46b1-a5a4-a0d40d8742f9 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:24.398615 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b850d-22b3-46b1-a5a4-a0d40d8742f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:24.398883 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b850d-22b3-46b1-a5a4-a0d40d8742f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:24.399604 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b850d-22b3-46b1-a5a4-a0d40d8742f9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:24.400983 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b850d-22b3-46b1-a5a4-a0d40d8742f9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:24.408105 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ca351-2726-4892-b405-2e8ffe5b2ee1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:24.428534 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 493/962] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Jun 30 10:28:24 2022] POST /identity/v3/endpoints => generated 349 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:28:24.428534 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b850d-22b3-46b1-a5a4-a0d40d8742f9 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:24.467776 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2d1ab-b8ee-4f2c-af7c-a052242a7911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:24.469003 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2d1ab-b8ee-4f2c-af7c-a052242a7911 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:24.469364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2d1ab-b8ee-4f2c-af7c-a052242a7911 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:24.469981 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2d1ab-b8ee-4f2c-af7c-a052242a7911 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:24.470815 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2d1ab-b8ee-4f2c-af7c-a052242a7911 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:24.471382 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2d1ab-b8ee-4f2c-af7c-a052242a7911 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:24.473545 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2d1ab-b8ee-4f2c-af7c-a052242a7911 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:24.485776 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 470/963] 10.222.0.59 () {56 vars in 1115 bytes} [Thu Jun 30 10:28:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:24.492928 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2d1ab-b8ee-4f2c-af7c-a052242a7911 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:24.577742 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b850d-22b3-46b1-a5a4-a0d40d8742f9 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:24.601917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:24.619660 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b4cc8-a339-412e-966f-9acd14e762fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:24.620870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b4cc8-a339-412e-966f-9acd14e762fe None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:24.621159 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b4cc8-a339-412e-966f-9acd14e762fe None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:24.621672 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b4cc8-a339-412e-966f-9acd14e762fe None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:24.622792 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b4cc8-a339-412e-966f-9acd14e762fe None admin] RBAC: Adding query filter params (type=compute) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:24.623101 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b4cc8-a339-412e-966f-9acd14e762fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:24.624631 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b4cc8-a339-412e-966f-9acd14e762fe None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:24.629481 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 494/964] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 30 10:28:24 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:24.636575 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2d1ab-b8ee-4f2c-af7c-a052242a7911 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:24.636835 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:24.680790 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3d35b-d794-4b8e-974e-ab9011476aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:24.682015 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3d35b-d794-4b8e-974e-ab9011476aea None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:24.682543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3d35b-d794-4b8e-974e-ab9011476aea None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:24.683587 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3d35b-d794-4b8e-974e-ab9011476aea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:24.696346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3d35b-d794-4b8e-974e-ab9011476aea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:24.698360 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3d35b-d794-4b8e-974e-ab9011476aea None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:24.718609 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-44e3d35b-d794-4b8e-974e-ab9011476aea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:24.718609 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:24.718609 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:24.718609 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:24.718609 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:24.718609 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:24.718609 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:24.718609 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:24.718609 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:24.718609 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:24.718609 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:24.718609 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:24.718609 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:28:24.718609 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:28:24.718609 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:28:24.719592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:28:24.719592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:24.719592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:24.719592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:24.719592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:24.719592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:24.719592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:24.719592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:24.719592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:24.719592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:24.719592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:24.719592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:24.719592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:24.719592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:24.719592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:24.719592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:24.719592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:24.720480 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:28:24.720480 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:28:24.720480 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:24.720480 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:24.722911 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 471/965] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:24.731920 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b4cc8-a339-412e-966f-9acd14e762fe None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:24.839951 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b4cc8-a339-412e-966f-9acd14e762fe None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:24.840799 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afd135-1e49-46ad-a08b-c60994ef6b7c None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:24.841094 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afd135-1e49-46ad-a08b-c60994ef6b7c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:24.841374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afd135-1e49-46ad-a08b-c60994ef6b7c None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:24.842761 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 472/966] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:28:24.847722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56677eea-9aa6-4ba6-a797-1731d9774802 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:24.847995 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56677eea-9aa6-4ba6-a797-1731d9774802 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:24.848273 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56677eea-9aa6-4ba6-a797-1731d9774802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:24.868631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-56677eea-9aa6-4ba6-a797-1731d9774802 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:24.870891 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-56677eea-9aa6-4ba6-a797-1731d9774802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:24.877836 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cff0cd-b1b7-48c9-b02c-faf287b25990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:24.878753 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cff0cd-b1b7-48c9-b02c-faf287b25990 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:24.879221 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cff0cd-b1b7-48c9-b02c-faf287b25990 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:24.879676 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cff0cd-b1b7-48c9-b02c-faf287b25990 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:24.880607 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cff0cd-b1b7-48c9-b02c-faf287b25990 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:24.881098 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cff0cd-b1b7-48c9-b02c-faf287b25990 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:24.882650 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cff0cd-b1b7-48c9-b02c-faf287b25990 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:24.895545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 495/967] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:24.901303 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cff0cd-b1b7-48c9-b02c-faf287b25990 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:24.952594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 473/968] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:28:24.964648 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:24.977363 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56677eea-9aa6-4ba6-a797-1731d9774802 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:25.038244 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cff0cd-b1b7-48c9-b02c-faf287b25990 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:25.083370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26340cab-a490-45e4-8066-1580325ed38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:25.084766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26340cab-a490-45e4-8066-1580325ed38c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:25.085236 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26340cab-a490-45e4-8066-1580325ed38c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:25.086056 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:25.086888 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26340cab-a490-45e4-8066-1580325ed38c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:25.098556 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26340cab-a490-45e4-8066-1580325ed38c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:25.101045 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26340cab-a490-45e4-8066-1580325ed38c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:25.106023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56677eea-9aa6-4ba6-a797-1731d9774802 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:25.123766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-26340cab-a490-45e4-8066-1580325ed38c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:28:25.123766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:25.123766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:25.123766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:25.123766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:25.123766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:25.123766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:25.123766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:25.123766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:25.123766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:25.123766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:25.123766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:25.123766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:28:25.123766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:28:25.123766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:28:25.123766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:28:25.124789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:25.124789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:25.124789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:28:25.124789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:25.124789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:28:25.124789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:25.124789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:25.124789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:25.124789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:25.124789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:25.124789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:25.124789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:25.124789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:25.124789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:25.124789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:25.124789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:25.124789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:25.124789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:25.125799 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:25.125799 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:25.125799 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:28:25.125799 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:28:25.125799 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:28:25.125799 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:28:25.125799 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:28:25.125799 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:28:25.125799 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:28:25.125799 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:25.135232 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 496/969] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Jun 30 10:28:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:25.135232 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26340cab-a490-45e4-8066-1580325ed38c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:25.145680 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89ae50-7542-45e8-aeed-2f07b5b5c130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:25.146346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89ae50-7542-45e8-aeed-2f07b5b5c130 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:25.146685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89ae50-7542-45e8-aeed-2f07b5b5c130 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:25.146966 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89ae50-7542-45e8-aeed-2f07b5b5c130 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:25.147673 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89ae50-7542-45e8-aeed-2f07b5b5c130 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:25.149144 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89ae50-7542-45e8-aeed-2f07b5b5c130 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:25.150439 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: WARNING keystone.server.flask.common [None req-5d89ae50-7542-45e8-aeed-2f07b5b5c130 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 30 10:28:25.162944 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.sql.core [None req-5d89ae50-7542-45e8-aeed-2f07b5b5c130 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 30 10:28:25.162944 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 30 10:28:25.162944 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [parameters: {'user_id': '151435a1312d401dbab929cb66fe51eb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 30 10:28:25.162944 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80264) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 30 10:28:25.181580 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-5d89ae50-7542-45e8-aeed-2f07b5b5c130 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 30 10:28:25.181580 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:25.181580 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 10:28:25.181580 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 10:28:25.181580 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 10:28:25.181580 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 10:28:25.181580 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 10:28:25.181580 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 10:28:25.181580 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 10:28:25.181580 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application conn.query(q) Jun 30 10:28:25.181580 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 10:28:25.181580 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 10:28:25.181580 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 10:28:25.181580 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application result.read() Jun 30 10:28:25.181580 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 10:28:25.182631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 10:28:25.182631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 10:28:25.182631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 10:28:25.182631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 10:28:25.182631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 10:28:25.182631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 10:28:25.182631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 10:28:25.182631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 30 10:28:25.182631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:25.182631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 30 10:28:25.182631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:25.182631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:25.182631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 30 10:28:25.182631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 30 10:28:25.182631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 30 10:28:25.182631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 30 10:28:25.182631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 10:28:25.182631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application next(self.gen) Jun 30 10:28:25.183878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 30 10:28:25.183878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application yield resource Jun 30 10:28:25.183878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 10:28:25.183878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application next(self.gen) Jun 30 10:28:25.183878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 30 10:28:25.183878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self.session.rollback() Jun 30 10:28:25.183878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 30 10:28:25.183878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self.force_reraise() Jun 30 10:28:25.183878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 30 10:28:25.183878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise self.value Jun 30 10:28:25.183878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 30 10:28:25.183878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 30 10:28:25.183878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 30 10:28:25.183878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application session.commit() Jun 30 10:28:25.183878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 30 10:28:25.183878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 30 10:28:25.183878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 30 10:28:25.185399 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._prepare_impl() Jun 30 10:28:25.185399 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 30 10:28:25.185399 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self.session.flush() Jun 30 10:28:25.185399 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 30 10:28:25.185399 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._flush(objects) Jun 30 10:28:25.185399 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 30 10:28:25.185399 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 30 10:28:25.185399 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 30 10:28:25.185399 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application compat.raise_( Jun 30 10:28:25.185399 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 10:28:25.185399 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception Jun 30 10:28:25.185399 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 30 10:28:25.185399 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application flush_context.execute() Jun 30 10:28:25.185399 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 30 10:28:25.185399 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rec.execute(self) Jun 30 10:28:25.185399 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 30 10:28:25.185399 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 30 10:28:25.187542 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 30 10:28:25.187542 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 30 10:28:25.187542 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 30 10:28:25.187542 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 30 10:28:25.187542 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 30 10:28:25.187542 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 30 10:28:25.187542 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 30 10:28:25.187542 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 30 10:28:25.187542 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 30 10:28:25.187542 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 30 10:28:25.187542 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 30 10:28:25.187542 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 30 10:28:25.187542 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 30 10:28:25.187542 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 30 10:28:25.187542 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 10:28:25.187542 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception Jun 30 10:28:25.189685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 10:28:25.189685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 10:28:25.189685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 10:28:25.189685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 10:28:25.189685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 10:28:25.189685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 10:28:25.189685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 10:28:25.189685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application conn.query(q) Jun 30 10:28:25.189685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 10:28:25.189685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 10:28:25.189685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 10:28:25.189685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application result.read() Jun 30 10:28:25.189685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 10:28:25.189685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 10:28:25.189685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 10:28:25.189685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 10:28:25.191784 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 10:28:25.191784 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 10:28:25.191784 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 10:28:25.191784 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 10:28:25.191784 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 30 10:28:25.191784 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 30 10:28:25.191784 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [parameters: {'user_id': '151435a1312d401dbab929cb66fe51eb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 30 10:28:25.191784 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 30 10:28:25.191784 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:25.191784 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:28:25.191784 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:25.191784 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:25.191784 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:25.191784 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:25.191784 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:25.194314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:25.194314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:25.194314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:25.194314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:25.194314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:25.194314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:25.194314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:25.194314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 30 10:28:25.194314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 30 10:28:25.194314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:25.194314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:25.194314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:28:25.194314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:25.194314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:28:25.194314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:25.194314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 30 10:28:25.194314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 30 10:28:25.197931 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 30 10:28:25.197931 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 30 10:28:25.197931 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 30 10:28:25.197931 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 30 10:28:25.197931 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 30 10:28:25.197931 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:25.197931 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 474/970] 10.222.0.59 () {60 vars in 1131 bytes} [Thu Jun 30 10:28:24 2022] POST /identity/v3/users => generated 160 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:25.197931 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89ae50-7542-45e8-aeed-2f07b5b5c130 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:25.267378 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26340cab-a490-45e4-8066-1580325ed38c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:25.269358 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:25.301383 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89ae50-7542-45e8-aeed-2f07b5b5c130 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:25.311192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a2522-5c95-41c2-8820-71d54eadfbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:25.312225 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a2522-5c95-41c2-8820-71d54eadfbf1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:25.312877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a2522-5c95-41c2-8820-71d54eadfbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:25.313361 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a2522-5c95-41c2-8820-71d54eadfbf1 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:25.314391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a2522-5c95-41c2-8820-71d54eadfbf1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:25.314904 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a2522-5c95-41c2-8820-71d54eadfbf1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:25.316787 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a2522-5c95-41c2-8820-71d54eadfbf1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:25.336753 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 497/971] 10.222.0.59 () {56 vars in 1149 bytes} [Thu Jun 30 10:28:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:25.341492 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e554ce-a059-4bd3-a1f0-87ff9ca5d8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:25.342321 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e554ce-a059-4bd3-a1f0-87ff9ca5d8be None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:25.342612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e554ce-a059-4bd3-a1f0-87ff9ca5d8be None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:25.342889 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e554ce-a059-4bd3-a1f0-87ff9ca5d8be None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:25.344842 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a2522-5c95-41c2-8820-71d54eadfbf1 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:25.351312 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e554ce-a059-4bd3-a1f0-87ff9ca5d8be None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:25.353027 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e554ce-a059-4bd3-a1f0-87ff9ca5d8be None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:25.369489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-b8e554ce-a059-4bd3-a1f0-87ff9ca5d8be None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 10:28:25.369489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:25.369489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:25.369489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:25.369489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:25.369489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:25.369489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:25.369489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:25.369489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:25.369489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:25.369489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:25.369489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:25.369489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:28:25.369489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:28:25.369489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:28:25.369489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:28:25.370493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:25.370493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:25.370493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:28:25.370493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:25.370493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:28:25.370493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:25.370493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:25.370493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:25.370493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:25.370493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:25.370493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:25.370493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:25.370493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:25.370493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:25.370493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:25.370493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:25.370493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:25.370493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:25.371468 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:25.371468 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:25.371468 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:28:25.371468 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:28:25.371468 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:28:25.371468 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:28:25.371468 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:28:25.371468 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:28:25.371468 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 10:28:25.371468 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:25.375341 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 475/972] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:28:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:25.376716 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e554ce-a059-4bd3-a1f0-87ff9ca5d8be None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:25.388151 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:25.461939 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a2522-5c95-41c2-8820-71d54eadfbf1 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:25.486017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e554ce-a059-4bd3-a1f0-87ff9ca5d8be None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:25.501113 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153249d-d20c-4567-b32f-3c4ba01dff77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:25.502348 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153249d-d20c-4567-b32f-3c4ba01dff77 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:25.502841 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153249d-d20c-4567-b32f-3c4ba01dff77 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:25.503582 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153249d-d20c-4567-b32f-3c4ba01dff77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:25.529794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2eead-412f-4f51-887b-9f416838f49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:25.531063 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2eead-412f-4f51-887b-9f416838f49e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:25.531800 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2eead-412f-4f51-887b-9f416838f49e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:25.532267 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2eead-412f-4f51-887b-9f416838f49e None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:25.533449 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2eead-412f-4f51-887b-9f416838f49e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:25.533781 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:25.534132 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2eead-412f-4f51-887b-9f416838f49e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:25.536457 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2eead-412f-4f51-887b-9f416838f49e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:25.582466 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153249d-d20c-4567-b32f-3c4ba01dff77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:25.584550 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153249d-d20c-4567-b32f-3c4ba01dff77 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:25.589815 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 476/973] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 30 10:28:25 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:25.700171 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 498/974] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:28:25 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 10:28:25.706093 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2eead-412f-4f51-887b-9f416838f49e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:25.780697 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:25.820893 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2eead-412f-4f51-887b-9f416838f49e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:25.859311 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009a52e-a6a7-4e36-b1c3-aea18aa8fb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:25.860110 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009a52e-a6a7-4e36-b1c3-aea18aa8fb9a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:25.860396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009a52e-a6a7-4e36-b1c3-aea18aa8fb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:25.860706 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009a52e-a6a7-4e36-b1c3-aea18aa8fb9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:25.871753 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009a52e-a6a7-4e36-b1c3-aea18aa8fb9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:25.873217 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009a52e-a6a7-4e36-b1c3-aea18aa8fb9a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:25.891705 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-8009a52e-a6a7-4e36-b1c3-aea18aa8fb9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:25.891705 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:25.891705 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:25.891705 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:25.891705 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:25.891705 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:25.891705 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:25.891705 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:25.891705 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:25.891705 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:25.891705 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:25.891705 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:25.891705 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:28:25.891705 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:28:25.891705 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:28:25.892934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:28:25.892934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:25.892934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:25.892934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:25.892934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:25.892934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:25.892934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:25.892934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:25.892934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:25.892934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:25.892934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:25.892934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:25.892934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:25.892934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:25.892934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:25.892934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:25.892934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:25.893835 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:28:25.893835 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:28:25.893835 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:25.893835 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:25.893835 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 477/975] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:25.898510 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153249d-d20c-4567-b32f-3c4ba01dff77 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:25.957678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:25.998291 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153249d-d20c-4567-b32f-3c4ba01dff77 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:26.033671 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d3e95-c676-46f3-b496-11244ad8e831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:26.034337 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d3e95-c676-46f3-b496-11244ad8e831 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:26.034620 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d3e95-c676-46f3-b496-11244ad8e831 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:26.034897 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d3e95-c676-46f3-b496-11244ad8e831 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:26.035602 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d3e95-c676-46f3-b496-11244ad8e831 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:26.035913 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d3e95-c676-46f3-b496-11244ad8e831 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:26.037295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d3e95-c676-46f3-b496-11244ad8e831 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:26.053016 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 499/976] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:26.054764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009a52e-a6a7-4e36-b1c3-aea18aa8fb9a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:26.157052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009a52e-a6a7-4e36-b1c3-aea18aa8fb9a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:26.174108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:26.192209 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b766c4-47fb-442a-9dd9-be19d38e14bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:26.193106 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b766c4-47fb-442a-9dd9-be19d38e14bc None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:26.193454 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b766c4-47fb-442a-9dd9-be19d38e14bc None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:26.193794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b766c4-47fb-442a-9dd9-be19d38e14bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:26.200590 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b766c4-47fb-442a-9dd9-be19d38e14bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:26.202121 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b766c4-47fb-442a-9dd9-be19d38e14bc None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:26.216440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-18b766c4-47fb-442a-9dd9-be19d38e14bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:26.216440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:26.216440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:26.216440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:26.216440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:26.216440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:26.216440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:26.216440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:26.216440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:26.216440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:26.216440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:26.216440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:26.216440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:28:26.216440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:28:26.216440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:28:26.217535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:28:26.217535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:26.217535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:26.217535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:26.217535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:26.217535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:26.217535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:26.217535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:26.217535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:26.217535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:26.217535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:26.217535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:26.217535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:26.217535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:26.217535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:26.217535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:26.217535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:26.218669 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:28:26.218669 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:28:26.218669 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:28:26.218669 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:28:26.218669 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:28:26.218669 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:28:26.218669 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:26.218669 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:26.220308 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 478/977] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:28:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:28:26.225260 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d3e95-c676-46f3-b496-11244ad8e831 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:26.334783 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d3e95-c676-46f3-b496-11244ad8e831 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:26.355374 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:26.371082 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef998a-a257-4e1e-84df-48225394ea6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:26.371746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef998a-a257-4e1e-84df-48225394ea6a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:26.372027 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef998a-a257-4e1e-84df-48225394ea6a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:26.372320 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef998a-a257-4e1e-84df-48225394ea6a None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:26.373177 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef998a-a257-4e1e-84df-48225394ea6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:26.373487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef998a-a257-4e1e-84df-48225394ea6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:26.374926 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef998a-a257-4e1e-84df-48225394ea6a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:26.387182 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 500/978] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:28:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:26.393021 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b766c4-47fb-442a-9dd9-be19d38e14bc None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:26.494794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b766c4-47fb-442a-9dd9-be19d38e14bc None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:26.529171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605efbe1-f06d-48ae-a3e6-13caf9981995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:26.529819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605efbe1-f06d-48ae-a3e6-13caf9981995 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:26.530102 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605efbe1-f06d-48ae-a3e6-13caf9981995 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:26.530379 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605efbe1-f06d-48ae-a3e6-13caf9981995 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:26.531198 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605efbe1-f06d-48ae-a3e6-13caf9981995 None admin] RBAC: Adding query filter params (role.id=8cda5b4c7265463f8caa1f85608653ec, scope.project.id=423854cc8f524ecb8d740d1cb0053856, user.id=a2bd48e6390241448fe2cf098ab64df3) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:26.531513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605efbe1-f06d-48ae-a3e6-13caf9981995 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:26.532973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605efbe1-f06d-48ae-a3e6-13caf9981995 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:26.544596 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 479/979] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:28:26 2022] GET /identity/v3/role_assignments?user.id=a2bd48e6390241448fe2cf098ab64df3&scope.project.id=423854cc8f524ecb8d740d1cb0053856&role.id=8cda5b4c7265463f8caa1f85608653ec => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:26.611945 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22529e5-985b-44f6-a11f-107662b4d0f0 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:26.612614 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22529e5-985b-44f6-a11f-107662b4d0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:26.612614 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22529e5-985b-44f6-a11f-107662b4d0f0 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:26.614120 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 501/980] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:26.619651 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5a476-0bfc-427d-8dcf-3badd9d17fca None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:26.619947 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5a476-0bfc-427d-8dcf-3badd9d17fca None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:26.620265 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5a476-0bfc-427d-8dcf-3badd9d17fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:26.637763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-aec5a476-0bfc-427d-8dcf-3badd9d17fca None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:26.639301 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-aec5a476-0bfc-427d-8dcf-3badd9d17fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:26.680048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:26.718743 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 480/981] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:26.742390 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22529e5-985b-44f6-a11f-107662b4d0f0 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:26.800556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bd48d-0cf7-489d-b4e7-868e19000843 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:26.800895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bd48d-0cf7-489d-b4e7-868e19000843 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:26.801248 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bd48d-0cf7-489d-b4e7-868e19000843 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:26.802716 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 481/982] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:28:26.807690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767bc79-4457-4e76-975c-b531343ee55f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:26.807983 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767bc79-4457-4e76-975c-b531343ee55f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:26.808259 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767bc79-4457-4e76-975c-b531343ee55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:26.824842 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d767bc79-4457-4e76-975c-b531343ee55f None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:26.826006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d767bc79-4457-4e76-975c-b531343ee55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:26.850821 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22529e5-985b-44f6-a11f-107662b4d0f0 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:26.887663 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f40c5f-e445-41d0-93fb-11704c2909f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:26.888455 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f40c5f-e445-41d0-93fb-11704c2909f7 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:26.888762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f40c5f-e445-41d0-93fb-11704c2909f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:26.889034 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f40c5f-e445-41d0-93fb-11704c2909f7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:26.889670 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f40c5f-e445-41d0-93fb-11704c2909f7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:26.891011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f40c5f-e445-41d0-93fb-11704c2909f7 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:26.897790 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 482/983] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:28:26.903340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-e1f40c5f-e445-41d0-93fb-11704c2909f7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:28:26.903340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:26.903340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:28:26.903340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:28:26.903340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:28:26.903340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:28:26.903340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:28:26.903340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:26.903340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:28:26.903340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:26.903340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:28:26.903340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:26.903340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:26.903340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:26.903340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:26.903340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:26.903340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:26.904362 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:26.904362 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:26.904362 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:26.904362 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:26.904362 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:26.904362 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:26.904362 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:28:26.904362 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:28:26.904362 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:28:26.904362 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:28:26.904362 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:26.904362 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:26.904362 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:26.904362 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:26.904362 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:26.904362 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:26.909598 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:26.909598 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:26.909598 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:26.909598 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:26.909598 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:26.909598 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:26.909598 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:26.909598 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:26.909598 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:26.909598 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:26.909598 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:28:26.909598 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:26.909598 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:28:26.909598 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:26.909598 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 502/984] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 30 10:28:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:26.912526 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767bc79-4457-4e76-975c-b531343ee55f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:26.921435 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f40c5f-e445-41d0-93fb-11704c2909f7 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:26.971950 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:27.022630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767bc79-4457-4e76-975c-b531343ee55f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:27.024199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:27.035595 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f40c5f-e445-41d0-93fb-11704c2909f7 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:27.060524 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d7a59-7f9f-4528-93a5-9a32074c0e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:27.061105 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d7a59-7f9f-4528-93a5-9a32074c0e84 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:27.061385 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d7a59-7f9f-4528-93a5-9a32074c0e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:27.061661 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d7a59-7f9f-4528-93a5-9a32074c0e84 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:27.062355 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d7a59-7f9f-4528-93a5-9a32074c0e84 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:27.062658 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d7a59-7f9f-4528-93a5-9a32074c0e84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:27.064018 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d7a59-7f9f-4528-93a5-9a32074c0e84 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:27.072845 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 483/985] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Jun 30 10:28:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:27.075172 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d7a59-7f9f-4528-93a5-9a32074c0e84 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:27.076356 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfbe4f-2b70-4757-9e0a-4d73f8cba7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:27.077090 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfbe4f-2b70-4757-9e0a-4d73f8cba7d8 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:27.077376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfbe4f-2b70-4757-9e0a-4d73f8cba7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:27.077653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfbe4f-2b70-4757-9e0a-4d73f8cba7d8 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:27.078383 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcfbe4f-2b70-4757-9e0a-4d73f8cba7d8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:27.080035 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcfbe4f-2b70-4757-9e0a-4d73f8cba7d8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:27.095959 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 503/986] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 30 10:28:26 2022] POST /identity/v3/services => generated 242 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:28:27.190840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d7a59-7f9f-4528-93a5-9a32074c0e84 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:27.236305 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0cac7-ee00-4a0f-8e85-c3b155b866af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:27.237058 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0cac7-ee00-4a0f-8e85-c3b155b866af None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:27.237350 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0cac7-ee00-4a0f-8e85-c3b155b866af None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:27.237627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0cac7-ee00-4a0f-8e85-c3b155b866af None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:27.238329 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0cac7-ee00-4a0f-8e85-c3b155b866af None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:27.238639 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0cac7-ee00-4a0f-8e85-c3b155b866af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:27.240018 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0cac7-ee00-4a0f-8e85-c3b155b866af None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:27.246168 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 484/987] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Jun 30 10:28:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:27.252221 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfbe4f-2b70-4757-9e0a-4d73f8cba7d8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:27.358972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfbe4f-2b70-4757-9e0a-4d73f8cba7d8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:27.361263 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:27.396588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56aa52-e311-4bb0-b1d7-2097a128374b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:27.397242 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56aa52-e311-4bb0-b1d7-2097a128374b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:27.397523 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56aa52-e311-4bb0-b1d7-2097a128374b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:27.397797 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56aa52-e311-4bb0-b1d7-2097a128374b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:27.398586 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f56aa52-e311-4bb0-b1d7-2097a128374b None admin] RBAC: Adding query filter params (interface=admin, service_id=896612da3f88490c948d92c58668a704, region_id=RegionOne) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:27.398897 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f56aa52-e311-4bb0-b1d7-2097a128374b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:27.400252 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f56aa52-e311-4bb0-b1d7-2097a128374b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:27.405677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 504/988] 10.222.0.59 () {56 vars in 1249 bytes} [Thu Jun 30 10:28:27 2022] GET /identity/v3/endpoints?service_id=896612da3f88490c948d92c58668a704&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:27.410959 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0cac7-ee00-4a0f-8e85-c3b155b866af None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:27.439925 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:27.515519 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0cac7-ee00-4a0f-8e85-c3b155b866af None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:27.548355 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b68e28-ea3a-43b5-9f69-ba421c669c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:27.549045 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b68e28-ea3a-43b5-9f69-ba421c669c8a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:27.549337 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b68e28-ea3a-43b5-9f69-ba421c669c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:27.549619 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b68e28-ea3a-43b5-9f69-ba421c669c8a None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:27.550297 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b68e28-ea3a-43b5-9f69-ba421c669c8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:27.551671 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b68e28-ea3a-43b5-9f69-ba421c669c8a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:27.564594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 485/989] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Jun 30 10:28:27 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:28:28.651660 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d17be-879d-446a-b322-e1d1dfc58a5a None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:28.652246 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d17be-879d-446a-b322-e1d1dfc58a5a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:28.652246 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d17be-879d-446a-b322-e1d1dfc58a5a None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:28.653682 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 505/990] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:28.659580 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b60c7a-1d29-4de9-827a-41bcc457da4f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:28.660061 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b60c7a-1d29-4de9-827a-41bcc457da4f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:28.660163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b60c7a-1d29-4de9-827a-41bcc457da4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:28.677260 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-22b60c7a-1d29-4de9-827a-41bcc457da4f None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:28.678441 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-22b60c7a-1d29-4de9-827a-41bcc457da4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:28.748114 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 486/991] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:28.770860 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d17be-879d-446a-b322-e1d1dfc58a5a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:28.884114 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d17be-879d-446a-b322-e1d1dfc58a5a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:28.918169 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75403d-2aef-4ed7-9329-11fbbfcefe72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:28.918879 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75403d-2aef-4ed7-9329-11fbbfcefe72 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:28.919160 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75403d-2aef-4ed7-9329-11fbbfcefe72 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:28.919433 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75403d-2aef-4ed7-9329-11fbbfcefe72 None admin] PATH_INFO: `/v3/services/image` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:28.920072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac75403d-2aef-4ed7-9329-11fbbfcefe72 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:28.921449 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac75403d-2aef-4ed7-9329-11fbbfcefe72 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:28.932966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-ac75403d-2aef-4ed7-9329-11fbbfcefe72 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 10:28:28.932966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:28.932966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:28:28.932966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:28:28.932966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:28:28.932966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:28:28.932966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:28:28.932966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:28.932966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 10:28:28.932966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:28.932966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:28:28.932966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:28.932966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:28.932966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:28.932966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:28.932966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:28.932966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:28.934015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:28.934015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:28.934015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:28.934015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:28.934015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:28.934015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:28.934015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:28:28.934015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:28:28.934015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:28:28.934015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:28:28.934015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:28.934015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:28.934015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:28.934015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:28.934015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:28.934015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:28.934870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:28.934870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:28.934870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:28.934870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:28.934870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:28.934870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:28.934870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:28.934870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:28.934870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:28.934870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:28.934870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:28:28.934870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:28.934870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 10:28:28.934870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:28.936825 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 506/992] 10.222.0.59 () {56 vars in 1105 bytes} [Thu Jun 30 10:28:28 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:28.939871 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b60c7a-1d29-4de9-827a-41bcc457da4f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:28.960712 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:29.040889 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b60c7a-1d29-4de9-827a-41bcc457da4f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:29.074803 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bbd65-1176-4478-9fc5-d22b09b6b8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:29.075465 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bbd65-1176-4478-9fc5-d22b09b6b8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:29.075750 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bbd65-1176-4478-9fc5-d22b09b6b8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:29.076026 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bbd65-1176-4478-9fc5-d22b09b6b8c2 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:29.076786 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48bbd65-1176-4478-9fc5-d22b09b6b8c2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:29.077096 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48bbd65-1176-4478-9fc5-d22b09b6b8c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:29.078470 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48bbd65-1176-4478-9fc5-d22b09b6b8c2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:29.083420 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 487/993] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:29.089358 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75403d-2aef-4ed7-9329-11fbbfcefe72 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:29.121305 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:29.165578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65846859-4c8c-4c72-a816-c6e77952ad92 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:29.166069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65846859-4c8c-4c72-a816-c6e77952ad92 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:29.166216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65846859-4c8c-4c72-a816-c6e77952ad92 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:29.168291 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 488/994] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:28:29.172977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b06219-4ed0-456a-8192-667b18bb3569 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:29.173271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b06219-4ed0-456a-8192-667b18bb3569 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:29.173557 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b06219-4ed0-456a-8192-667b18bb3569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:29.190567 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e1b06219-4ed0-456a-8192-667b18bb3569 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:29.191849 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e1b06219-4ed0-456a-8192-667b18bb3569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:29.192983 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75403d-2aef-4ed7-9329-11fbbfcefe72 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:29.231130 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7f6f4-6bb4-4ae9-93a8-3a401d5d62df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:29.231794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7f6f4-6bb4-4ae9-93a8-3a401d5d62df None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:29.232080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7f6f4-6bb4-4ae9-93a8-3a401d5d62df None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:29.232359 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7f6f4-6bb4-4ae9-93a8-3a401d5d62df None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:29.233086 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7f6f4-6bb4-4ae9-93a8-3a401d5d62df None admin] RBAC: Adding query filter params (type=image) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:29.233396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7f6f4-6bb4-4ae9-93a8-3a401d5d62df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:29.234762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7f6f4-6bb4-4ae9-93a8-3a401d5d62df None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:29.248549 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 507/995] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:29 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:29.273410 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 489/996] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:28:29.296973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7f6f4-6bb4-4ae9-93a8-3a401d5d62df None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:29.400566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:29.408476 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7f6f4-6bb4-4ae9-93a8-3a401d5d62df None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:29.442092 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb1f65-04e9-4e0a-89e4-e89160ac9b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:29.442809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb1f65-04e9-4e0a-89e4-e89160ac9b5a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:29.443090 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb1f65-04e9-4e0a-89e4-e89160ac9b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:29.443363 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb1f65-04e9-4e0a-89e4-e89160ac9b5a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:29.444004 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb1f65-04e9-4e0a-89e4-e89160ac9b5a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:29.445388 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb1f65-04e9-4e0a-89e4-e89160ac9b5a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:29.457773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-19fb1f65-04e9-4e0a-89e4-e89160ac9b5a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 10:28:29.457773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:29.457773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:28:29.457773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:28:29.457773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:28:29.457773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:28:29.457773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:28:29.457773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:29.457773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 10:28:29.457773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:29.457773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:28:29.457773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:29.457773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:29.457773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:29.457773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:29.457773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:29.457773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:29.458765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:29.458765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:29.458765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:29.458765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:29.458765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:29.458765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:29.458765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:28:29.458765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:28:29.458765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:28:29.458765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:28:29.458765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:29.458765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:29.458765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:29.458765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:29.458765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:29.458765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:29.459610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:29.459610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:29.459610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:29.459610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:29.459610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:29.459610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:29.459610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:29.459610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:29.459610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:29.459610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:29.459610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:28:29.459610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:29.459610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 10:28:29.459610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:29.459610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 508/997] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:28:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:29.465796 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b06219-4ed0-456a-8192-667b18bb3569 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:29.482123 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:29.569401 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b06219-4ed0-456a-8192-667b18bb3569 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:29.595763 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400269e-bae4-49f3-9fe4-53467743e753 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:29.596084 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400269e-bae4-49f3-9fe4-53467743e753 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:29.596315 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400269e-bae4-49f3-9fe4-53467743e753 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:29.597954 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 509/998] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:28:29.603635 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e154cf-6c71-4f1a-8832-3b7effae58d3 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:29.603929 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e154cf-6c71-4f1a-8832-3b7effae58d3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:29.604216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e154cf-6c71-4f1a-8832-3b7effae58d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:29.605926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b06a6c-e8e0-4d9c-b20b-8fdeba0175b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:29.606584 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b06a6c-e8e0-4d9c-b20b-8fdeba0175b7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:29.606930 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b06a6c-e8e0-4d9c-b20b-8fdeba0175b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:29.607212 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b06a6c-e8e0-4d9c-b20b-8fdeba0175b7 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:29.607941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b06a6c-e8e0-4d9c-b20b-8fdeba0175b7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:29.608252 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b06a6c-e8e0-4d9c-b20b-8fdeba0175b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:29.609668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b06a6c-e8e0-4d9c-b20b-8fdeba0175b7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:29.615201 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 490/999] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 30 10:28:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:29.621311 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b06a6c-e8e0-4d9c-b20b-8fdeba0175b7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:29.622485 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-73e154cf-6c71-4f1a-8832-3b7effae58d3 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:29.623677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-73e154cf-6c71-4f1a-8832-3b7effae58d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:29.694644 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 510/1000] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:28:29.708742 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:29.720065 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e154cf-6c71-4f1a-8832-3b7effae58d3 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:29.731773 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b06a6c-e8e0-4d9c-b20b-8fdeba0175b7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:29.769359 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006c733-983a-44fd-ada2-e52b8d302e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:29.770019 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006c733-983a-44fd-ada2-e52b8d302e20 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:29.770306 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006c733-983a-44fd-ada2-e52b8d302e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:29.770588 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006c733-983a-44fd-ada2-e52b8d302e20 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:29.771287 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006c733-983a-44fd-ada2-e52b8d302e20 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:29.771601 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006c733-983a-44fd-ada2-e52b8d302e20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:29.773025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006c733-983a-44fd-ada2-e52b8d302e20 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:29.778335 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 491/1001] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 30 10:28:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:29.784020 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006c733-983a-44fd-ada2-e52b8d302e20 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:29.821547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:29.833401 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e154cf-6c71-4f1a-8832-3b7effae58d3 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:29.867838 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41913e9-2703-4f29-bd77-a883925cbb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:29.868836 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41913e9-2703-4f29-bd77-a883925cbb0b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:29.869121 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41913e9-2703-4f29-bd77-a883925cbb0b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:29.869404 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41913e9-2703-4f29-bd77-a883925cbb0b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:29.870567 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41913e9-2703-4f29-bd77-a883925cbb0b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:29.871944 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41913e9-2703-4f29-bd77-a883925cbb0b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:29.883877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-f41913e9-2703-4f29-bd77-a883925cbb0b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:28:29.883877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:29.883877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:28:29.883877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:28:29.883877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:28:29.883877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:28:29.883877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:28:29.883877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:29.883877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:28:29.883877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:29.883877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:28:29.883877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:29.883877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:29.883877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:29.883877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:29.883877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:29.883877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:29.884900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:29.884900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:29.884900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:29.884900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:29.884900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:29.884900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:29.884900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:28:29.884900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:28:29.884900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:28:29.884900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:28:29.884900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:29.884900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:29.884900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:29.884900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:29.884900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:29.884900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:29.885803 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:29.885803 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:29.885803 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:29.885803 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:29.885803 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:29.885803 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:29.885803 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:29.885803 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:29.885803 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:29.885803 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:29.885803 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:28:29.885803 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:29.885803 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:28:29.885803 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:29.885803 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 511/1002] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 30 10:28:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:29.891688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41913e9-2703-4f29-bd77-a883925cbb0b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:29.896932 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006c733-983a-44fd-ada2-e52b8d302e20 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:29.942549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d167ca6-9a4b-40e0-bc95-c726e386214d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:29.943218 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d167ca6-9a4b-40e0-bc95-c726e386214d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:29.943505 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d167ca6-9a4b-40e0-bc95-c726e386214d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:29.943784 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d167ca6-9a4b-40e0-bc95-c726e386214d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:29.944594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d167ca6-9a4b-40e0-bc95-c726e386214d None admin] RBAC: Adding query filter params (interface=public, service_id=00aa82e85b2743998a655dd7155cbcc0, region_id=RegionOne) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:29.944965 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d167ca6-9a4b-40e0-bc95-c726e386214d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:29.946285 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d167ca6-9a4b-40e0-bc95-c726e386214d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:29.956191 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 492/1003] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Jun 30 10:28:29 2022] GET /identity/v3/endpoints?service_id=00aa82e85b2743998a655dd7155cbcc0&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:29.957274 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d167ca6-9a4b-40e0-bc95-c726e386214d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:29.966192 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:30.004708 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41913e9-2703-4f29-bd77-a883925cbb0b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:30.040247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412280a-1f34-425c-88a3-2693264d5ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:30.040988 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412280a-1f34-425c-88a3-2693264d5ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:30.041278 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412280a-1f34-425c-88a3-2693264d5ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:30.041583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412280a-1f34-425c-88a3-2693264d5ba8 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:30.042790 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412280a-1f34-425c-88a3-2693264d5ba8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:30.043169 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412280a-1f34-425c-88a3-2693264d5ba8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:30.044458 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412280a-1f34-425c-88a3-2693264d5ba8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:30.053838 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 512/1004] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Jun 30 10:28:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:30.054878 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412280a-1f34-425c-88a3-2693264d5ba8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:30.067829 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d167ca6-9a4b-40e0-bc95-c726e386214d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:30.078024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:30.106714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36bac3-60ad-4cb8-86f3-433676785f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:30.107382 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36bac3-60ad-4cb8-86f3-433676785f6f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:30.107663 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36bac3-60ad-4cb8-86f3-433676785f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:30.107942 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36bac3-60ad-4cb8-86f3-433676785f6f None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:30.108645 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36bac3-60ad-4cb8-86f3-433676785f6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:30.110014 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36bac3-60ad-4cb8-86f3-433676785f6f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:30.124535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 493/1005] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Jun 30 10:28:29 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:28:30.174967 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412280a-1f34-425c-88a3-2693264d5ba8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:30.211428 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3422d74-105a-45e4-9b0f-5be4d71ba31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:30.212004 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3422d74-105a-45e4-9b0f-5be4d71ba31a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:30.212293 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3422d74-105a-45e4-9b0f-5be4d71ba31a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:30.212601 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3422d74-105a-45e4-9b0f-5be4d71ba31a None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:30.213311 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3422d74-105a-45e4-9b0f-5be4d71ba31a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:30.213621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3422d74-105a-45e4-9b0f-5be4d71ba31a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:30.215046 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3422d74-105a-45e4-9b0f-5be4d71ba31a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:30.220381 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 513/1006] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Jun 30 10:28:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:30.226961 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36bac3-60ad-4cb8-86f3-433676785f6f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:30.313310 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:30.345724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36bac3-60ad-4cb8-86f3-433676785f6f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:30.382921 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccb083-f735-4d97-a1a8-fc6894e04998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:30.383634 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccb083-f735-4d97-a1a8-fc6894e04998 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:30.383919 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccb083-f735-4d97-a1a8-fc6894e04998 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:30.384238 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccb083-f735-4d97-a1a8-fc6894e04998 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:30.385011 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eccb083-f735-4d97-a1a8-fc6894e04998 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:30.386420 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eccb083-f735-4d97-a1a8-fc6894e04998 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:30.403978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 494/1007] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Jun 30 10:28:30 2022] POST /identity/v3/endpoints => generated 325 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:28:31.313513 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe1e55-63ee-45d5-a4e3-df667ffc443c None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:31.314047 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe1e55-63ee-45d5-a4e3-df667ffc443c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:31.314047 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe1e55-63ee-45d5-a4e3-df667ffc443c None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:31.315589 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 514/1008] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:31.320548 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680ae12-514c-40ff-9f58-4f082da692cf None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:31.320927 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680ae12-514c-40ff-9f58-4f082da692cf None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:31.321120 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680ae12-514c-40ff-9f58-4f082da692cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:31.341320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b680ae12-514c-40ff-9f58-4f082da692cf None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:31.342517 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b680ae12-514c-40ff-9f58-4f082da692cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:31.416403 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 495/1009] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:31 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:31.439562 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe1e55-63ee-45d5-a4e3-df667ffc443c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:31.524306 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:31.546091 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe1e55-63ee-45d5-a4e3-df667ffc443c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:31.580000 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32023ee-b0cb-4915-8a6b-d101ecd7e863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:31.580682 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32023ee-b0cb-4915-8a6b-d101ecd7e863 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:31.580966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32023ee-b0cb-4915-8a6b-d101ecd7e863 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:31.581241 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32023ee-b0cb-4915-8a6b-d101ecd7e863 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:31.581964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32023ee-b0cb-4915-8a6b-d101ecd7e863 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:31.583321 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32023ee-b0cb-4915-8a6b-d101ecd7e863 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:31.604608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 515/1010] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 30 10:28:31 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:28:32.230289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecceb146-227b-4bad-ba96-21ef8bd50954 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:32.230675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecceb146-227b-4bad-ba96-21ef8bd50954 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:32.230865 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecceb146-227b-4bad-ba96-21ef8bd50954 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:32.232403 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 496/1011] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:32.237448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1ebe9-8bf3-4c91-8dec-11c2f363c2b7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:32.237744 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1ebe9-8bf3-4c91-8dec-11c2f363c2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:32.238023 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1ebe9-8bf3-4c91-8dec-11c2f363c2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:32.254676 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-89a1ebe9-8bf3-4c91-8dec-11c2f363c2b7 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:32.255862 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-89a1ebe9-8bf3-4c91-8dec-11c2f363c2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:32.341761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 516/1012] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:32 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:32.365023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecceb146-227b-4bad-ba96-21ef8bd50954 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:32.424311 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:32.468839 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6961c-1db6-4ca9-8baa-47484e29cfb0 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:32.469239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6961c-1db6-4ca9-8baa-47484e29cfb0 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:32.469526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6961c-1db6-4ca9-8baa-47484e29cfb0 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:32.470068 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecceb146-227b-4bad-ba96-21ef8bd50954 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:32.471026 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 517/1013] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:28:32.476049 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807a972-456e-4da0-8e97-82e94228ca07 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:32.476337 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807a972-456e-4da0-8e97-82e94228ca07 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:32.476659 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807a972-456e-4da0-8e97-82e94228ca07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:32.492868 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-4807a972-456e-4da0-8e97-82e94228ca07 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:32.493971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4807a972-456e-4da0-8e97-82e94228ca07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:32.506751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b1a67-007b-403f-9c8f-699cb69e5ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:32.506751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b1a67-007b-403f-9c8f-699cb69e5ccd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:32.506751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b1a67-007b-403f-9c8f-699cb69e5ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:32.507060 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b1a67-007b-403f-9c8f-699cb69e5ccd None admin] PATH_INFO: `/v3/services/compute` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:32.507466 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b1a67-007b-403f-9c8f-699cb69e5ccd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:32.508864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b1a67-007b-403f-9c8f-699cb69e5ccd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:32.521732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-5a7b1a67-007b-403f-9c8f-699cb69e5ccd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 10:28:32.521732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:32.521732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:28:32.521732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:28:32.521732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:28:32.521732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:28:32.521732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:28:32.521732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:32.521732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 10:28:32.521732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:32.521732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:28:32.521732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:32.521732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:32.521732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:32.521732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:32.521732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:32.521732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:32.522707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:32.522707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:32.522707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:32.522707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:32.522707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:32.522707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:32.522707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:28:32.522707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:28:32.522707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:28:32.522707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:28:32.522707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:32.522707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:32.522707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:32.522707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:32.522707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:32.522707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:32.523556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:32.523556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:32.523556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:32.523556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:32.523556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:32.523556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:32.523556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:32.523556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:32.523556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:32.523556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:32.523556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:28:32.523556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:32.523556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 10:28:32.523556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:32.523556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 497/1014] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:28:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:32.529456 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b1a67-007b-403f-9c8f-699cb69e5ccd None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:32.560683 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:32.575950 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 518/1015] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:32 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:28:32.593454 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807a972-456e-4da0-8e97-82e94228ca07 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:32.653395 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b1a67-007b-403f-9c8f-699cb69e5ccd None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:32.674826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:32.690342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd650f50-1860-41c5-829c-be0eb123f45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:32.691006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd650f50-1860-41c5-829c-be0eb123f45c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:32.691294 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd650f50-1860-41c5-829c-be0eb123f45c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:32.691576 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd650f50-1860-41c5-829c-be0eb123f45c None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:32.692282 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd650f50-1860-41c5-829c-be0eb123f45c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:32.692621 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd650f50-1860-41c5-829c-be0eb123f45c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:32.694005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd650f50-1860-41c5-829c-be0eb123f45c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:32.699075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 498/1016] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 30 10:28:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:32.704579 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd650f50-1860-41c5-829c-be0eb123f45c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:32.705998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807a972-456e-4da0-8e97-82e94228ca07 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:32.742534 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1baa3ea-8772-4a19-be0d-2a6fc6717660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:32.743416 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1baa3ea-8772-4a19-be0d-2a6fc6717660 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:32.743646 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1baa3ea-8772-4a19-be0d-2a6fc6717660 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:32.743928 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1baa3ea-8772-4a19-be0d-2a6fc6717660 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:32.745233 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1baa3ea-8772-4a19-be0d-2a6fc6717660 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:32.746705 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1baa3ea-8772-4a19-be0d-2a6fc6717660 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:32.748437 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 519/1017] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:32.754601 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1baa3ea-8772-4a19-be0d-2a6fc6717660 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:32.817708 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd650f50-1860-41c5-829c-be0eb123f45c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:32.822399 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:32.854371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8cd31-0033-4a93-a2aa-a24673a29c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:32.855576 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8cd31-0033-4a93-a2aa-a24673a29c41 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:32.855978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8cd31-0033-4a93-a2aa-a24673a29c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:32.856259 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8cd31-0033-4a93-a2aa-a24673a29c41 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:32.857093 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8cd31-0033-4a93-a2aa-a24673a29c41 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:32.857413 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8cd31-0033-4a93-a2aa-a24673a29c41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:32.858783 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8cd31-0033-4a93-a2aa-a24673a29c41 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:32.859438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1baa3ea-8772-4a19-be0d-2a6fc6717660 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:32.868607 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 499/1018] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 30 10:28:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:32.869524 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8cd31-0033-4a93-a2aa-a24673a29c41 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:32.896242 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53543b6b-9342-430d-b1b0-00d75acd7ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:32.896928 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53543b6b-9342-430d-b1b0-00d75acd7ddd None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:32.897215 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53543b6b-9342-430d-b1b0-00d75acd7ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:32.897495 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53543b6b-9342-430d-b1b0-00d75acd7ddd None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:32.898205 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53543b6b-9342-430d-b1b0-00d75acd7ddd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:32.899627 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53543b6b-9342-430d-b1b0-00d75acd7ddd None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:32.921562 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:32.928959 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 520/1019] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 30 10:28:32 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:28:32.993576 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8cd31-0033-4a93-a2aa-a24673a29c41 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:33.031842 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51dfbc2-5a26-4522-be01-a2ce465fc89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:33.032537 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dfbc2-5a26-4522-be01-a2ce465fc89e None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:33.032830 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dfbc2-5a26-4522-be01-a2ce465fc89e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:33.033113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dfbc2-5a26-4522-be01-a2ce465fc89e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:33.033868 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51dfbc2-5a26-4522-be01-a2ce465fc89e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:33.035274 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51dfbc2-5a26-4522-be01-a2ce465fc89e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:33.059850 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 500/1020] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Jun 30 10:28:32 2022] POST /identity/v3/endpoints => generated 334 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:28:33.687599 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91673e5d-d6d5-4254-a23f-2ef3c1b82cb7 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:33.688149 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91673e5d-d6d5-4254-a23f-2ef3c1b82cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:33.688534 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91673e5d-d6d5-4254-a23f-2ef3c1b82cb7 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:33.690071 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 521/1021] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:33.694991 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42b77a-543b-4de7-adda-f17220894876 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:33.695375 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42b77a-543b-4de7-adda-f17220894876 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:33.695556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42b77a-543b-4de7-adda-f17220894876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:33.712068 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ce42b77a-543b-4de7-adda-f17220894876 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:33.713269 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ce42b77a-543b-4de7-adda-f17220894876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:33.786125 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 501/1022] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:33.809632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91673e5d-d6d5-4254-a23f-2ef3c1b82cb7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:33.914171 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91673e5d-d6d5-4254-a23f-2ef3c1b82cb7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:33.933938 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:33.953158 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb81ab-081d-49f6-bcaf-59bdfb9d71a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:33.954120 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb81ab-081d-49f6-bcaf-59bdfb9d71a1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:33.954547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb81ab-081d-49f6-bcaf-59bdfb9d71a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:33.954981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb81ab-081d-49f6-bcaf-59bdfb9d71a1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:33.955755 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb81ab-081d-49f6-bcaf-59bdfb9d71a1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:33.957283 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb81ab-081d-49f6-bcaf-59bdfb9d71a1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:33.968833 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-8dbb81ab-081d-49f6-bcaf-59bdfb9d71a1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 10:28:33.968833 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:33.968833 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:28:33.968833 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:28:33.968833 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:28:33.968833 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:28:33.968833 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:28:33.968833 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:33.968833 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 10:28:33.968833 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:33.968833 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:28:33.968833 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:33.968833 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:33.968833 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:33.968833 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:33.968833 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:33.968833 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:33.969987 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:33.969987 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:33.969987 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:33.969987 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:33.969987 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:33.969987 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:33.969987 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:28:33.969987 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:28:33.969987 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:28:33.969987 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:28:33.969987 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:33.969987 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:33.969987 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:33.969987 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:33.969987 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:33.969987 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:33.971099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:33.971099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:33.971099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:33.971099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:33.971099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:33.971099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:33.971099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:33.971099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:33.971099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:33.971099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:33.971099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:28:33.971099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:33.971099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 10:28:33.971099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:33.974008 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 522/1023] 10.222.0.59 () {56 vars in 1105 bytes} [Thu Jun 30 10:28:33 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:33.980556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42b77a-543b-4de7-adda-f17220894876 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:34.010694 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:34.085936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42b77a-543b-4de7-adda-f17220894876 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:34.120850 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e9734-2370-4437-8673-ec3ce978cb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:34.121805 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e9734-2370-4437-8673-ec3ce978cb43 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:34.122265 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e9734-2370-4437-8673-ec3ce978cb43 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:34.122715 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e9734-2370-4437-8673-ec3ce978cb43 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:34.123580 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e9734-2370-4437-8673-ec3ce978cb43 None admin] RBAC: Adding query filter params (name=image) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:34.124074 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e9734-2370-4437-8673-ec3ce978cb43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:34.125656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e9734-2370-4437-8673-ec3ce978cb43 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:34.130915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 502/1024] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:34.136818 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb81ab-081d-49f6-bcaf-59bdfb9d71a1 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:34.237980 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb81ab-081d-49f6-bcaf-59bdfb9d71a1 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:34.280104 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b2e53-7210-452b-bf8c-d656ac219ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:34.280794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b2e53-7210-452b-bf8c-d656ac219ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:34.281082 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b2e53-7210-452b-bf8c-d656ac219ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:34.281363 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b2e53-7210-452b-bf8c-d656ac219ef2 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:34.282065 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b2e53-7210-452b-bf8c-d656ac219ef2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:34.282375 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b2e53-7210-452b-bf8c-d656ac219ef2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:34.283729 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b2e53-7210-452b-bf8c-d656ac219ef2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:34.288715 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 523/1025] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:34.294984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e9734-2370-4437-8673-ec3ce978cb43 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:34.390374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:34.398563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e9734-2370-4437-8673-ec3ce978cb43 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:34.433379 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676442f4-c662-4801-8658-4b90574b9193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:34.434031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676442f4-c662-4801-8658-4b90574b9193 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:34.434313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676442f4-c662-4801-8658-4b90574b9193 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:34.434588 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676442f4-c662-4801-8658-4b90574b9193 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:34.435366 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676442f4-c662-4801-8658-4b90574b9193 None admin] RBAC: Adding query filter params (interface=public, service_id=4779848e86b94a6f9f5abc8b8f9c2155, region_id=RegionOne) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:34.435680 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676442f4-c662-4801-8658-4b90574b9193 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:34.437086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676442f4-c662-4801-8658-4b90574b9193 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:34.446644 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 503/1026] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Jun 30 10:28:34 2022] GET /identity/v3/endpoints?service_id=4779848e86b94a6f9f5abc8b8f9c2155&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:34.447775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b2e53-7210-452b-bf8c-d656ac219ef2 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:34.495388 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:34.551683 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b2e53-7210-452b-bf8c-d656ac219ef2 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:34.584527 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b25881-1a8b-4a79-a66e-dd0e4a0a93b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:34.585199 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b25881-1a8b-4a79-a66e-dd0e4a0a93b9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:34.585482 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b25881-1a8b-4a79-a66e-dd0e4a0a93b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:34.585758 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b25881-1a8b-4a79-a66e-dd0e4a0a93b9 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:34.586432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b25881-1a8b-4a79-a66e-dd0e4a0a93b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:34.587782 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b25881-1a8b-4a79-a66e-dd0e4a0a93b9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:34.600542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 524/1027] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Jun 30 10:28:34 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:28:35.013669 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd4bd7-95bd-4f41-8dcd-6b2e2b6dd679 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:35.014212 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd4bd7-95bd-4f41-8dcd-6b2e2b6dd679 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:35.014212 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd4bd7-95bd-4f41-8dcd-6b2e2b6dd679 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:35.015742 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 504/1028] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:35.020849 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf47ea-74c3-40e3-bb28-fbe0da340021 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:35.021265 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf47ea-74c3-40e3-bb28-fbe0da340021 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:35.021427 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf47ea-74c3-40e3-bb28-fbe0da340021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:35.038397 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-55cf47ea-74c3-40e3-bb28-fbe0da340021 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:35.039596 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-55cf47ea-74c3-40e3-bb28-fbe0da340021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:35.108925 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 525/1029] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:35.134073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd4bd7-95bd-4f41-8dcd-6b2e2b6dd679 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:35.177770 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da88f0-afba-4f18-a573-1b50e7e3d495 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:35.178197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da88f0-afba-4f18-a573-1b50e7e3d495 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:35.178314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da88f0-afba-4f18-a573-1b50e7e3d495 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:35.179813 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 526/1030] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:28:35.184825 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2696af-f1be-4eee-9d87-6d43035ef2c0 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:35.185112 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2696af-f1be-4eee-9d87-6d43035ef2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:35.185388 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2696af-f1be-4eee-9d87-6d43035ef2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:35.201863 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-1d2696af-f1be-4eee-9d87-6d43035ef2c0 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:35.203046 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1d2696af-f1be-4eee-9d87-6d43035ef2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:35.238894 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:35.245662 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd4bd7-95bd-4f41-8dcd-6b2e2b6dd679 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:35.276248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 527/1031] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:28:35.286418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc763fa-b958-4b54-a22b-2326eeb44640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:35.287202 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc763fa-b958-4b54-a22b-2326eeb44640 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:35.287484 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc763fa-b958-4b54-a22b-2326eeb44640 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:35.287760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc763fa-b958-4b54-a22b-2326eeb44640 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:35.288950 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc763fa-b958-4b54-a22b-2326eeb44640 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:35.290389 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc763fa-b958-4b54-a22b-2326eeb44640 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:35.292699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 505/1032] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:35.298760 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2696af-f1be-4eee-9d87-6d43035ef2c0 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:35.301663 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc763fa-b958-4b54-a22b-2326eeb44640 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:35.335659 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:35.402607 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2696af-f1be-4eee-9d87-6d43035ef2c0 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:35.412152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc763fa-b958-4b54-a22b-2326eeb44640 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:35.439163 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f43fa-8e35-4083-922a-9dacbcfb56c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:35.439817 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f43fa-8e35-4083-922a-9dacbcfb56c5 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:35.440095 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f43fa-8e35-4083-922a-9dacbcfb56c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:35.440365 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f43fa-8e35-4083-922a-9dacbcfb56c5 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:35.441104 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f43fa-8e35-4083-922a-9dacbcfb56c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:35.442520 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f43fa-8e35-4083-922a-9dacbcfb56c5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:35.446138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0b8ad-b690-427c-b4f8-e5ce99ef4c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:35.446943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0b8ad-b690-427c-b4f8-e5ce99ef4c21 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:35.447228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0b8ad-b690-427c-b4f8-e5ce99ef4c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:35.447506 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0b8ad-b690-427c-b4f8-e5ce99ef4c21 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:35.459160 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f0b8ad-b690-427c-b4f8-e5ce99ef4c21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:28:35.464395 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 528/1033] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 30 10:28:35 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:28:35.467714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-18f0b8ad-b690-427c-b4f8-e5ce99ef4c21 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:28:35.467714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:35.467714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:35.467714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:35.467714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:35.467714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:35.467714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:35.467714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:35.467714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:35.467714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:35.467714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:35.467714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:35.467714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:28:35.467714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:28:35.467714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:28:35.467714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:28:35.468699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:28:35.468699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:28:35.468699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:28:35.468699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:28:35.468699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:35.468699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:35.468699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:35.468699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:35.468699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:35.468699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:35.468699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:35.468699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:35.468699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:35.468699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:35.468699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:35.468699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:35.469591 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:35.469591 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:35.469591 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:35.469591 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:35.469591 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:28:35.469591 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:28:35.469591 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:28:35.469591 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:28:35.469591 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:28:35.469591 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:28:35.469591 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:28:35.469591 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:35.474157 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 506/1034] 10.222.0.59 () {56 vars in 1120 bytes} [Thu Jun 30 10:28:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:28:35.476248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f43fa-8e35-4083-922a-9dacbcfb56c5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:35.508177 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:35.588117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f43fa-8e35-4083-922a-9dacbcfb56c5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:35.628372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fd0d1-c0b0-4d3e-97a3-8546d11c9618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:35.629065 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fd0d1-c0b0-4d3e-97a3-8546d11c9618 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:35.629367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fd0d1-c0b0-4d3e-97a3-8546d11c9618 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:35.629643 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fd0d1-c0b0-4d3e-97a3-8546d11c9618 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:35.630381 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fd0d1-c0b0-4d3e-97a3-8546d11c9618 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:35.630685 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fd0d1-c0b0-4d3e-97a3-8546d11c9618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:35.632058 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fd0d1-c0b0-4d3e-97a3-8546d11c9618 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:35.640834 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 529/1035] 10.222.0.59 () {56 vars in 1115 bytes} [Thu Jun 30 10:28:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:35.647101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0b8ad-b690-427c-b4f8-e5ce99ef4c21 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:35.746463 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:35.762799 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0b8ad-b690-427c-b4f8-e5ce99ef4c21 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:35.799237 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e78ddd-64c5-432d-aa13-c4c6fc32c2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:35.800030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e78ddd-64c5-432d-aa13-c4c6fc32c2fb None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:35.800314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e78ddd-64c5-432d-aa13-c4c6fc32c2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:35.800616 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e78ddd-64c5-432d-aa13-c4c6fc32c2fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:35.811161 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e78ddd-64c5-432d-aa13-c4c6fc32c2fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:35.812645 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e78ddd-64c5-432d-aa13-c4c6fc32c2fb None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:35.829401 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-70e78ddd-64c5-432d-aa13-c4c6fc32c2fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:35.829401 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:35.829401 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:35.829401 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:35.829401 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:35.829401 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:35.829401 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:35.829401 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:35.829401 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:35.829401 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:35.829401 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:35.829401 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:35.829401 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:28:35.829401 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:28:35.829401 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:28:35.830315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:28:35.830315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:35.830315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:35.830315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:35.830315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:35.830315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:35.830315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:35.830315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:35.830315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:35.830315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:35.830315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:35.830315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:35.830315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:35.830315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:35.830315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:35.830315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:35.830315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:35.835905 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:28:35.835905 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:28:35.835905 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:35.835905 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:35.835905 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 507/1036] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:28:35.837830 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fd0d1-c0b0-4d3e-97a3-8546d11c9618 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:35.927601 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:35.940898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fd0d1-c0b0-4d3e-97a3-8546d11c9618 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:35.974776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead8405-f2a5-4fd4-b933-7a09836fe782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:35.975442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead8405-f2a5-4fd4-b933-7a09836fe782 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:35.975727 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead8405-f2a5-4fd4-b933-7a09836fe782 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:35.976218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead8405-f2a5-4fd4-b933-7a09836fe782 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:35.976965 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead8405-f2a5-4fd4-b933-7a09836fe782 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:35.977276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead8405-f2a5-4fd4-b933-7a09836fe782 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:35.978626 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead8405-f2a5-4fd4-b933-7a09836fe782 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:35.995951 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 530/1037] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:35.997554 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e78ddd-64c5-432d-aa13-c4c6fc32c2fb None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:36.102475 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e78ddd-64c5-432d-aa13-c4c6fc32c2fb None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:36.136249 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f23d6-b17e-4bb1-8f04-c52222851a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:36.137087 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f23d6-b17e-4bb1-8f04-c52222851a1f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:36.137374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f23d6-b17e-4bb1-8f04-c52222851a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:36.137653 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f23d6-b17e-4bb1-8f04-c52222851a1f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:36.145338 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f23d6-b17e-4bb1-8f04-c52222851a1f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:36.146789 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f23d6-b17e-4bb1-8f04-c52222851a1f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:36.148553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:36.162578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-aa1f23d6-b17e-4bb1-8f04-c52222851a1f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:28:36.162578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:36.162578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:36.162578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:36.162578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:36.162578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:36.162578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:36.162578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:36.162578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:36.162578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:36.162578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:36.162578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:36.162578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:28:36.162578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:28:36.162578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:28:36.162578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:28:36.163733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:36.163733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:36.163733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:28:36.163733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:36.163733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:28:36.163733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:36.163733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:36.163733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:36.163733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:36.163733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:36.163733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:36.163733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:36.163733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:36.163733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:36.163733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:36.163733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:36.163733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:36.163733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:36.164945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:36.164945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:36.164945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:28:36.164945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:28:36.164945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:28:36.164945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:28:36.164945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:28:36.164945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:28:36.164945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:28:36.164945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:36.167757 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 508/1038] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Jun 30 10:28:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:36.173313 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead8405-f2a5-4fd4-b933-7a09836fe782 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:36.283241 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead8405-f2a5-4fd4-b933-7a09836fe782 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:36.317746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd0b5b-8582-4ba9-a8a7-1a8e36b1a6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:36.318415 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd0b5b-8582-4ba9-a8a7-1a8e36b1a6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:36.318696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd0b5b-8582-4ba9-a8a7-1a8e36b1a6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:36.318974 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd0b5b-8582-4ba9-a8a7-1a8e36b1a6e1 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:36.319795 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd0b5b-8582-4ba9-a8a7-1a8e36b1a6e1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:36.320108 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd0b5b-8582-4ba9-a8a7-1a8e36b1a6e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:36.321552 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd0b5b-8582-4ba9-a8a7-1a8e36b1a6e1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:36.344173 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 531/1039] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Jun 30 10:28:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:36.345811 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f23d6-b17e-4bb1-8f04-c52222851a1f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:36.450054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f23d6-b17e-4bb1-8f04-c52222851a1f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:36.484225 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6367122-38de-4738-aa13-ecaa681ac4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:36.484905 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6367122-38de-4738-aa13-ecaa681ac4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:36.485193 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6367122-38de-4738-aa13-ecaa681ac4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:36.485475 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6367122-38de-4738-aa13-ecaa681ac4a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:36.550982 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:36.556139 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6367122-38de-4738-aa13-ecaa681ac4a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:36.557676 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6367122-38de-4738-aa13-ecaa681ac4a7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:36.626792 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddca70-e642-451f-8608-27494d5d95d8 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:36.627134 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddca70-e642-451f-8608-27494d5d95d8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:36.627345 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddca70-e642-451f-8608-27494d5d95d8 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:36.628891 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 532/1040] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:28:36.633554 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852235d-78ec-4e88-a5de-ca8c63dc8c9e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:36.633839 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852235d-78ec-4e88-a5de-ca8c63dc8c9e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:36.634150 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852235d-78ec-4e88-a5de-ca8c63dc8c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:36.644864 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:36.651005 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d852235d-78ec-4e88-a5de-ca8c63dc8c9e None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:36.652775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d852235d-78ec-4e88-a5de-ca8c63dc8c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:36.661173 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 509/1041] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:28:36 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 10:28:36.667623 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6367122-38de-4738-aa13-ecaa681ac4a7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:36.727545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 533/1042] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:28:36.750947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852235d-78ec-4e88-a5de-ca8c63dc8c9e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:36.766214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:36.771163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6367122-38de-4738-aa13-ecaa681ac4a7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:36.809034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ad401-3f33-400f-9dba-b5e510680d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:36.810037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ad401-3f33-400f-9dba-b5e510680d6c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:36.810487 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ad401-3f33-400f-9dba-b5e510680d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:36.810908 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ad401-3f33-400f-9dba-b5e510680d6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:36.822328 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ad401-3f33-400f-9dba-b5e510680d6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:36.824570 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ad401-3f33-400f-9dba-b5e510680d6c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:36.843867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-751ad401-3f33-400f-9dba-b5e510680d6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:36.843867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:36.843867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:36.843867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:36.843867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:36.843867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:36.843867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:36.843867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:36.843867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:36.843867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:36.843867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:36.843867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:36.843867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:28:36.843867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:28:36.843867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:28:36.844915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:28:36.844915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:36.844915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:36.844915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:36.844915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:36.844915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:36.844915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:36.844915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:36.844915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:36.844915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:36.844915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:36.844915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:36.844915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:36.844915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:36.844915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:36.844915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:36.844915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:36.845849 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:28:36.845849 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:28:36.845849 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:36.845849 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:36.850146 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 510/1043] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:28:36.850851 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ad401-3f33-400f-9dba-b5e510680d6c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:36.858174 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852235d-78ec-4e88-a5de-ca8c63dc8c9e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:36.894410 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513db886-2817-4897-9cfd-e6067cddaf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:36.895193 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513db886-2817-4897-9cfd-e6067cddaf81 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:36.895719 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513db886-2817-4897-9cfd-e6067cddaf81 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:36.895719 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513db886-2817-4897-9cfd-e6067cddaf81 None admin] PATH_INFO: `/v3/services/image` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:36.896379 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513db886-2817-4897-9cfd-e6067cddaf81 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:36.897783 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513db886-2817-4897-9cfd-e6067cddaf81 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:36.900717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:36.911784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-513db886-2817-4897-9cfd-e6067cddaf81 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 10:28:36.911784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:36.911784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:28:36.911784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:28:36.911784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:28:36.911784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:28:36.911784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:28:36.911784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:36.911784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 10:28:36.911784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:36.911784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:28:36.911784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:36.911784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:36.911784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:36.911784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:36.911784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:36.911784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:36.913028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:36.913028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:36.913028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:36.913028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:36.913028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:36.913028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:36.913028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:28:36.913028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:28:36.913028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:28:36.913028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:28:36.913028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:36.913028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:36.913028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:36.913028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:36.913028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:36.913028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:36.913899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:36.913899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:36.913899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:36.913899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:36.913899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:36.913899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:36.913899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:36.913899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:36.913899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:36.913899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:36.913899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:28:36.913899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:28:36.913899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 10:28:36.913899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:36.913899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 534/1044] 10.222.0.59 () {56 vars in 1105 bytes} [Thu Jun 30 10:28:36 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:28:36.919583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513db886-2817-4897-9cfd-e6067cddaf81 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:36.962881 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ad401-3f33-400f-9dba-b5e510680d6c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:36.997391 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36300cbb-52ee-43b4-9f2d-e58214137d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:36.998048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36300cbb-52ee-43b4-9f2d-e58214137d33 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:36.998337 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36300cbb-52ee-43b4-9f2d-e58214137d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:36.998618 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36300cbb-52ee-43b4-9f2d-e58214137d33 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:36.999338 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36300cbb-52ee-43b4-9f2d-e58214137d33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:36.999651 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36300cbb-52ee-43b4-9f2d-e58214137d33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:37.001071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36300cbb-52ee-43b4-9f2d-e58214137d33 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:37.016663 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 511/1045] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:37.020556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36300cbb-52ee-43b4-9f2d-e58214137d33 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:37.033727 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:37.034624 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513db886-2817-4897-9cfd-e6067cddaf81 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:37.071780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596935d-b7c6-4a1a-af6e-a0f78df580c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:37.072828 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596935d-b7c6-4a1a-af6e-a0f78df580c8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:37.074011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596935d-b7c6-4a1a-af6e-a0f78df580c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:37.074508 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596935d-b7c6-4a1a-af6e-a0f78df580c8 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:37.075575 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596935d-b7c6-4a1a-af6e-a0f78df580c8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:37.076147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596935d-b7c6-4a1a-af6e-a0f78df580c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:37.078110 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596935d-b7c6-4a1a-af6e-a0f78df580c8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:37.084426 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 535/1046] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:37.089801 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596935d-b7c6-4a1a-af6e-a0f78df580c8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:37.131896 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36300cbb-52ee-43b4-9f2d-e58214137d33 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:37.153481 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:37.170508 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035634c-e107-468d-b0ad-9f8d0b6b3211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:37.171412 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035634c-e107-468d-b0ad-9f8d0b6b3211 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:37.171700 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035634c-e107-468d-b0ad-9f8d0b6b3211 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:37.172004 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035634c-e107-468d-b0ad-9f8d0b6b3211 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:37.179588 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035634c-e107-468d-b0ad-9f8d0b6b3211 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:37.181410 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035634c-e107-468d-b0ad-9f8d0b6b3211 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:37.192758 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596935d-b7c6-4a1a-af6e-a0f78df580c8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:37.197639 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-8035634c-e107-468d-b0ad-9f8d0b6b3211 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:37.197639 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:37.197639 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:37.197639 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:37.197639 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:37.197639 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:37.197639 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:37.197639 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:37.197639 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:37.197639 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:37.197639 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:37.197639 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:37.197639 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:28:37.197639 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:28:37.197639 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:28:37.199158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:28:37.199158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:37.199158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:37.199158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:37.199158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:37.199158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:37.199158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:37.199158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:37.199158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:37.199158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:37.199158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:37.199158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:37.199158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:37.199158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:37.199158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:37.199158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:37.199158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:37.200066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:28:37.200066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:28:37.200066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:28:37.200066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:28:37.200066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:28:37.200066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:28:37.200066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:37.200066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:37.204118 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 512/1047] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:28:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:28:37.204979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035634c-e107-468d-b0ad-9f8d0b6b3211 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:37.230371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47724d86-d94d-4f8c-b13f-901ecd4a914a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:37.231036 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47724d86-d94d-4f8c-b13f-901ecd4a914a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:37.231323 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47724d86-d94d-4f8c-b13f-901ecd4a914a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:37.231598 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47724d86-d94d-4f8c-b13f-901ecd4a914a None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:37.232299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47724d86-d94d-4f8c-b13f-901ecd4a914a None admin] RBAC: Adding query filter params (type=image) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:37.232640 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47724d86-d94d-4f8c-b13f-901ecd4a914a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:37.234005 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47724d86-d94d-4f8c-b13f-901ecd4a914a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:37.239235 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 536/1048] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:37.244846 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47724d86-d94d-4f8c-b13f-901ecd4a914a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:37.290155 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:37.325801 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035634c-e107-468d-b0ad-9f8d0b6b3211 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:37.358771 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47724d86-d94d-4f8c-b13f-901ecd4a914a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:37.362459 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3068a-7f48-4cc0-99f5-2031db50991b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:37.363125 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3068a-7f48-4cc0-99f5-2031db50991b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:37.363410 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3068a-7f48-4cc0-99f5-2031db50991b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:37.363686 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3068a-7f48-4cc0-99f5-2031db50991b None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:37.364467 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3068a-7f48-4cc0-99f5-2031db50991b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:37.364818 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3068a-7f48-4cc0-99f5-2031db50991b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:37.366691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3068a-7f48-4cc0-99f5-2031db50991b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:37.380167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 513/1049] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:28:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:37.386557 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3068a-7f48-4cc0-99f5-2031db50991b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:37.387110 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:37.395653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed82762-7da2-455e-b395-7bd99afdec7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:37.396315 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed82762-7da2-455e-b395-7bd99afdec7b None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:37.396649 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed82762-7da2-455e-b395-7bd99afdec7b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:37.396934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed82762-7da2-455e-b395-7bd99afdec7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:37.397667 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed82762-7da2-455e-b395-7bd99afdec7b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:37.399029 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed82762-7da2-455e-b395-7bd99afdec7b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:37.427766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 537/1050] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Jun 30 10:28:37 2022] POST /identity/v3/endpoints => generated 327 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:28:37.496267 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3068a-7f48-4cc0-99f5-2031db50991b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:37.525975 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:37.539029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48c957-8692-4abb-8948-5edcbd44d95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:37.539691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48c957-8692-4abb-8948-5edcbd44d95e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:37.539978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48c957-8692-4abb-8948-5edcbd44d95e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:37.540258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48c957-8692-4abb-8948-5edcbd44d95e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:37.541128 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48c957-8692-4abb-8948-5edcbd44d95e None admin] RBAC: Adding query filter params (role.id=8cda5b4c7265463f8caa1f85608653ec, scope.project.id=423854cc8f524ecb8d740d1cb0053856, user.id=1bfd036d747241d9bc314b60bf8648b6) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:37.541446 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48c957-8692-4abb-8948-5edcbd44d95e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:37.543451 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48c957-8692-4abb-8948-5edcbd44d95e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:37.549804 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 514/1051] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:28:37 2022] GET /identity/v3/role_assignments?user.id=1bfd036d747241d9bc314b60bf8648b6&scope.project.id=423854cc8f524ecb8d740d1cb0053856&role.id=8cda5b4c7265463f8caa1f85608653ec => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:37.599783 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa391d-953d-4ed8-a038-0742d67a8088 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:37.599972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa391d-953d-4ed8-a038-0742d67a8088 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:37.600251 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa391d-953d-4ed8-a038-0742d67a8088 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:37.601929 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 538/1052] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:37.608202 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649370eb-5821-47da-af3e-99304c686bba None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:37.608555 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649370eb-5821-47da-af3e-99304c686bba None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:37.608802 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649370eb-5821-47da-af3e-99304c686bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:37.627612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-649370eb-5821-47da-af3e-99304c686bba None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:37.628926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-649370eb-5821-47da-af3e-99304c686bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:37.704255 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 515/1053] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:37.727161 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa391d-953d-4ed8-a038-0742d67a8088 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:37.829998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa391d-953d-4ed8-a038-0742d67a8088 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:37.864139 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe4bd3-c528-4b59-85e0-3044afbc7ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:37.864868 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe4bd3-c528-4b59-85e0-3044afbc7ddc None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:37.865148 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe4bd3-c528-4b59-85e0-3044afbc7ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:37.865420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe4bd3-c528-4b59-85e0-3044afbc7ddc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:37.875478 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe4bd3-c528-4b59-85e0-3044afbc7ddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:28:37.882972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-1dfe4bd3-c528-4b59-85e0-3044afbc7ddc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:28:37.882972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:37.882972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:37.882972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:37.882972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:37.882972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:37.882972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:37.882972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:37.882972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:37.882972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:37.882972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:37.882972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:37.882972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:28:37.882972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:28:37.882972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:28:37.882972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:28:37.883908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:28:37.883908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:28:37.883908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:28:37.883908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:28:37.883908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:37.883908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:37.883908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:37.883908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:37.883908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:37.883908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:37.883908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:37.883908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:37.883908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:37.883908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:37.883908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:37.883908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:37.885165 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:37.885165 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:37.885165 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:37.885165 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:37.885165 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:28:37.885165 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:28:37.885165 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:28:37.885165 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:28:37.885165 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:28:37.885165 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:28:37.885165 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:28:37.885165 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:37.888578 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 539/1054] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:28:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:37.890539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649370eb-5821-47da-af3e-99304c686bba None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:37.992906 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649370eb-5821-47da-af3e-99304c686bba None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:38.016097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:38.031181 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b8964-a260-411f-8bde-4e5a8d4cbd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:38.031861 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b8964-a260-411f-8bde-4e5a8d4cbd4f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:38.032144 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b8964-a260-411f-8bde-4e5a8d4cbd4f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:38.032528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b8964-a260-411f-8bde-4e5a8d4cbd4f None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:38.033292 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b8964-a260-411f-8bde-4e5a8d4cbd4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:38.033601 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b8964-a260-411f-8bde-4e5a8d4cbd4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:38.034968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b8964-a260-411f-8bde-4e5a8d4cbd4f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:38.044257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 516/1055] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:28:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:38.049726 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe4bd3-c528-4b59-85e0-3044afbc7ddc None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:38.097124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:38.153305 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe4bd3-c528-4b59-85e0-3044afbc7ddc None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:38.187926 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c314ee-23a8-4fa6-8a0a-fd0facd8eb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:38.188829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c314ee-23a8-4fa6-8a0a-fd0facd8eb45 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:38.189113 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c314ee-23a8-4fa6-8a0a-fd0facd8eb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:38.189386 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c314ee-23a8-4fa6-8a0a-fd0facd8eb45 None admin] PATH_INFO: `/v3/users/ba0d0884196845da9154fd7054847c0d` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:38.203769 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c314ee-23a8-4fa6-8a0a-fd0facd8eb45 None admin] RBAC: Authorizing `identity:get_user(user_id=ba0d0884196845da9154fd7054847c0d)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:38.205221 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c314ee-23a8-4fa6-8a0a-fd0facd8eb45 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:38.207073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 540/1056] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:28:38 2022] GET /identity/v3/users/ba0d0884196845da9154fd7054847c0d => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:38.212595 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b8964-a260-411f-8bde-4e5a8d4cbd4f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:38.323692 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b8964-a260-411f-8bde-4e5a8d4cbd4f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:38.357986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f73e49-8604-4aea-89bb-d9d6d6209632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:38.358625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f73e49-8604-4aea-89bb-d9d6d6209632 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:38.358916 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f73e49-8604-4aea-89bb-d9d6d6209632 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:38.359197 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f73e49-8604-4aea-89bb-d9d6d6209632 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:38.417002 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:38.445228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f73e49-8604-4aea-89bb-d9d6d6209632 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:38.446689 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f73e49-8604-4aea-89bb-d9d6d6209632 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:38.551615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 517/1057] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:28:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:28:38.553115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c314ee-23a8-4fa6-8a0a-fd0facd8eb45 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:38.656593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c314ee-23a8-4fa6-8a0a-fd0facd8eb45 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:38.658165 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:38.692858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cf782-0051-44f6-ba92-ec63913836c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:38.693642 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cf782-0051-44f6-ba92-ec63913836c2 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:38.693931 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cf782-0051-44f6-ba92-ec63913836c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:38.694209 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cf782-0051-44f6-ba92-ec63913836c2 None admin] PATH_INFO: `/v3/projects/9557354c80ed4631b5c10f6c057f472a` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:38.695376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cf782-0051-44f6-ba92-ec63913836c2 None admin] RBAC: Authorizing `identity:get_project(project_id=9557354c80ed4631b5c10f6c057f472a)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:38.696846 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cf782-0051-44f6-ba92-ec63913836c2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:38.699262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 541/1058] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:28:38 2022] GET /identity/v3/projects/9557354c80ed4631b5c10f6c057f472a => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:38.705075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f73e49-8604-4aea-89bb-d9d6d6209632 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:38.784854 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:38.803711 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f73e49-8604-4aea-89bb-d9d6d6209632 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:38.837571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955b9d3-503a-48c1-b732-c4c18a6f5604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:38.838215 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955b9d3-503a-48c1-b732-c4c18a6f5604 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:38.838501 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955b9d3-503a-48c1-b732-c4c18a6f5604 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:38.838808 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955b9d3-503a-48c1-b732-c4c18a6f5604 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:38.839633 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955b9d3-503a-48c1-b732-c4c18a6f5604 None admin] RBAC: Adding query filter params (role.id=ab64ea6d0475430195af26a049485569, scope.project.id=9557354c80ed4631b5c10f6c057f472a, user.id=ba0d0884196845da9154fd7054847c0d) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:38.839948 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955b9d3-503a-48c1-b732-c4c18a6f5604 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:38.841401 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955b9d3-503a-48c1-b732-c4c18a6f5604 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:38.847030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 518/1059] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:28:38 2022] GET /identity/v3/role_assignments?user.id=ba0d0884196845da9154fd7054847c0d&scope.project.id=9557354c80ed4631b5c10f6c057f472a&role.id=ab64ea6d0475430195af26a049485569 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:39.499122 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbd1a0-ff99-4781-9009-b7fcfb3a8812 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:39.499637 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbd1a0-ff99-4781-9009-b7fcfb3a8812 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:39.499637 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbd1a0-ff99-4781-9009-b7fcfb3a8812 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:39.501104 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 542/1060] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:39.506260 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71674795-5e03-42fe-a4e0-2f77eac750cb None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:39.506654 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71674795-5e03-42fe-a4e0-2f77eac750cb None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:39.506824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71674795-5e03-42fe-a4e0-2f77eac750cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:39.523185 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-71674795-5e03-42fe-a4e0-2f77eac750cb None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:39.524284 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-71674795-5e03-42fe-a4e0-2f77eac750cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:39.574379 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1ec51-535e-411c-9d53-5cc8b9952245 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:39.574667 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1ec51-535e-411c-9d53-5cc8b9952245 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:39.575197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1ec51-535e-411c-9d53-5cc8b9952245 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:39.576595 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 543/1061] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:28:39.581531 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f0807-19dd-4707-9415-b894d5e0bcf9 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:39.582006 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f0807-19dd-4707-9415-b894d5e0bcf9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:39.582475 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f0807-19dd-4707-9415-b894d5e0bcf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:39.596537 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 519/1062] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:39.603899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-bc0f0807-19dd-4707-9415-b894d5e0bcf9 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:39.605758 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-bc0f0807-19dd-4707-9415-b894d5e0bcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:39.615420 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71674795-5e03-42fe-a4e0-2f77eac750cb None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:39.686613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 544/1063] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:28:39.694419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:39.704136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f0807-19dd-4707-9415-b894d5e0bcf9 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:39.718577 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71674795-5e03-42fe-a4e0-2f77eac750cb None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:39.751992 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3157d02-49a2-43ce-bca2-70fecbf6e688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:39.752671 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3157d02-49a2-43ce-bca2-70fecbf6e688 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:39.752953 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3157d02-49a2-43ce-bca2-70fecbf6e688 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:39.753238 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3157d02-49a2-43ce-bca2-70fecbf6e688 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:39.804750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:39.808933 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f0807-19dd-4707-9415-b894d5e0bcf9 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:39.821648 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3157d02-49a2-43ce-bca2-70fecbf6e688 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:39.823637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3157d02-49a2-43ce-bca2-70fecbf6e688 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:39.845097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90450b8e-c5ed-4cec-af27-ad16ff328070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:39.846214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90450b8e-c5ed-4cec-af27-ad16ff328070 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:39.846496 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90450b8e-c5ed-4cec-af27-ad16ff328070 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:39.846765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90450b8e-c5ed-4cec-af27-ad16ff328070 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:39.857131 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90450b8e-c5ed-4cec-af27-ad16ff328070 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:28:39.866813 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-90450b8e-c5ed-4cec-af27-ad16ff328070 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:28:39.866813 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:39.866813 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:39.866813 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:39.866813 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:39.866813 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:39.866813 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:39.866813 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:39.866813 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:39.866813 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:39.866813 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:39.866813 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:39.866813 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:28:39.866813 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:28:39.866813 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:28:39.866813 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:28:39.867765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:28:39.867765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:28:39.867765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:28:39.867765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:28:39.867765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:39.867765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:39.867765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:39.867765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:39.867765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:39.867765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:39.867765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:39.867765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:39.867765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:39.867765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:39.867765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:39.867765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:39.873884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:39.873884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:39.873884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:39.873884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:39.873884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:28:39.873884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:28:39.873884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:28:39.873884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:28:39.873884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:28:39.873884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:28:39.873884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:28:39.873884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:39.873884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 545/1064] 10.222.0.59 () {56 vars in 1120 bytes} [Thu Jun 30 10:28:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:39.874850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90450b8e-c5ed-4cec-af27-ad16ff328070 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:39.905910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:39.938961 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 520/1065] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:28:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 10:28:39.939983 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3157d02-49a2-43ce-bca2-70fecbf6e688 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:39.978922 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90450b8e-c5ed-4cec-af27-ad16ff328070 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:40.017155 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0a9f7-e7f2-4d42-b726-75c24ea4ea27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:40.017821 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0a9f7-e7f2-4d42-b726-75c24ea4ea27 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:40.018108 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0a9f7-e7f2-4d42-b726-75c24ea4ea27 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:40.018387 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0a9f7-e7f2-4d42-b726-75c24ea4ea27 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:40.019540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0a9f7-e7f2-4d42-b726-75c24ea4ea27 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:40.019858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0a9f7-e7f2-4d42-b726-75c24ea4ea27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:40.021615 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0a9f7-e7f2-4d42-b726-75c24ea4ea27 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:40.030874 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 546/1066] 10.222.0.59 () {56 vars in 1115 bytes} [Thu Jun 30 10:28:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:40.036432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0a9f7-e7f2-4d42-b726-75c24ea4ea27 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:40.044689 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3157d02-49a2-43ce-bca2-70fecbf6e688 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:40.062397 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:40.083466 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e717a-de50-4c91-87d0-1c0a9c8aa2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:40.084317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e717a-de50-4c91-87d0-1c0a9c8aa2ef None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:40.084637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e717a-de50-4c91-87d0-1c0a9c8aa2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:40.084920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e717a-de50-4c91-87d0-1c0a9c8aa2ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:40.095914 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e717a-de50-4c91-87d0-1c0a9c8aa2ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:40.097407 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e717a-de50-4c91-87d0-1c0a9c8aa2ef None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:40.115656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-b22e717a-de50-4c91-87d0-1c0a9c8aa2ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:40.115656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:40.115656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:40.115656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:40.115656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:40.115656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:40.115656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:40.115656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:40.115656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:40.115656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:40.115656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:40.115656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:40.115656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:28:40.115656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:28:40.115656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:28:40.116595 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:28:40.116595 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:40.116595 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:40.116595 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:40.116595 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:40.116595 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:40.116595 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:40.116595 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:40.116595 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:40.116595 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:40.116595 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:40.116595 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:40.116595 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:40.116595 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:40.116595 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:40.116595 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:40.116595 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:40.117680 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:28:40.117680 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:28:40.117680 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:40.117680 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:40.119186 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 521/1067] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:40.125388 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e717a-de50-4c91-87d0-1c0a9c8aa2ef None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:40.150642 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0a9f7-e7f2-4d42-b726-75c24ea4ea27 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:40.155590 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:40.189792 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc216ca-bd83-46c7-b3bd-914daa033af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:40.190582 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc216ca-bd83-46c7-b3bd-914daa033af8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:40.190868 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc216ca-bd83-46c7-b3bd-914daa033af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:40.191144 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc216ca-bd83-46c7-b3bd-914daa033af8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:40.203019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc216ca-bd83-46c7-b3bd-914daa033af8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:40.204455 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc216ca-bd83-46c7-b3bd-914daa033af8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:40.221848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-abc216ca-bd83-46c7-b3bd-914daa033af8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:40.221848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:40.221848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:40.221848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:40.221848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:40.221848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:40.221848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:40.221848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:40.221848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:40.221848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:40.221848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:40.221848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:40.221848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:28:40.221848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:28:40.221848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:28:40.222772 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:28:40.222772 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:40.222772 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:40.222772 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:40.222772 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:40.222772 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:40.222772 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:40.222772 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:40.222772 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:40.222772 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:40.222772 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:40.222772 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:40.222772 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:40.222772 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:40.222772 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:40.222772 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:40.222772 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:40.223741 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:28:40.223741 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:28:40.223741 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:40.223741 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:40.228233 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 547/1068] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:28:40.229064 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc216ca-bd83-46c7-b3bd-914daa033af8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:40.231647 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e717a-de50-4c91-87d0-1c0a9c8aa2ef None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:40.276425 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a1057-d70a-45e4-9a26-fb96e0c35d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:40.277117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a1057-d70a-45e4-9a26-fb96e0c35d24 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:40.277404 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a1057-d70a-45e4-9a26-fb96e0c35d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:40.277678 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a1057-d70a-45e4-9a26-fb96e0c35d24 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:40.278574 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a1057-d70a-45e4-9a26-fb96e0c35d24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:40.278884 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a1057-d70a-45e4-9a26-fb96e0c35d24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:40.280257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a1057-d70a-45e4-9a26-fb96e0c35d24 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:40.293044 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 522/1069] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:40.316516 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:40.346770 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc216ca-bd83-46c7-b3bd-914daa033af8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:40.385133 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d361de-0345-4261-89b7-0f3b77856d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:40.385878 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d361de-0345-4261-89b7-0f3b77856d29 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:40.386664 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d361de-0345-4261-89b7-0f3b77856d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:40.386941 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d361de-0345-4261-89b7-0f3b77856d29 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:40.387663 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d361de-0345-4261-89b7-0f3b77856d29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:40.387974 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d361de-0345-4261-89b7-0f3b77856d29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:40.389791 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d361de-0345-4261-89b7-0f3b77856d29 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:40.407943 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 548/1070] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:40.408921 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a1057-d70a-45e4-9a26-fb96e0c35d24 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:40.508115 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:40.521995 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a1057-d70a-45e4-9a26-fb96e0c35d24 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:40.558433 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62d03f-8796-42eb-91c7-5d55e15eb05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:40.559268 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62d03f-8796-42eb-91c7-5d55e15eb05d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:40.559617 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62d03f-8796-42eb-91c7-5d55e15eb05d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:40.559895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62d03f-8796-42eb-91c7-5d55e15eb05d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:40.567927 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62d03f-8796-42eb-91c7-5d55e15eb05d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:40.569340 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62d03f-8796-42eb-91c7-5d55e15eb05d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:40.583415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-4a62d03f-8796-42eb-91c7-5d55e15eb05d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:28:40.583415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:40.583415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:40.583415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:40.583415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:40.583415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:40.583415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:40.583415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:40.583415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:40.583415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:40.583415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:40.583415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:40.583415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:28:40.583415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:28:40.583415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:28:40.583415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:28:40.584476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:40.584476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:40.584476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:28:40.584476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:40.584476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:28:40.584476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:40.584476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:40.584476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:40.584476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:40.584476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:40.584476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:40.584476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:40.584476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:40.584476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:40.584476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:40.584476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:40.584476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:40.584476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:40.585475 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:40.585475 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:40.585475 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:28:40.585475 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:28:40.585475 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:28:40.585475 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:28:40.585475 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:28:40.585475 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:28:40.585475 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:28:40.585475 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:40.585475 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 523/1071] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Jun 30 10:28:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:28:40.592072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d361de-0345-4261-89b7-0f3b77856d29 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:40.690479 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d361de-0345-4261-89b7-0f3b77856d29 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:40.723351 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9ffa7-ef52-4146-bc0b-9098002250ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:40.724015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9ffa7-ef52-4146-bc0b-9098002250ea None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:40.724574 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9ffa7-ef52-4146-bc0b-9098002250ea None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:40.724859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9ffa7-ef52-4146-bc0b-9098002250ea None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:40.725673 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9ffa7-ef52-4146-bc0b-9098002250ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:40.725981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9ffa7-ef52-4146-bc0b-9098002250ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:40.727391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9ffa7-ef52-4146-bc0b-9098002250ea None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:40.729050 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:40.747292 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 549/1072] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Jun 30 10:28:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:40.752870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62d03f-8796-42eb-91c7-5d55e15eb05d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:40.850290 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62d03f-8796-42eb-91c7-5d55e15eb05d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:40.857073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dd81c-5657-4ebe-8f5b-cbc2710d7c50 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:40.857361 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dd81c-5657-4ebe-8f5b-cbc2710d7c50 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:40.857637 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dd81c-5657-4ebe-8f5b-cbc2710d7c50 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:40.859009 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 550/1073] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:28:40.863885 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e59e40-5fbb-484e-8791-2de932a79689 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:40.864170 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e59e40-5fbb-484e-8791-2de932a79689 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:40.864440 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e59e40-5fbb-484e-8791-2de932a79689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:40.880684 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e8e59e40-5fbb-484e-8791-2de932a79689 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:40.881890 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e8e59e40-5fbb-484e-8791-2de932a79689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:40.883802 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46bd83-506e-4f41-990b-d20c9cf62a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:40.884621 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46bd83-506e-4f41-990b-d20c9cf62a35 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:40.884914 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46bd83-506e-4f41-990b-d20c9cf62a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:40.885219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46bd83-506e-4f41-990b-d20c9cf62a35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:40.895686 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46bd83-506e-4f41-990b-d20c9cf62a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:40.897164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46bd83-506e-4f41-990b-d20c9cf62a35 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:40.905643 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:40.915630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-5b46bd83-506e-4f41-990b-d20c9cf62a35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:40.915630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:40.915630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:40.915630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:40.915630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:40.915630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:40.915630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:40.915630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:40.915630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:40.915630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:40.915630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:40.915630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:40.915630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:28:40.915630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:28:40.915630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:28:40.916571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:28:40.916571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:40.916571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:40.916571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:40.916571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:40.916571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:40.916571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:40.916571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:40.916571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:40.916571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:40.916571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:40.916571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:40.916571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:40.916571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:40.916571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:40.916571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:40.916571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:40.918119 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:28:40.918119 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:28:40.918119 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:40.918119 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:40.918119 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 524/1074] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:40.923067 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46bd83-506e-4f41-990b-d20c9cf62a35 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:40.949848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 551/1075] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:28:40.972625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e59e40-5fbb-484e-8791-2de932a79689 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:41.020350 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46bd83-506e-4f41-990b-d20c9cf62a35 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:41.053766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa7d12-000a-49b0-b328-0826cced6841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:41.054423 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa7d12-000a-49b0-b328-0826cced6841 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:41.054708 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa7d12-000a-49b0-b328-0826cced6841 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:41.054986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa7d12-000a-49b0-b328-0826cced6841 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:41.055701 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa7d12-000a-49b0-b328-0826cced6841 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:41.056014 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa7d12-000a-49b0-b328-0826cced6841 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:41.057435 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa7d12-000a-49b0-b328-0826cced6841 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:41.068525 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e59e40-5fbb-484e-8791-2de932a79689 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:41.068938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 525/1076] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:41.074440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa7d12-000a-49b0-b328-0826cced6841 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:41.091056 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:41.103467 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2a319-2204-4e3e-8349-c29ad5b9b9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:41.104188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2a319-2204-4e3e-8349-c29ad5b9b9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:41.104542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2a319-2204-4e3e-8349-c29ad5b9b9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:41.104826 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2a319-2204-4e3e-8349-c29ad5b9b9f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:41.114644 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2a319-2204-4e3e-8349-c29ad5b9b9f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:28:41.122733 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-bad2a319-2204-4e3e-8349-c29ad5b9b9f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:28:41.122733 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:41.122733 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:41.122733 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:41.122733 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:41.122733 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:41.122733 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:41.122733 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:41.122733 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:41.122733 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:41.122733 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:41.122733 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:41.122733 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:28:41.122733 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:28:41.122733 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:28:41.122733 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:28:41.123704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:28:41.123704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:28:41.123704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:28:41.123704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:28:41.123704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:41.123704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:41.123704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:41.123704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:41.123704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:41.123704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:41.123704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:41.123704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:41.123704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:41.123704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:41.123704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:41.123704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:41.124602 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:41.124602 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:41.124602 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:41.124602 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:41.124602 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:28:41.124602 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:28:41.124602 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:28:41.124602 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:28:41.124602 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:28:41.124602 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:28:41.124602 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:28:41.124602 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:41.124602 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 552/1077] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:28:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:28:41.129864 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2a319-2204-4e3e-8349-c29ad5b9b9f4 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:41.133266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:41.174426 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa7d12-000a-49b0-b328-0826cced6841 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:41.207212 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10105dbe-362c-43c5-a47f-14ddf710f9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:41.207989 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10105dbe-362c-43c5-a47f-14ddf710f9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:41.208275 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10105dbe-362c-43c5-a47f-14ddf710f9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:41.208571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10105dbe-362c-43c5-a47f-14ddf710f9c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:41.215074 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10105dbe-362c-43c5-a47f-14ddf710f9c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:41.216542 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10105dbe-362c-43c5-a47f-14ddf710f9c3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:41.228953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2a319-2204-4e3e-8349-c29ad5b9b9f4 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:41.230520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-10105dbe-362c-43c5-a47f-14ddf710f9c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:41.230520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:41.230520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:41.230520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:41.230520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:41.230520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:41.230520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:41.230520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:41.230520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:41.230520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:41.230520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:41.230520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:41.230520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:28:41.230520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:28:41.230520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:28:41.231440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:28:41.231440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:41.231440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:41.231440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:41.231440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:41.231440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:41.231440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:41.231440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:41.231440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:41.231440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:41.231440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:41.231440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:41.231440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:41.231440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:41.231440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:41.231440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:41.231440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:41.232375 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:28:41.232375 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:28:41.232375 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:28:41.232375 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:28:41.232375 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:28:41.232375 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:28:41.232375 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:41.232375 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:41.232375 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 526/1078] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:28:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:28:41.237625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10105dbe-362c-43c5-a47f-14ddf710f9c3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:41.266218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d65b86-b1a5-4078-bb3a-4b77136ca55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:41.266878 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d65b86-b1a5-4078-bb3a-4b77136ca55e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:41.267156 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d65b86-b1a5-4078-bb3a-4b77136ca55e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:41.267431 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d65b86-b1a5-4078-bb3a-4b77136ca55e None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:41.268151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d65b86-b1a5-4078-bb3a-4b77136ca55e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:41.268452 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d65b86-b1a5-4078-bb3a-4b77136ca55e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:41.269834 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d65b86-b1a5-4078-bb3a-4b77136ca55e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:41.277966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 553/1079] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:28:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:41.283631 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d65b86-b1a5-4078-bb3a-4b77136ca55e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:41.328308 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:41.338763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10105dbe-362c-43c5-a47f-14ddf710f9c3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:41.360062 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:41.376794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef3c2c-b2fc-42d9-8b71-705a77938d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:41.377452 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef3c2c-b2fc-42d9-8b71-705a77938d9e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:41.377741 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef3c2c-b2fc-42d9-8b71-705a77938d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:41.378017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef3c2c-b2fc-42d9-8b71-705a77938d9e None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:41.378796 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef3c2c-b2fc-42d9-8b71-705a77938d9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:41.379108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef3c2c-b2fc-42d9-8b71-705a77938d9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:41.380565 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef3c2c-b2fc-42d9-8b71-705a77938d9e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:41.385693 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d65b86-b1a5-4078-bb3a-4b77136ca55e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:41.392727 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 527/1080] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:28:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:41.398566 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef3c2c-b2fc-42d9-8b71-705a77938d9e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:41.419318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81ea67-0ee7-45bb-9535-6f44d6b5f74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:41.420197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81ea67-0ee7-45bb-9535-6f44d6b5f74e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:41.420480 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81ea67-0ee7-45bb-9535-6f44d6b5f74e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:41.420786 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81ea67-0ee7-45bb-9535-6f44d6b5f74e None admin] PATH_INFO: `/v3/users/ba0d0884196845da9154fd7054847c0d` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:41.421978 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81ea67-0ee7-45bb-9535-6f44d6b5f74e None admin] RBAC: Authorizing `identity:get_user(user_id=ba0d0884196845da9154fd7054847c0d)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:41.423399 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81ea67-0ee7-45bb-9535-6f44d6b5f74e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:41.425060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 554/1081] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:28:41 2022] GET /identity/v3/users/ba0d0884196845da9154fd7054847c0d => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:41.430764 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81ea67-0ee7-45bb-9535-6f44d6b5f74e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:41.496464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef3c2c-b2fc-42d9-8b71-705a77938d9e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:41.527681 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81ea67-0ee7-45bb-9535-6f44d6b5f74e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:41.529594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6936fc-de2a-4db2-93e9-eb1a4c756627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:41.530474 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6936fc-de2a-4db2-93e9-eb1a4c756627 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:41.530763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6936fc-de2a-4db2-93e9-eb1a4c756627 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:41.531042 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6936fc-de2a-4db2-93e9-eb1a4c756627 None admin] PATH_INFO: `/v3/projects/423854cc8f524ecb8d740d1cb0053856/users/1bfd036d747241d9bc314b60bf8648b6/roles/8cda5b4c7265463f8caa1f85608653ec` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:41.533286 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6936fc-de2a-4db2-93e9-eb1a4c756627 None admin] RBAC: Authorizing `identity:create_grant(project_id=423854cc8f524ecb8d740d1cb0053856, user_id=1bfd036d747241d9bc314b60bf8648b6, role_id=8cda5b4c7265463f8caa1f85608653ec)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:41.534721 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6936fc-de2a-4db2-93e9-eb1a4c756627 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:41.540444 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:41.547923 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 528/1082] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 30 10:28:41 2022] PUT /identity/v3/projects/423854cc8f524ecb8d740d1cb0053856/users/1bfd036d747241d9bc314b60bf8648b6/roles/8cda5b4c7265463f8caa1f85608653ec => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:28:41.562623 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06482ab4-d4e3-4206-b8d3-1a56e5686963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:41.563504 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06482ab4-d4e3-4206-b8d3-1a56e5686963 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:41.563782 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06482ab4-d4e3-4206-b8d3-1a56e5686963 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:41.564054 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06482ab4-d4e3-4206-b8d3-1a56e5686963 None admin] PATH_INFO: `/v3/projects/9557354c80ed4631b5c10f6c057f472a` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:41.565339 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06482ab4-d4e3-4206-b8d3-1a56e5686963 None admin] RBAC: Authorizing `identity:get_project(project_id=9557354c80ed4631b5c10f6c057f472a)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:41.566788 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06482ab4-d4e3-4206-b8d3-1a56e5686963 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:41.568586 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 555/1083] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:28:41 2022] GET /identity/v3/projects/9557354c80ed4631b5c10f6c057f472a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:41.574869 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6936fc-de2a-4db2-93e9-eb1a4c756627 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:41.622553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:41.685528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6936fc-de2a-4db2-93e9-eb1a4c756627 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:41.721490 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee852039-59d8-45df-9339-f6ee45e4e753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:41.722371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee852039-59d8-45df-9339-f6ee45e4e753 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:41.722684 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee852039-59d8-45df-9339-f6ee45e4e753 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:41.722957 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee852039-59d8-45df-9339-f6ee45e4e753 None admin] PATH_INFO: `/v3/projects/9557354c80ed4631b5c10f6c057f472a/users/ba0d0884196845da9154fd7054847c0d/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:41.725193 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee852039-59d8-45df-9339-f6ee45e4e753 None admin] RBAC: Authorizing `identity:create_grant(project_id=9557354c80ed4631b5c10f6c057f472a, user_id=ba0d0884196845da9154fd7054847c0d, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:41.726631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee852039-59d8-45df-9339-f6ee45e4e753 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:41.740432 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 529/1084] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 30 10:28:41 2022] PUT /identity/v3/projects/9557354c80ed4631b5c10f6c057f472a/users/ba0d0884196845da9154fd7054847c0d/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:43.566462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ed199-9d15-4546-8b5a-6c544fbdab5a None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:43.566959 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ed199-9d15-4546-8b5a-6c544fbdab5a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:43.566959 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ed199-9d15-4546-8b5a-6c544fbdab5a None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:43.568311 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 556/1085] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:43.573644 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fcb57-4198-4eb9-b4c7-6fc58000c35d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:43.574041 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fcb57-4198-4eb9-b4c7-6fc58000c35d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:43.574352 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fcb57-4198-4eb9-b4c7-6fc58000c35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:43.590807 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7d8fcb57-4198-4eb9-b4c7-6fc58000c35d None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:43.592018 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7d8fcb57-4198-4eb9-b4c7-6fc58000c35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:43.657477 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 530/1086] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:43.681588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ed199-9d15-4546-8b5a-6c544fbdab5a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:43.781757 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ed199-9d15-4546-8b5a-6c544fbdab5a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:43.814119 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2c405-574b-448d-a60a-37c1a8792383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:43.814913 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2c405-574b-448d-a60a-37c1a8792383 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:43.815197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2c405-574b-448d-a60a-37c1a8792383 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:43.815473 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2c405-574b-448d-a60a-37c1a8792383 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:43.820049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbea518-9dcb-460f-bb20-f3df2fca5b52 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:43.820291 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbea518-9dcb-460f-bb20-f3df2fca5b52 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:43.820602 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbea518-9dcb-460f-bb20-f3df2fca5b52 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:43.821979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 531/1087] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:43.826449 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b2c405-574b-448d-a60a-37c1a8792383 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:28:43.826942 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88e730-f22c-439e-b9d6-1d0b4ff2a196 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:43.827225 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88e730-f22c-439e-b9d6-1d0b4ff2a196 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:43.827499 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88e730-f22c-439e-b9d6-1d0b4ff2a196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:43.834745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-c1b2c405-574b-448d-a60a-37c1a8792383 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:28:43.834745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:43.834745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:43.834745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:43.834745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:43.834745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:43.834745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:43.834745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:43.834745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:43.834745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:43.834745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:43.834745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:43.834745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:28:43.834745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:28:43.834745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:28:43.834745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:28:43.835690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:28:43.835690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:28:43.835690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:28:43.835690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:28:43.835690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:43.835690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:43.835690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:43.835690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:43.835690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:43.835690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:43.835690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:43.835690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:43.835690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:43.835690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:43.835690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:43.835690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:43.836565 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:43.836565 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:43.836565 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:43.836565 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:43.836565 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:28:43.836565 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:28:43.836565 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:28:43.836565 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:28:43.836565 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:28:43.836565 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:28:43.836565 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:28:43.836565 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:43.836565 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 557/1088] 10.222.0.59 () {56 vars in 1120 bytes} [Thu Jun 30 10:28:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:43.842117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2c405-574b-448d-a60a-37c1a8792383 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:43.846286 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0f88e730-f22c-439e-b9d6-1d0b4ff2a196 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:43.847470 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0f88e730-f22c-439e-b9d6-1d0b4ff2a196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:43.871527 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:43.883581 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:43.918725 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 532/1089] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:28:43.939496 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2c405-574b-448d-a60a-37c1a8792383 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:43.942242 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88e730-f22c-439e-b9d6-1d0b4ff2a196 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:43.972780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9fccb-b213-4ea7-927c-2a76399ebca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:43.973437 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9fccb-b213-4ea7-927c-2a76399ebca3 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:43.973719 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9fccb-b213-4ea7-927c-2a76399ebca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:43.973993 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9fccb-b213-4ea7-927c-2a76399ebca3 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:43.974988 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9fccb-b213-4ea7-927c-2a76399ebca3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:43.975292 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9fccb-b213-4ea7-927c-2a76399ebca3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:43.976672 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9fccb-b213-4ea7-927c-2a76399ebca3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:43.985405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 558/1090] 10.222.0.59 () {56 vars in 1115 bytes} [Thu Jun 30 10:28:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:43.990748 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9fccb-b213-4ea7-927c-2a76399ebca3 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:44.048520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88e730-f22c-439e-b9d6-1d0b4ff2a196 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:44.081005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02f59e-7856-4962-b0ef-32acd31047c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:44.081698 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02f59e-7856-4962-b0ef-32acd31047c9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:44.081982 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02f59e-7856-4962-b0ef-32acd31047c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:44.082254 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02f59e-7856-4962-b0ef-32acd31047c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:44.086664 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9fccb-b213-4ea7-927c-2a76399ebca3 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:44.088154 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:44.093091 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02f59e-7856-4962-b0ef-32acd31047c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:28:44.100712 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-3e02f59e-7856-4962-b0ef-32acd31047c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:28:44.100712 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:44.100712 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:44.100712 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:44.100712 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:44.100712 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:44.100712 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:44.100712 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:44.100712 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:44.100712 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:44.100712 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:44.100712 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:44.100712 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:28:44.100712 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:28:44.100712 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:28:44.100712 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:28:44.101660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:28:44.101660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:28:44.101660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:28:44.101660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:28:44.101660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:44.101660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:44.101660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:44.101660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:44.101660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:44.101660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:44.101660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:44.101660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:44.101660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:44.101660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:44.101660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:44.101660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:44.102516 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:44.102516 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:44.102516 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:44.102516 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:44.102516 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:28:44.102516 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:28:44.102516 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:28:44.102516 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:28:44.102516 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:28:44.102516 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:28:44.102516 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:28:44.102516 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:28:44.102516 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 533/1091] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:28:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:28:44.108374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02f59e-7856-4962-b0ef-32acd31047c9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:44.120977 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331e5b1-7f14-4ce2-85e5-6960241fc887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:44.121761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331e5b1-7f14-4ce2-85e5-6960241fc887 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:44.122042 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331e5b1-7f14-4ce2-85e5-6960241fc887 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:44.122319 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331e5b1-7f14-4ce2-85e5-6960241fc887 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:44.129151 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:44.133274 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331e5b1-7f14-4ce2-85e5-6960241fc887 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:44.134895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331e5b1-7f14-4ce2-85e5-6960241fc887 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:44.152714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-7331e5b1-7f14-4ce2-85e5-6960241fc887 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:44.152714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:44.152714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:44.152714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:44.152714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:44.152714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:44.152714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:44.152714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:44.152714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:44.152714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:44.152714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:44.152714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:44.152714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:28:44.152714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:28:44.152714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:28:44.153619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:28:44.153619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:44.153619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:44.153619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:44.153619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:44.153619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:44.153619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:44.153619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:44.153619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:44.153619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:44.153619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:44.153619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:44.153619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:44.153619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:44.153619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:44.153619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:44.153619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:44.154530 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:28:44.154530 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:28:44.154530 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:44.154530 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:44.154530 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 559/1092] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:28:44.159462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331e5b1-7f14-4ce2-85e5-6960241fc887 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:44.208684 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02f59e-7856-4962-b0ef-32acd31047c9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:44.242014 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38386577-6c2d-441a-b160-e075d0805015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:44.242671 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38386577-6c2d-441a-b160-e075d0805015 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:44.242959 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38386577-6c2d-441a-b160-e075d0805015 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:44.243239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38386577-6c2d-441a-b160-e075d0805015 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:44.243979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38386577-6c2d-441a-b160-e075d0805015 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:44.244287 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38386577-6c2d-441a-b160-e075d0805015 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:44.245722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38386577-6c2d-441a-b160-e075d0805015 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:44.253991 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 534/1093] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:28:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:44.259540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38386577-6c2d-441a-b160-e075d0805015 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:44.265584 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331e5b1-7f14-4ce2-85e5-6960241fc887 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:44.300082 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4952c-6c5e-4b5a-a3c5-24850f04705a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:44.300766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4952c-6c5e-4b5a-a3c5-24850f04705a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:44.301053 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4952c-6c5e-4b5a-a3c5-24850f04705a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:44.301336 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4952c-6c5e-4b5a-a3c5-24850f04705a None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:44.302046 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4952c-6c5e-4b5a-a3c5-24850f04705a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:44.302357 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4952c-6c5e-4b5a-a3c5-24850f04705a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:44.303706 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4952c-6c5e-4b5a-a3c5-24850f04705a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:44.315278 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 560/1094] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:44.320747 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4952c-6c5e-4b5a-a3c5-24850f04705a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:44.336253 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:44.341732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:44.360243 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38386577-6c2d-441a-b160-e075d0805015 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:44.393786 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e2c97-1cb6-4e50-b084-6c8f8c2fe761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:44.394647 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e2c97-1cb6-4e50-b084-6c8f8c2fe761 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:44.394934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e2c97-1cb6-4e50-b084-6c8f8c2fe761 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:44.395218 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e2c97-1cb6-4e50-b084-6c8f8c2fe761 None admin] PATH_INFO: `/v3/users/ba0d0884196845da9154fd7054847c0d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:44.396407 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e2c97-1cb6-4e50-b084-6c8f8c2fe761 None admin] RBAC: Authorizing `identity:get_user(user_id=ba0d0884196845da9154fd7054847c0d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:44.397885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e2c97-1cb6-4e50-b084-6c8f8c2fe761 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:44.399678 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 535/1095] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:28:44 2022] GET /identity/v3/users/ba0d0884196845da9154fd7054847c0d => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:44.405684 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e2c97-1cb6-4e50-b084-6c8f8c2fe761 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:44.418915 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4952c-6c5e-4b5a-a3c5-24850f04705a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:44.452631 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8950a97-b158-40b4-8465-87a8e086de89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:44.453416 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8950a97-b158-40b4-8465-87a8e086de89 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:44.453700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8950a97-b158-40b4-8465-87a8e086de89 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:44.453978 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8950a97-b158-40b4-8465-87a8e086de89 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:44.460913 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8950a97-b158-40b4-8465-87a8e086de89 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:44.462348 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8950a97-b158-40b4-8465-87a8e086de89 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:44.478859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-e8950a97-b158-40b4-8465-87a8e086de89 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:28:44.478859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:44.478859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:44.478859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:44.478859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:44.478859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:44.478859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:44.478859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:44.478859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:44.478859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:44.478859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:44.478859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:44.478859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:28:44.478859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:28:44.478859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:28:44.478859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:28:44.479873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:44.479873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:44.479873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:28:44.479873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:44.479873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:28:44.479873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:28:44.479873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:44.479873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:44.479873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:44.479873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:44.479873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:44.479873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:44.479873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:44.479873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:44.479873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:44.479873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:44.479873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:44.479873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:44.481140 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:44.481140 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:44.481140 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:28:44.481140 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:28:44.481140 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:28:44.481140 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:28:44.481140 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:28:44.481140 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:28:44.481140 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:28:44.481140 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:44.481140 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 561/1096] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Jun 30 10:28:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:44.485978 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8950a97-b158-40b4-8465-87a8e086de89 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:44.517083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e2c97-1cb6-4e50-b084-6c8f8c2fe761 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:44.550194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3a14d-3b48-4abe-8852-c7845e76e80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:44.550841 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3a14d-3b48-4abe-8852-c7845e76e80a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:44.551129 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3a14d-3b48-4abe-8852-c7845e76e80a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:44.551413 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3a14d-3b48-4abe-8852-c7845e76e80a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:44.556662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:44.570053 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:44.582245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8950a97-b158-40b4-8465-87a8e086de89 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:44.615830 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b71857-4ecb-4e76-803b-c787ac2a36a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:44.616420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b71857-4ecb-4e76-803b-c787ac2a36a0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:44.616739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b71857-4ecb-4e76-803b-c787ac2a36a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:44.617017 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b71857-4ecb-4e76-803b-c787ac2a36a0 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:44.617831 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b71857-4ecb-4e76-803b-c787ac2a36a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:44.618138 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b71857-4ecb-4e76-803b-c787ac2a36a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:44.618815 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3a14d-3b48-4abe-8852-c7845e76e80a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:44.619558 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b71857-4ecb-4e76-803b-c787ac2a36a0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:44.620810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3a14d-3b48-4abe-8852-c7845e76e80a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:44.637196 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 562/1097] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Jun 30 10:28:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:44.642895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b71857-4ecb-4e76-803b-c787ac2a36a0 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:44.718793 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 536/1098] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:28:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 10:28:44.724791 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3a14d-3b48-4abe-8852-c7845e76e80a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:44.737917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b71857-4ecb-4e76-803b-c787ac2a36a0 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:44.766904 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:44.772613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496f0ec-0348-42e7-9a8b-83c3d0dba7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:44.773256 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496f0ec-0348-42e7-9a8b-83c3d0dba7bd None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:44.773537 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496f0ec-0348-42e7-9a8b-83c3d0dba7bd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:44.773821 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496f0ec-0348-42e7-9a8b-83c3d0dba7bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:44.773969 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:44.822646 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3a14d-3b48-4abe-8852-c7845e76e80a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:44.840310 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496f0ec-0348-42e7-9a8b-83c3d0dba7bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:44.841784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496f0ec-0348-42e7-9a8b-83c3d0dba7bd None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:44.856316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75699161-9864-4d15-8b3c-baeed15bf255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:44.857190 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75699161-9864-4d15-8b3c-baeed15bf255 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:44.857477 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75699161-9864-4d15-8b3c-baeed15bf255 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:44.857762 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75699161-9864-4d15-8b3c-baeed15bf255 None admin] PATH_INFO: `/v3/projects/9557354c80ed4631b5c10f6c057f472a` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:44.858926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75699161-9864-4d15-8b3c-baeed15bf255 None admin] RBAC: Authorizing `identity:get_project(project_id=9557354c80ed4631b5c10f6c057f472a)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:44.860367 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75699161-9864-4d15-8b3c-baeed15bf255 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:44.862102 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 537/1099] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:28:44 2022] GET /identity/v3/projects/9557354c80ed4631b5c10f6c057f472a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:44.868098 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75699161-9864-4d15-8b3c-baeed15bf255 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:44.940344 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 563/1100] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:28:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 10:28:44.945954 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496f0ec-0348-42e7-9a8b-83c3d0dba7bd None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:44.965138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75699161-9864-4d15-8b3c-baeed15bf255 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:44.975330 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:44.983049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:45.000170 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546240cb-fb0f-41ef-954e-89b7f84034b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:45.000838 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546240cb-fb0f-41ef-954e-89b7f84034b9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:45.001150 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546240cb-fb0f-41ef-954e-89b7f84034b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:45.001429 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546240cb-fb0f-41ef-954e-89b7f84034b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:45.002600 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546240cb-fb0f-41ef-954e-89b7f84034b9 None admin] RBAC: Adding query filter params (role.id=ab64ea6d0475430195af26a049485569, scope.project.id=9557354c80ed4631b5c10f6c057f472a, user.id=ba0d0884196845da9154fd7054847c0d) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:45.002713 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546240cb-fb0f-41ef-954e-89b7f84034b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:45.004062 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546240cb-fb0f-41ef-954e-89b7f84034b9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:45.009767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 538/1101] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:28:44 2022] GET /identity/v3/role_assignments?user.id=ba0d0884196845da9154fd7054847c0d&scope.project.id=9557354c80ed4631b5c10f6c057f472a&role.id=ab64ea6d0475430195af26a049485569 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:28:45.050151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496f0ec-0348-42e7-9a8b-83c3d0dba7bd None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:45.086468 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50710788-23cc-411c-81ca-760632ad49ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:45.087275 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50710788-23cc-411c-81ca-760632ad49ac None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:45.087556 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50710788-23cc-411c-81ca-760632ad49ac None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:45.087831 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50710788-23cc-411c-81ca-760632ad49ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:45.098731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50710788-23cc-411c-81ca-760632ad49ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:45.100442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50710788-23cc-411c-81ca-760632ad49ac None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:45.119304 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-50710788-23cc-411c-81ca-760632ad49ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:45.119304 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:45.119304 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:45.119304 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:45.119304 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:45.119304 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:45.119304 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:45.119304 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:45.119304 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:45.119304 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:45.119304 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:45.119304 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:45.119304 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:28:45.119304 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:28:45.119304 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:28:45.120882 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:28:45.120882 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:45.120882 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:45.120882 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:45.120882 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:45.120882 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:45.120882 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:45.120882 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:45.120882 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:45.120882 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:45.120882 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:45.120882 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:45.120882 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:45.120882 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:45.120882 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:45.120882 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:45.120882 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:45.121795 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:28:45.121795 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:28:45.121795 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:28:45.121795 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:45.124690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 564/1102] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:28:45.126833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546240cb-fb0f-41ef-954e-89b7f84034b9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:45.227785 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546240cb-fb0f-41ef-954e-89b7f84034b9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:45.261930 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63d550-cfa6-4886-b285-2ab96ce0e04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:45.262588 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63d550-cfa6-4886-b285-2ab96ce0e04e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:45.262912 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63d550-cfa6-4886-b285-2ab96ce0e04e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:45.263137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63d550-cfa6-4886-b285-2ab96ce0e04e None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:45.263844 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63d550-cfa6-4886-b285-2ab96ce0e04e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:45.264148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63d550-cfa6-4886-b285-2ab96ce0e04e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:45.265543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63d550-cfa6-4886-b285-2ab96ce0e04e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:45.278071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 539/1103] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:45.283905 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50710788-23cc-411c-81ca-760632ad49ac None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:45.365907 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:45.381850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50710788-23cc-411c-81ca-760632ad49ac None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:45.414757 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db446984-bcfb-47b7-bf4f-5d57f421e783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:45.415533 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db446984-bcfb-47b7-bf4f-5d57f421e783 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:45.415810 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db446984-bcfb-47b7-bf4f-5d57f421e783 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:45.416081 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db446984-bcfb-47b7-bf4f-5d57f421e783 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:45.423088 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db446984-bcfb-47b7-bf4f-5d57f421e783 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:45.424543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db446984-bcfb-47b7-bf4f-5d57f421e783 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:45.438011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-db446984-bcfb-47b7-bf4f-5d57f421e783 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:45.438011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:28:45.438011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:28:45.438011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:28:45.438011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:28:45.438011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:28:45.438011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:28:45.438011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:28:45.438011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:28:45.438011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:28:45.438011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:28:45.438011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:28:45.438011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:28:45.438011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:28:45.438011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:28:45.438975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:28:45.438975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:28:45.438975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:28:45.438975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:28:45.438975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:28:45.438975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:28:45.438975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:28:45.438975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:28:45.438975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:28:45.438975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:28:45.438975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:28:45.438975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:28:45.438975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:28:45.438975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:28:45.438975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:28:45.438975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:28:45.438975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:28:45.439905 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:28:45.439905 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:28:45.439905 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:28:45.439905 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:28:45.439905 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:28:45.439905 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:28:45.439905 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:28:45.439905 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:28:45.440714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 565/1104] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:28:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:28:45.445061 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63d550-cfa6-4886-b285-2ab96ce0e04e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:45.489090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:45.547039 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63d550-cfa6-4886-b285-2ab96ce0e04e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:45.579270 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2a561-aa3a-4ac8-947e-1740912c7716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:45.579919 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2a561-aa3a-4ac8-947e-1740912c7716 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:45.580204 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2a561-aa3a-4ac8-947e-1740912c7716 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:45.580478 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2a561-aa3a-4ac8-947e-1740912c7716 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:45.581282 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2a561-aa3a-4ac8-947e-1740912c7716 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:45.581592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2a561-aa3a-4ac8-947e-1740912c7716 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:45.583021 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2a561-aa3a-4ac8-947e-1740912c7716 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:45.594784 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 540/1105] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:28:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:45.601074 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db446984-bcfb-47b7-bf4f-5d57f421e783 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:45.698468 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db446984-bcfb-47b7-bf4f-5d57f421e783 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:45.731394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892232a-31d7-4da5-b038-5de21c17b8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:45.732040 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892232a-31d7-4da5-b038-5de21c17b8ba None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:45.732323 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892232a-31d7-4da5-b038-5de21c17b8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:45.732635 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892232a-31d7-4da5-b038-5de21c17b8ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:45.733448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892232a-31d7-4da5-b038-5de21c17b8ba None admin] RBAC: Adding query filter params (role.id=8cda5b4c7265463f8caa1f85608653ec, scope.project.id=423854cc8f524ecb8d740d1cb0053856, user.id=1bfd036d747241d9bc314b60bf8648b6) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:45.733759 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892232a-31d7-4da5-b038-5de21c17b8ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:45.735170 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892232a-31d7-4da5-b038-5de21c17b8ba None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:45.740881 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 566/1106] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:28:45 2022] GET /identity/v3/role_assignments?user.id=1bfd036d747241d9bc314b60bf8648b6&scope.project.id=423854cc8f524ecb8d740d1cb0053856&role.id=8cda5b4c7265463f8caa1f85608653ec => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:47.076823 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ac06a-8cbf-498a-8d12-412d7452eaf0 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:47.077374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ac06a-8cbf-498a-8d12-412d7452eaf0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:47.077374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ac06a-8cbf-498a-8d12-412d7452eaf0 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:47.078746 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 541/1107] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:47.083822 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e2823-92c9-4429-8651-0170df589042 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:47.084218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e2823-92c9-4429-8651-0170df589042 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:47.084390 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e2823-92c9-4429-8651-0170df589042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:47.101545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-fb2e2823-92c9-4429-8651-0170df589042 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:47.102723 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-fb2e2823-92c9-4429-8651-0170df589042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:47.105333 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:47.168897 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 567/1108] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:47.193556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ac06a-8cbf-498a-8d12-412d7452eaf0 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:47.293054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ac06a-8cbf-498a-8d12-412d7452eaf0 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:47.294545 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:47.327482 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713cc91-efbc-4fea-b7b6-e0324042023d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:47.328196 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713cc91-efbc-4fea-b7b6-e0324042023d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:47.328477 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713cc91-efbc-4fea-b7b6-e0324042023d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:47.328782 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713cc91-efbc-4fea-b7b6-e0324042023d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:47.329935 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713cc91-efbc-4fea-b7b6-e0324042023d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:47.331378 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713cc91-efbc-4fea-b7b6-e0324042023d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:47.333023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 542/1109] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:47.339356 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e2823-92c9-4429-8651-0170df589042 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:47.434385 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e2823-92c9-4429-8651-0170df589042 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:47.467134 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26dad0-0d84-452f-9648-ee2186c5e53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:47.467780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26dad0-0d84-452f-9648-ee2186c5e53f None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:47.468061 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26dad0-0d84-452f-9648-ee2186c5e53f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:47.468335 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26dad0-0d84-452f-9648-ee2186c5e53f None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:47.469070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26dad0-0d84-452f-9648-ee2186c5e53f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:47.470485 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26dad0-0d84-452f-9648-ee2186c5e53f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:47.479628 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:47.497334 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 568/1110] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 30 10:28:47 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:28:49.570298 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3017d-1c46-41f3-bc40-9274024999fc None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:49.570844 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3017d-1c46-41f3-bc40-9274024999fc None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:49.570844 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3017d-1c46-41f3-bc40-9274024999fc None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:49.572161 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 543/1111] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:49.577366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c9ac4-459f-4f6b-ae21-061bbbaae45e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:49.577758 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c9ac4-459f-4f6b-ae21-061bbbaae45e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:49.577918 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c9ac4-459f-4f6b-ae21-061bbbaae45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:49.594031 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-694c9ac4-459f-4f6b-ae21-061bbbaae45e None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:49.595190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-694c9ac4-459f-4f6b-ae21-061bbbaae45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:49.658451 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 569/1112] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:49.681728 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3017d-1c46-41f3-bc40-9274024999fc None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:49.782450 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3017d-1c46-41f3-bc40-9274024999fc None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:49.815161 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62effa1c-64f0-45c2-8ee2-956136fa0c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:49.815995 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62effa1c-64f0-45c2-8ee2-956136fa0c67 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:49.816276 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62effa1c-64f0-45c2-8ee2-956136fa0c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:49.816573 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62effa1c-64f0-45c2-8ee2-956136fa0c67 None admin] PATH_INFO: `/v3/roles/2d85fe2aee9740f984e944e0d5c80ec5` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:49.818008 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62effa1c-64f0-45c2-8ee2-956136fa0c67 None admin] RBAC: Authorizing `identity:get_role(role_id=2d85fe2aee9740f984e944e0d5c80ec5)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:49.819375 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62effa1c-64f0-45c2-8ee2-956136fa0c67 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:49.820806 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 544/1113] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:28:49 2022] GET /identity/v3/roles/2d85fe2aee9740f984e944e0d5c80ec5 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:49.826522 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c9ac4-459f-4f6b-ae21-061bbbaae45e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:49.922868 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c9ac4-459f-4f6b-ae21-061bbbaae45e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:49.944994 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:49.956378 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e63b0b-d21b-4586-872a-8ef4ab509977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:49.957261 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e63b0b-d21b-4586-872a-8ef4ab509977 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:49.957544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e63b0b-d21b-4586-872a-8ef4ab509977 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:49.957817 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e63b0b-d21b-4586-872a-8ef4ab509977 None admin] PATH_INFO: `/v3/users/599b03ca02db45d380c8cd81e20c4de8` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:49.971539 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e63b0b-d21b-4586-872a-8ef4ab509977 None admin] RBAC: Authorizing `identity:get_user(user_id=599b03ca02db45d380c8cd81e20c4de8)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:49.973017 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e63b0b-d21b-4586-872a-8ef4ab509977 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:49.974902 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 570/1114] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:28:49 2022] GET /identity/v3/users/599b03ca02db45d380c8cd81e20c4de8 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:49.981194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62effa1c-64f0-45c2-8ee2-956136fa0c67 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:50.021276 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:50.078151 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62effa1c-64f0-45c2-8ee2-956136fa0c67 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:50.112426 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2914c8-17c1-4e5b-b08d-1a145257f57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:50.113233 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2914c8-17c1-4e5b-b08d-1a145257f57f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:50.113523 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2914c8-17c1-4e5b-b08d-1a145257f57f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:50.113796 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2914c8-17c1-4e5b-b08d-1a145257f57f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:50.177830 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2914c8-17c1-4e5b-b08d-1a145257f57f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:50.179273 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2914c8-17c1-4e5b-b08d-1a145257f57f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:50.215955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:50.274320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 545/1115] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:28:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:28:50.280712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e63b0b-d21b-4586-872a-8ef4ab509977 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:50.375641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e63b0b-d21b-4586-872a-8ef4ab509977 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:50.408319 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9a5ac-5cb1-4b52-a25a-f923f545fb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:50.409188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9a5ac-5cb1-4b52-a25a-f923f545fb57 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:50.409469 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9a5ac-5cb1-4b52-a25a-f923f545fb57 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:50.409742 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9a5ac-5cb1-4b52-a25a-f923f545fb57 None admin] PATH_INFO: `/v3/projects/9557354c80ed4631b5c10f6c057f472a` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:50.410895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9a5ac-5cb1-4b52-a25a-f923f545fb57 None admin] RBAC: Authorizing `identity:get_project(project_id=9557354c80ed4631b5c10f6c057f472a)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:50.412305 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9a5ac-5cb1-4b52-a25a-f923f545fb57 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:50.413998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 571/1116] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:28:50 2022] GET /identity/v3/projects/9557354c80ed4631b5c10f6c057f472a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:50.419836 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2914c8-17c1-4e5b-b08d-1a145257f57f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:50.516051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2914c8-17c1-4e5b-b08d-1a145257f57f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:50.548059 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd632c-df9b-45d0-b376-eb1ea1fee56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:50.548717 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd632c-df9b-45d0-b376-eb1ea1fee56c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:50.548999 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd632c-df9b-45d0-b376-eb1ea1fee56c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:50.549268 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd632c-df9b-45d0-b376-eb1ea1fee56c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:50.550073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd632c-df9b-45d0-b376-eb1ea1fee56c None admin] RBAC: Adding query filter params (role.id=2d85fe2aee9740f984e944e0d5c80ec5, scope.project.id=9557354c80ed4631b5c10f6c057f472a, user.id=599b03ca02db45d380c8cd81e20c4de8) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:50.550379 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd632c-df9b-45d0-b376-eb1ea1fee56c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:50.551788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd632c-df9b-45d0-b376-eb1ea1fee56c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:50.557011 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 546/1117] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:28:50 2022] GET /identity/v3/role_assignments?user.id=599b03ca02db45d380c8cd81e20c4de8&scope.project.id=9557354c80ed4631b5c10f6c057f472a&role.id=2d85fe2aee9740f984e944e0d5c80ec5 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:52.553459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476ce4e-cf98-40b9-b62f-1f4e0a5cf541 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:52.554003 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476ce4e-cf98-40b9-b62f-1f4e0a5cf541 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:52.554003 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476ce4e-cf98-40b9-b62f-1f4e0a5cf541 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:52.555306 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 572/1118] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:52.561156 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3a950-5460-4c0f-8314-6c8b0e80af76 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:52.561555 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3a950-5460-4c0f-8314-6c8b0e80af76 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:52.561723 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3a950-5460-4c0f-8314-6c8b0e80af76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:52.566668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:52.579331 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-eaa3a950-5460-4c0f-8314-6c8b0e80af76 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:52.580520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-eaa3a950-5460-4c0f-8314-6c8b0e80af76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:52.645085 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 547/1119] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:52.668204 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476ce4e-cf98-40b9-b62f-1f4e0a5cf541 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:52.717718 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:52.767072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476ce4e-cf98-40b9-b62f-1f4e0a5cf541 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:52.799769 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25234542-b06f-45aa-8c62-d4131396bc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:52.800627 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25234542-b06f-45aa-8c62-d4131396bc25 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:52.800911 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25234542-b06f-45aa-8c62-d4131396bc25 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:52.801186 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25234542-b06f-45aa-8c62-d4131396bc25 None admin] PATH_INFO: `/v3/roles/2d85fe2aee9740f984e944e0d5c80ec5` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:52.802641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25234542-b06f-45aa-8c62-d4131396bc25 None admin] RBAC: Authorizing `identity:get_role(role_id=2d85fe2aee9740f984e944e0d5c80ec5)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:52.804039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25234542-b06f-45aa-8c62-d4131396bc25 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:52.805373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 573/1120] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:28:52 2022] GET /identity/v3/roles/2d85fe2aee9740f984e944e0d5c80ec5 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:52.810997 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3a950-5460-4c0f-8314-6c8b0e80af76 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:52.906351 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3a950-5460-4c0f-8314-6c8b0e80af76 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:52.935487 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:52.940927 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b8906-c5c7-44eb-a985-c714cfc75651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:52.941781 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b8906-c5c7-44eb-a985-c714cfc75651 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:52.942070 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b8906-c5c7-44eb-a985-c714cfc75651 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:52.942350 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b8906-c5c7-44eb-a985-c714cfc75651 None admin] PATH_INFO: `/v3/users/599b03ca02db45d380c8cd81e20c4de8` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:52.943524 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b8906-c5c7-44eb-a985-c714cfc75651 None admin] RBAC: Authorizing `identity:get_user(user_id=599b03ca02db45d380c8cd81e20c4de8)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:52.944992 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b8906-c5c7-44eb-a985-c714cfc75651 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:52.946597 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 548/1121] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:28:52 2022] GET /identity/v3/users/599b03ca02db45d380c8cd81e20c4de8 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:52.952283 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25234542-b06f-45aa-8c62-d4131396bc25 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:53.047240 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25234542-b06f-45aa-8c62-d4131396bc25 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:53.063391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:53.079572 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce9a36-ca74-4ce6-899f-306ed9f5de45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:53.080407 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce9a36-ca74-4ce6-899f-306ed9f5de45 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:53.080715 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce9a36-ca74-4ce6-899f-306ed9f5de45 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:53.080989 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce9a36-ca74-4ce6-899f-306ed9f5de45 None admin] PATH_INFO: `/v3/projects/9557354c80ed4631b5c10f6c057f472a` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:53.082211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce9a36-ca74-4ce6-899f-306ed9f5de45 None admin] RBAC: Authorizing `identity:get_project(project_id=9557354c80ed4631b5c10f6c057f472a)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:53.083643 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce9a36-ca74-4ce6-899f-306ed9f5de45 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:53.085308 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 574/1122] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:28:52 2022] GET /identity/v3/projects/9557354c80ed4631b5c10f6c057f472a => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:53.091901 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b8906-c5c7-44eb-a985-c714cfc75651 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:53.191613 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b8906-c5c7-44eb-a985-c714cfc75651 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:53.226373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f1281-6f65-4a12-a272-6ce50ac73604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:53.227259 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f1281-6f65-4a12-a272-6ce50ac73604 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:53.227547 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f1281-6f65-4a12-a272-6ce50ac73604 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:53.227822 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f1281-6f65-4a12-a272-6ce50ac73604 None admin] PATH_INFO: `/v3/projects/9557354c80ed4631b5c10f6c057f472a/users/599b03ca02db45d380c8cd81e20c4de8/roles/2d85fe2aee9740f984e944e0d5c80ec5` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:53.230124 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f1281-6f65-4a12-a272-6ce50ac73604 None admin] RBAC: Authorizing `identity:create_grant(project_id=9557354c80ed4631b5c10f6c057f472a, user_id=599b03ca02db45d380c8cd81e20c4de8, role_id=2d85fe2aee9740f984e944e0d5c80ec5)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:53.231561 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f1281-6f65-4a12-a272-6ce50ac73604 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:53.244183 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 549/1123] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 30 10:28:53 2022] PUT /identity/v3/projects/9557354c80ed4631b5c10f6c057f472a/users/599b03ca02db45d380c8cd81e20c4de8/roles/2d85fe2aee9740f984e944e0d5c80ec5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:28:55.227567 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381151c-c770-4611-adf3-9ed9ae4a3931 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:55.228121 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381151c-c770-4611-adf3-9ed9ae4a3931 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:55.228121 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381151c-c770-4611-adf3-9ed9ae4a3931 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:55.229528 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 575/1124] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:55.234662 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4d16f-c90e-43fa-8c78-c654feb27d31 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:55.235049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4d16f-c90e-43fa-8c78-c654feb27d31 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:55.235232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4d16f-c90e-43fa-8c78-c654feb27d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:55.251982 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c2e4d16f-c90e-43fa-8c78-c654feb27d31 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:55.253355 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c2e4d16f-c90e-43fa-8c78-c654feb27d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:55.306919 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:55.319603 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 550/1125] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:55.343737 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381151c-c770-4611-adf3-9ed9ae4a3931 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:55.440958 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381151c-c770-4611-adf3-9ed9ae4a3931 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:55.472514 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ba032-96a3-42e9-9b6e-eb210797689e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:55.473354 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ba032-96a3-42e9-9b6e-eb210797689e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:55.473632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ba032-96a3-42e9-9b6e-eb210797689e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:55.473902 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ba032-96a3-42e9-9b6e-eb210797689e None admin] PATH_INFO: `/v3/roles/2d85fe2aee9740f984e944e0d5c80ec5` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:55.475595 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ba032-96a3-42e9-9b6e-eb210797689e None admin] RBAC: Authorizing `identity:get_role(role_id=2d85fe2aee9740f984e944e0d5c80ec5)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:55.476976 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ba032-96a3-42e9-9b6e-eb210797689e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:55.478378 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 576/1126] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:28:55 2022] GET /identity/v3/roles/2d85fe2aee9740f984e944e0d5c80ec5 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:55.484306 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4d16f-c90e-43fa-8c78-c654feb27d31 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:55.580196 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4d16f-c90e-43fa-8c78-c654feb27d31 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:55.613452 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59654f5-94b4-42ce-9afd-36eae55052d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:55.614300 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59654f5-94b4-42ce-9afd-36eae55052d0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:55.614584 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59654f5-94b4-42ce-9afd-36eae55052d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:55.614861 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59654f5-94b4-42ce-9afd-36eae55052d0 None admin] PATH_INFO: `/v3/users/599b03ca02db45d380c8cd81e20c4de8` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:55.616034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59654f5-94b4-42ce-9afd-36eae55052d0 None admin] RBAC: Authorizing `identity:get_user(user_id=599b03ca02db45d380c8cd81e20c4de8)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:55.617493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59654f5-94b4-42ce-9afd-36eae55052d0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:55.619093 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 551/1127] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:28:55 2022] GET /identity/v3/users/599b03ca02db45d380c8cd81e20c4de8 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:55.625237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ba032-96a3-42e9-9b6e-eb210797689e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:55.677996 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:55.720988 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ba032-96a3-42e9-9b6e-eb210797689e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:55.753964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c5c14-a756-4146-8dcb-2c1ebdee4d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:55.754530 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c5c14-a756-4146-8dcb-2c1ebdee4d57 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:55.754811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c5c14-a756-4146-8dcb-2c1ebdee4d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:55.755085 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c5c14-a756-4146-8dcb-2c1ebdee4d57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:55.818502 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c5c14-a756-4146-8dcb-2c1ebdee4d57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:55.819920 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c5c14-a756-4146-8dcb-2c1ebdee4d57 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:55.871416 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:55.914110 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 577/1128] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:28:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:28:55.920387 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59654f5-94b4-42ce-9afd-36eae55052d0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:55.977093 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:56.018471 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59654f5-94b4-42ce-9afd-36eae55052d0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:56.051701 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af740b-6437-4e9e-a112-837568ca1b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:56.052560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af740b-6437-4e9e-a112-837568ca1b16 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:56.052849 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af740b-6437-4e9e-a112-837568ca1b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:56.053130 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af740b-6437-4e9e-a112-837568ca1b16 None admin] PATH_INFO: `/v3/projects/9557354c80ed4631b5c10f6c057f472a` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:56.054285 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af740b-6437-4e9e-a112-837568ca1b16 None admin] RBAC: Authorizing `identity:get_project(project_id=9557354c80ed4631b5c10f6c057f472a)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:56.055720 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af740b-6437-4e9e-a112-837568ca1b16 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:56.057452 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 552/1129] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:28:55 2022] GET /identity/v3/projects/9557354c80ed4631b5c10f6c057f472a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:56.063337 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c5c14-a756-4146-8dcb-2c1ebdee4d57 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:56.158278 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c5c14-a756-4146-8dcb-2c1ebdee4d57 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:56.190651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba54ee-0905-4e43-b056-7c86e769bce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:56.191283 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba54ee-0905-4e43-b056-7c86e769bce4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:56.191567 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba54ee-0905-4e43-b056-7c86e769bce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:56.191845 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba54ee-0905-4e43-b056-7c86e769bce4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:56.192683 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba54ee-0905-4e43-b056-7c86e769bce4 None admin] RBAC: Adding query filter params (role.id=2d85fe2aee9740f984e944e0d5c80ec5, scope.project.id=9557354c80ed4631b5c10f6c057f472a, user.id=599b03ca02db45d380c8cd81e20c4de8) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:56.192998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba54ee-0905-4e43-b056-7c86e769bce4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:56.194428 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba54ee-0905-4e43-b056-7c86e769bce4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:56.200552 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 578/1130] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:28:56 2022] GET /identity/v3/role_assignments?user.id=599b03ca02db45d380c8cd81e20c4de8&scope.project.id=9557354c80ed4631b5c10f6c057f472a&role.id=2d85fe2aee9740f984e944e0d5c80ec5 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:58.262167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd47a6-6b20-4a62-82f4-d6b4a173ad6d None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:58.262586 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd47a6-6b20-4a62-82f4-d6b4a173ad6d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:58.262727 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd47a6-6b20-4a62-82f4-d6b4a173ad6d None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:58.264101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 553/1131] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:28:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:28:58.269238 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5c37e-4321-4008-8182-7868bbe8febb None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:58.269618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5c37e-4321-4008-8182-7868bbe8febb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:58.269798 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5c37e-4321-4008-8182-7868bbe8febb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:58.286229 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b2b5c37e-4321-4008-8182-7868bbe8febb None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:58.287411 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b2b5c37e-4321-4008-8182-7868bbe8febb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:58.300123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:58.352715 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 579/1132] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:28:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:28:58.375881 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd47a6-6b20-4a62-82f4-d6b4a173ad6d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:58.473398 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd47a6-6b20-4a62-82f4-d6b4a173ad6d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:58.499250 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:58.508160 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185d0b3-5b88-4d6c-9ec7-066b27e4ed4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:58.509172 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185d0b3-5b88-4d6c-9ec7-066b27e4ed4f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:58.509588 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185d0b3-5b88-4d6c-9ec7-066b27e4ed4f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:58.509855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185d0b3-5b88-4d6c-9ec7-066b27e4ed4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:58.511040 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185d0b3-5b88-4d6c-9ec7-066b27e4ed4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:58.512479 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185d0b3-5b88-4d6c-9ec7-066b27e4ed4f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:58.514125 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 554/1133] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:28:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:58.519834 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5c37e-4321-4008-8182-7868bbe8febb None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:58.616323 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5c37e-4321-4008-8182-7868bbe8febb None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:58.649244 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68a445-e0f9-42a4-95e1-01de76e7a1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:58.649886 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68a445-e0f9-42a4-95e1-01de76e7a1f4 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:58.650168 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68a445-e0f9-42a4-95e1-01de76e7a1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:58.650444 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68a445-e0f9-42a4-95e1-01de76e7a1f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:58.651176 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68a445-e0f9-42a4-95e1-01de76e7a1f4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:58.652625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68a445-e0f9-42a4-95e1-01de76e7a1f4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:58.671877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:58.683563 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 580/1134] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 30 10:28:58 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:29:00.718780 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507046fb-f8b2-4ab7-a205-ae74f43d3622 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:00.719321 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507046fb-f8b2-4ab7-a205-ae74f43d3622 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:00.719321 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507046fb-f8b2-4ab7-a205-ae74f43d3622 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:00.720743 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 555/1135] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:29:00.726246 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc5481-763a-409f-9680-c4d283da3ad7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:00.726660 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc5481-763a-409f-9680-c4d283da3ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:00.726803 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc5481-763a-409f-9680-c4d283da3ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:00.742943 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-17cc5481-763a-409f-9680-c4d283da3ad7 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:00.744119 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-17cc5481-763a-409f-9680-c4d283da3ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:00.806927 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 581/1136] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:29:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:29:00.831428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507046fb-f8b2-4ab7-a205-ae74f43d3622 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:00.930149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507046fb-f8b2-4ab7-a205-ae74f43d3622 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:00.963051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10769499-c539-40de-9c3f-a39e3b8dcbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:00.964395 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10769499-c539-40de-9c3f-a39e3b8dcbcc None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:00.964701 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10769499-c539-40de-9c3f-a39e3b8dcbcc None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:00.964975 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10769499-c539-40de-9c3f-a39e3b8dcbcc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:00.966121 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10769499-c539-40de-9c3f-a39e3b8dcbcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:00.967549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10769499-c539-40de-9c3f-a39e3b8dcbcc None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:00.969235 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 556/1137] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:29:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:00.974985 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc5481-763a-409f-9680-c4d283da3ad7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:01.069640 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc5481-763a-409f-9680-c4d283da3ad7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:01.096940 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:01.103013 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bb8a8-dbf4-46aa-88c1-2f4d768c580a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:01.103661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bb8a8-dbf4-46aa-88c1-2f4d768c580a None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:01.103965 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bb8a8-dbf4-46aa-88c1-2f4d768c580a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:01.104237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bb8a8-dbf4-46aa-88c1-2f4d768c580a None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:01.104956 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6bb8a8-dbf4-46aa-88c1-2f4d768c580a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:01.106360 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6bb8a8-dbf4-46aa-88c1-2f4d768c580a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:01.125328 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 582/1138] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 30 10:29:00 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:29:03.176612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43284648-f7ae-484b-bad6-41912e7d01a2 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:03.177160 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43284648-f7ae-484b-bad6-41912e7d01a2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:03.177160 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43284648-f7ae-484b-bad6-41912e7d01a2 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:03.178562 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 557/1139] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:29:03.184041 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57c2de-e515-4d4b-9b95-638b338d04a3 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:03.184407 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57c2de-e515-4d4b-9b95-638b338d04a3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:03.184636 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57c2de-e515-4d4b-9b95-638b338d04a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:03.202255 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-be57c2de-e515-4d4b-9b95-638b338d04a3 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:03.203431 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-be57c2de-e515-4d4b-9b95-638b338d04a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:03.271119 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 583/1140] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:29:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:29:03.296002 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43284648-f7ae-484b-bad6-41912e7d01a2 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:03.357071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:03.395132 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43284648-f7ae-484b-bad6-41912e7d01a2 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:03.428423 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee095cef-7148-4180-b79b-f78ee0b75497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:03.429161 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee095cef-7148-4180-b79b-f78ee0b75497 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:03.429446 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee095cef-7148-4180-b79b-f78ee0b75497 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:03.429725 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee095cef-7148-4180-b79b-f78ee0b75497 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:03.439616 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee095cef-7148-4180-b79b-f78ee0b75497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:29:03.447147 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-ee095cef-7148-4180-b79b-f78ee0b75497 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:29:03.447147 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:29:03.447147 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:29:03.447147 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:29:03.447147 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:29:03.447147 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:29:03.447147 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:29:03.447147 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:29:03.447147 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:29:03.447147 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:29:03.447147 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:29:03.447147 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:29:03.447147 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:29:03.447147 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:29:03.447147 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:29:03.447147 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:29:03.448320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:29:03.448320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:29:03.448320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:29:03.448320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:29:03.448320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:29:03.448320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:29:03.448320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:29:03.448320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:29:03.448320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:29:03.448320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:29:03.448320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:29:03.448320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:29:03.448320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:29:03.448320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:29:03.448320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:29:03.448320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:29:03.449605 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:29:03.449605 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:29:03.449605 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:29:03.449605 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:29:03.449605 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:29:03.449605 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:29:03.449605 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:29:03.449605 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:29:03.449605 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:29:03.449605 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:29:03.449605 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:29:03.449605 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:29:03.449605 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 558/1141] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:29:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:29:03.454223 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57c2de-e515-4d4b-9b95-638b338d04a3 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:03.549286 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57c2de-e515-4d4b-9b95-638b338d04a3 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:03.564931 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:03.584236 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f693f-5051-49f6-a5bc-9260204e11ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:03.584914 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f693f-5051-49f6-a5bc-9260204e11ed None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:03.585192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f693f-5051-49f6-a5bc-9260204e11ed None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:03.585460 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f693f-5051-49f6-a5bc-9260204e11ed None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:03.586290 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f693f-5051-49f6-a5bc-9260204e11ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:29:03.586595 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f693f-5051-49f6-a5bc-9260204e11ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:03.587940 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f693f-5051-49f6-a5bc-9260204e11ed None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:03.596167 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 584/1142] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:29:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:03.602154 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee095cef-7148-4180-b79b-f78ee0b75497 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:03.698559 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee095cef-7148-4180-b79b-f78ee0b75497 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:03.719854 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:03.731589 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d9236-1600-4d6b-9a4c-fc7a3ebcb20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:03.732422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d9236-1600-4d6b-9a4c-fc7a3ebcb20b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:03.732730 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d9236-1600-4d6b-9a4c-fc7a3ebcb20b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:03.733004 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d9236-1600-4d6b-9a4c-fc7a3ebcb20b None admin] PATH_INFO: `/v3/users/1b77fcd7025241dab5294cf5ea1a79fc` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:03.745696 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d9236-1600-4d6b-9a4c-fc7a3ebcb20b None admin] RBAC: Authorizing `identity:get_user(user_id=1b77fcd7025241dab5294cf5ea1a79fc)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:03.747124 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d9236-1600-4d6b-9a4c-fc7a3ebcb20b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:03.748765 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 559/1143] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:29:03 2022] GET /identity/v3/users/1b77fcd7025241dab5294cf5ea1a79fc => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:03.754303 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f693f-5051-49f6-a5bc-9260204e11ed None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:03.849113 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f693f-5051-49f6-a5bc-9260204e11ed None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:03.884714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106aad16-17e1-4de6-bd95-ed519fbf4f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:03.885870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106aad16-17e1-4de6-bd95-ed519fbf4f2b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:03.886146 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106aad16-17e1-4de6-bd95-ed519fbf4f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:03.886416 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106aad16-17e1-4de6-bd95-ed519fbf4f2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:03.929335 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:03.951293 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106aad16-17e1-4de6-bd95-ed519fbf4f2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:03.952700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106aad16-17e1-4de6-bd95-ed519fbf4f2b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:04.048350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 585/1144] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:29:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:29:04.054339 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d9236-1600-4d6b-9a4c-fc7a3ebcb20b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:04.151061 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d9236-1600-4d6b-9a4c-fc7a3ebcb20b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:04.183537 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b47f9-c030-48bc-b8fa-ea379b65336e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:04.184371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b47f9-c030-48bc-b8fa-ea379b65336e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:04.184684 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b47f9-c030-48bc-b8fa-ea379b65336e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:04.184958 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b47f9-c030-48bc-b8fa-ea379b65336e None admin] PATH_INFO: `/v3/projects/2979eb79b85841869b7f6b9cc0d9b17f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:04.186097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b47f9-c030-48bc-b8fa-ea379b65336e None admin] RBAC: Authorizing `identity:get_project(project_id=2979eb79b85841869b7f6b9cc0d9b17f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:04.187516 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b47f9-c030-48bc-b8fa-ea379b65336e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:04.189182 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 560/1145] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:29:04 2022] GET /identity/v3/projects/2979eb79b85841869b7f6b9cc0d9b17f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:04.195032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106aad16-17e1-4de6-bd95-ed519fbf4f2b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:04.270703 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:04.291636 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106aad16-17e1-4de6-bd95-ed519fbf4f2b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:04.324756 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa223df-9da0-446c-9a22-44fb3f8e466b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:04.325392 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa223df-9da0-446c-9a22-44fb3f8e466b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:04.325678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa223df-9da0-446c-9a22-44fb3f8e466b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:04.325958 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa223df-9da0-446c-9a22-44fb3f8e466b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:04.326767 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa223df-9da0-446c-9a22-44fb3f8e466b None admin] RBAC: Adding query filter params (role.id=ab64ea6d0475430195af26a049485569, scope.project.id=2979eb79b85841869b7f6b9cc0d9b17f, user.id=1b77fcd7025241dab5294cf5ea1a79fc) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:29:04.327081 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa223df-9da0-446c-9a22-44fb3f8e466b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:04.328498 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa223df-9da0-446c-9a22-44fb3f8e466b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:04.333770 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 586/1146] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:29:04 2022] GET /identity/v3/role_assignments?user.id=1b77fcd7025241dab5294cf5ea1a79fc&scope.project.id=2979eb79b85841869b7f6b9cc0d9b17f&role.id=ab64ea6d0475430195af26a049485569 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:06.315619 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0931f6a-0efa-45c3-8f42-5e44fd060f67 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:06.316118 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0931f6a-0efa-45c3-8f42-5e44fd060f67 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:06.316211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0931f6a-0efa-45c3-8f42-5e44fd060f67 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:06.317605 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 561/1147] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:29:06.323400 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffe53f-2b08-43af-8b27-7a89bdd4d6ad None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:06.323813 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffe53f-2b08-43af-8b27-7a89bdd4d6ad None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:06.323956 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffe53f-2b08-43af-8b27-7a89bdd4d6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:06.340211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-5cffe53f-2b08-43af-8b27-7a89bdd4d6ad None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:06.341423 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-5cffe53f-2b08-43af-8b27-7a89bdd4d6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:06.406555 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 587/1148] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:29:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:29:06.428960 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0931f6a-0efa-45c3-8f42-5e44fd060f67 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:06.481077 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:06.549406 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0931f6a-0efa-45c3-8f42-5e44fd060f67 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:06.585602 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a140c-a524-48cc-9adc-1a6260dc9eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:06.586381 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a140c-a524-48cc-9adc-1a6260dc9eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:06.586667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a140c-a524-48cc-9adc-1a6260dc9eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:06.586946 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a140c-a524-48cc-9adc-1a6260dc9eb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:06.596861 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a140c-a524-48cc-9adc-1a6260dc9eb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:29:06.604560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-d63a140c-a524-48cc-9adc-1a6260dc9eb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:29:06.604560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:29:06.604560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:29:06.604560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:29:06.604560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:29:06.604560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:29:06.604560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:29:06.604560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:29:06.604560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:29:06.604560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:29:06.604560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:29:06.604560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:29:06.604560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:29:06.604560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:29:06.604560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:29:06.604560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:29:06.605637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:29:06.605637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:29:06.605637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:29:06.605637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:29:06.605637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:29:06.605637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:29:06.605637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:29:06.605637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:29:06.605637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:29:06.605637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:29:06.605637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:29:06.605637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:29:06.605637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:29:06.605637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:29:06.605637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:29:06.605637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:29:06.606691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:29:06.606691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:29:06.606691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:29:06.606691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:29:06.606691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:29:06.606691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:29:06.606691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:29:06.606691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:29:06.606691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:29:06.606691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:29:06.606691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:29:06.606691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:29:06.606691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 562/1149] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:29:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:29:06.612016 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffe53f-2b08-43af-8b27-7a89bdd4d6ad None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:06.678729 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:06.707688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffe53f-2b08-43af-8b27-7a89bdd4d6ad None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:06.740382 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a48b3e-a5e4-4fdf-ad4c-172501f816ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:06.741060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a48b3e-a5e4-4fdf-ad4c-172501f816ba None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:06.741347 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a48b3e-a5e4-4fdf-ad4c-172501f816ba None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:06.741627 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a48b3e-a5e4-4fdf-ad4c-172501f816ba None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:06.742355 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a48b3e-a5e4-4fdf-ad4c-172501f816ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:29:06.742664 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a48b3e-a5e4-4fdf-ad4c-172501f816ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:06.744022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a48b3e-a5e4-4fdf-ad4c-172501f816ba None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:06.752375 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 588/1150] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:29:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:06.758065 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a140c-a524-48cc-9adc-1a6260dc9eb9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:06.856037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a140c-a524-48cc-9adc-1a6260dc9eb9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:06.865053 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:06.889621 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd7ad9-ce8e-4bec-ab71-637f4ff34fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:06.890472 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd7ad9-ce8e-4bec-ab71-637f4ff34fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:06.890754 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd7ad9-ce8e-4bec-ab71-637f4ff34fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:06.891027 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd7ad9-ce8e-4bec-ab71-637f4ff34fc7 None admin] PATH_INFO: `/v3/users/1b77fcd7025241dab5294cf5ea1a79fc` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:06.892182 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd7ad9-ce8e-4bec-ab71-637f4ff34fc7 None admin] RBAC: Authorizing `identity:get_user(user_id=1b77fcd7025241dab5294cf5ea1a79fc)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:06.893662 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd7ad9-ce8e-4bec-ab71-637f4ff34fc7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:06.895293 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 563/1151] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:29:06 2022] GET /identity/v3/users/1b77fcd7025241dab5294cf5ea1a79fc => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:06.901275 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a48b3e-a5e4-4fdf-ad4c-172501f816ba None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:06.997398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a48b3e-a5e4-4fdf-ad4c-172501f816ba None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:07.029971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01745211-5b7d-4800-bf7f-6b0ab8db74f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:07.030815 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01745211-5b7d-4800-bf7f-6b0ab8db74f9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:07.031094 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01745211-5b7d-4800-bf7f-6b0ab8db74f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:07.031366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01745211-5b7d-4800-bf7f-6b0ab8db74f9 None admin] PATH_INFO: `/v3/projects/2979eb79b85841869b7f6b9cc0d9b17f` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:07.032538 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01745211-5b7d-4800-bf7f-6b0ab8db74f9 None admin] RBAC: Authorizing `identity:get_project(project_id=2979eb79b85841869b7f6b9cc0d9b17f)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:07.033956 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01745211-5b7d-4800-bf7f-6b0ab8db74f9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:07.035648 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 589/1152] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:29:06 2022] GET /identity/v3/projects/2979eb79b85841869b7f6b9cc0d9b17f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:07.041933 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd7ad9-ce8e-4bec-ab71-637f4ff34fc7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:07.137340 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd7ad9-ce8e-4bec-ab71-637f4ff34fc7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:07.169611 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd82d6-1507-4d22-bf8d-5c5f7928041f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:07.170464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd82d6-1507-4d22-bf8d-5c5f7928041f None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:07.170745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd82d6-1507-4d22-bf8d-5c5f7928041f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:07.171020 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd82d6-1507-4d22-bf8d-5c5f7928041f None admin] PATH_INFO: `/v3/projects/2979eb79b85841869b7f6b9cc0d9b17f/users/1b77fcd7025241dab5294cf5ea1a79fc/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:07.172948 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd82d6-1507-4d22-bf8d-5c5f7928041f None admin] RBAC: Authorizing `identity:create_grant(project_id=2979eb79b85841869b7f6b9cc0d9b17f, user_id=1b77fcd7025241dab5294cf5ea1a79fc, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:07.174353 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd82d6-1507-4d22-bf8d-5c5f7928041f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:07.186698 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 564/1153] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 30 10:29:07 2022] PUT /identity/v3/projects/2979eb79b85841869b7f6b9cc0d9b17f/users/1b77fcd7025241dab5294cf5ea1a79fc/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:09.144802 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e610ce-2680-4571-a739-c0dac7eb4cce None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:09.145352 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e610ce-2680-4571-a739-c0dac7eb4cce None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:09.145352 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e610ce-2680-4571-a739-c0dac7eb4cce None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:09.146762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 590/1154] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:29:09.152477 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa975c17-4803-449e-a92f-f453d2c7c3a2 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:09.152901 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa975c17-4803-449e-a92f-f453d2c7c3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:09.153071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa975c17-4803-449e-a92f-f453d2c7c3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:09.169197 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-fa975c17-4803-449e-a92f-f453d2c7c3a2 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:09.170362 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fa975c17-4803-449e-a92f-f453d2c7c3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:09.197934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:09.234897 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 565/1155] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:29:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:29:09.258046 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e610ce-2680-4571-a739-c0dac7eb4cce None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:09.261479 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:09.358619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e610ce-2680-4571-a739-c0dac7eb4cce None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:09.392017 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3436699-2558-48a4-b643-befc3322fbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:09.392827 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3436699-2558-48a4-b643-befc3322fbae None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:09.393114 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3436699-2558-48a4-b643-befc3322fbae None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:09.393392 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3436699-2558-48a4-b643-befc3322fbae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:09.403340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3436699-2558-48a4-b643-befc3322fbae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:29:09.410820 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-e3436699-2558-48a4-b643-befc3322fbae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:29:09.410820 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:29:09.410820 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:29:09.410820 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:29:09.410820 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:29:09.410820 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:29:09.410820 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:29:09.410820 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:29:09.410820 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:29:09.410820 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:29:09.410820 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:29:09.410820 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:29:09.410820 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:29:09.410820 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:29:09.410820 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:29:09.410820 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:29:09.411898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:29:09.411898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:29:09.411898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:29:09.411898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:29:09.411898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:29:09.411898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:29:09.411898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:29:09.411898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:29:09.411898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:29:09.411898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:29:09.411898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:29:09.411898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:29:09.411898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:29:09.411898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:29:09.411898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:29:09.411898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:29:09.412994 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:29:09.412994 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:29:09.412994 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:29:09.412994 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:29:09.412994 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:29:09.412994 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:29:09.412994 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:29:09.412994 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:29:09.412994 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:29:09.412994 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:29:09.412994 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:29:09.412994 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:29:09.412994 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 591/1156] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:29:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:29:09.417848 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa975c17-4803-449e-a92f-f453d2c7c3a2 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:09.512740 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa975c17-4803-449e-a92f-f453d2c7c3a2 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:09.544136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e0905-d56e-4cc2-bfe8-e2b353a9454b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:09.544807 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e0905-d56e-4cc2-bfe8-e2b353a9454b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:09.545090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e0905-d56e-4cc2-bfe8-e2b353a9454b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:09.545358 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e0905-d56e-4cc2-bfe8-e2b353a9454b None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:09.546074 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e0905-d56e-4cc2-bfe8-e2b353a9454b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:29:09.546374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e0905-d56e-4cc2-bfe8-e2b353a9454b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:09.547725 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e0905-d56e-4cc2-bfe8-e2b353a9454b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:09.555395 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 566/1157] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:29:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:09.561401 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3436699-2558-48a4-b643-befc3322fbae None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:09.620205 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:09.657610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3436699-2558-48a4-b643-befc3322fbae None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:09.690810 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e53fa1-2051-4b18-8b82-98d9c7b84575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:09.691656 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e53fa1-2051-4b18-8b82-98d9c7b84575 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:09.691937 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e53fa1-2051-4b18-8b82-98d9c7b84575 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:09.692211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e53fa1-2051-4b18-8b82-98d9c7b84575 None admin] PATH_INFO: `/v3/users/1b77fcd7025241dab5294cf5ea1a79fc` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:09.693402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e53fa1-2051-4b18-8b82-98d9c7b84575 None admin] RBAC: Authorizing `identity:get_user(user_id=1b77fcd7025241dab5294cf5ea1a79fc)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:09.694814 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e53fa1-2051-4b18-8b82-98d9c7b84575 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:09.696409 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 592/1158] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:29:09 2022] GET /identity/v3/users/1b77fcd7025241dab5294cf5ea1a79fc => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:09.702176 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e0905-d56e-4cc2-bfe8-e2b353a9454b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:09.730356 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:09.798911 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e0905-d56e-4cc2-bfe8-e2b353a9454b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:09.830934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c2007-3a02-4409-9427-8570e64b11fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:09.831558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c2007-3a02-4409-9427-8570e64b11fa None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:09.831843 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c2007-3a02-4409-9427-8570e64b11fa None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:09.832120 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c2007-3a02-4409-9427-8570e64b11fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:09.896087 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c2007-3a02-4409-9427-8570e64b11fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:09.897551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c2007-3a02-4409-9427-8570e64b11fa None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:09.923390 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:09.992795 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 567/1159] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:29:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:29:09.999400 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e53fa1-2051-4b18-8b82-98d9c7b84575 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:10.096705 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e53fa1-2051-4b18-8b82-98d9c7b84575 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:10.124727 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:10.130753 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22347d-c059-44df-a730-28a689c61297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:10.131607 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22347d-c059-44df-a730-28a689c61297 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:10.131893 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22347d-c059-44df-a730-28a689c61297 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:10.132170 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22347d-c059-44df-a730-28a689c61297 None admin] PATH_INFO: `/v3/projects/2979eb79b85841869b7f6b9cc0d9b17f` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:10.133360 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a22347d-c059-44df-a730-28a689c61297 None admin] RBAC: Authorizing `identity:get_project(project_id=2979eb79b85841869b7f6b9cc0d9b17f)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:10.134781 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a22347d-c059-44df-a730-28a689c61297 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:10.136459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 593/1160] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:29:09 2022] GET /identity/v3/projects/2979eb79b85841869b7f6b9cc0d9b17f => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:10.142451 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c2007-3a02-4409-9427-8570e64b11fa None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:10.241364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c2007-3a02-4409-9427-8570e64b11fa None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:10.272279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:10.280871 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c9c33-1855-4ba9-8f72-5d95159e1731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:10.281521 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c9c33-1855-4ba9-8f72-5d95159e1731 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:10.281805 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c9c33-1855-4ba9-8f72-5d95159e1731 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:10.282083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c9c33-1855-4ba9-8f72-5d95159e1731 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:10.282901 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c9c33-1855-4ba9-8f72-5d95159e1731 None admin] RBAC: Adding query filter params (role.id=ab64ea6d0475430195af26a049485569, scope.project.id=2979eb79b85841869b7f6b9cc0d9b17f, user.id=1b77fcd7025241dab5294cf5ea1a79fc) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:29:10.283217 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c9c33-1855-4ba9-8f72-5d95159e1731 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:10.284665 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c9c33-1855-4ba9-8f72-5d95159e1731 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:10.290310 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 568/1161] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:29:10 2022] GET /identity/v3/role_assignments?user.id=1b77fcd7025241dab5294cf5ea1a79fc&scope.project.id=2979eb79b85841869b7f6b9cc0d9b17f&role.id=ab64ea6d0475430195af26a049485569 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:12.311527 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d103d3-bb85-46b7-af89-ca5f2cb0c3e1 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:12.311996 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d103d3-bb85-46b7-af89-ca5f2cb0c3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:12.312085 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d103d3-bb85-46b7-af89-ca5f2cb0c3e1 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:12.313595 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 594/1162] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:29:12.318723 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfa48d-344b-47c3-bb86-a5a37b51f7e4 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:12.319128 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfa48d-344b-47c3-bb86-a5a37b51f7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:12.319289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfa48d-344b-47c3-bb86-a5a37b51f7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:12.335606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-23cfa48d-344b-47c3-bb86-a5a37b51f7e4 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:12.336831 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-23cfa48d-344b-47c3-bb86-a5a37b51f7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:12.401763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 569/1163] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:29:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:29:12.424794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d103d3-bb85-46b7-af89-ca5f2cb0c3e1 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:12.522457 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d103d3-bb85-46b7-af89-ca5f2cb0c3e1 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:12.555212 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb3ffa-9998-4033-a33d-b47591f3e67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:12.555832 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb3ffa-9998-4033-a33d-b47591f3e67d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:12.556115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb3ffa-9998-4033-a33d-b47591f3e67d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:12.556391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb3ffa-9998-4033-a33d-b47591f3e67d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:12.619605 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:12.623448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb3ffa-9998-4033-a33d-b47591f3e67d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:12.624927 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb3ffa-9998-4033-a33d-b47591f3e67d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:12.719476 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 595/1164] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:29:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 10:29:12.725687 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfa48d-344b-47c3-bb86-a5a37b51f7e4 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:12.818783 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfa48d-344b-47c3-bb86-a5a37b51f7e4 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:12.840856 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:12.852478 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c194285-4f5a-4111-ace4-c2e44d7dad0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:12.853281 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c194285-4f5a-4111-ace4-c2e44d7dad0b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:12.853588 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c194285-4f5a-4111-ace4-c2e44d7dad0b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:12.853856 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c194285-4f5a-4111-ace4-c2e44d7dad0b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:12.860267 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c194285-4f5a-4111-ace4-c2e44d7dad0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:12.861730 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c194285-4f5a-4111-ace4-c2e44d7dad0b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:12.875289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-5c194285-4f5a-4111-ace4-c2e44d7dad0b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 30 10:29:12.875289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:29:12.875289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 30 10:29:12.875289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 30 10:29:12.875289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:29:12.875289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:29:12.875289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:29:12.875289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:29:12.875289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 30 10:29:12.875289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:29:12.875289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:29:12.875289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:29:12.875289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:29:12.875289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:29:12.875289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:29:12.875289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:29:12.875289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:29:12.881090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:29:12.881090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:29:12.881090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:29:12.881090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:29:12.881090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:29:12.881090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:29:12.881090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:29:12.881090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:29:12.881090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:29:12.881090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:29:12.881090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:29:12.881090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:29:12.881090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:29:12.881090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:29:12.881090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:29:12.881090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:29:12.882187 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:29:12.882187 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:29:12.882187 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:29:12.882187 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:29:12.882187 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:29:12.882187 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:29:12.882187 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:29:12.882187 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:29:12.882187 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:29:12.882187 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:29:12.882187 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 30 10:29:12.882187 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:29:12.882187 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 30 10:29:12.882187 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:29:12.882187 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 570/1165] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Jun 30 10:29:12 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:29:12.883172 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb3ffa-9998-4033-a33d-b47591f3e67d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:12.976102 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:12.979734 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb3ffa-9998-4033-a33d-b47591f3e67d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:13.013115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd508cd-a9c9-4aa9-ac0f-c466b25f24c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:13.013767 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd508cd-a9c9-4aa9-ac0f-c466b25f24c0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:13.014055 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd508cd-a9c9-4aa9-ac0f-c466b25f24c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:13.014333 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd508cd-a9c9-4aa9-ac0f-c466b25f24c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:13.015040 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd508cd-a9c9-4aa9-ac0f-c466b25f24c0 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:29:13.015349 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd508cd-a9c9-4aa9-ac0f-c466b25f24c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:13.016733 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd508cd-a9c9-4aa9-ac0f-c466b25f24c0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:13.023696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 596/1166] 10.222.0.59 () {56 vars in 1115 bytes} [Thu Jun 30 10:29:12 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:15.007190 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a154e-8cd5-457f-9aa4-f714c329be98 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:15.007758 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a154e-8cd5-457f-9aa4-f714c329be98 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:15.007758 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a154e-8cd5-457f-9aa4-f714c329be98 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:15.009146 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 571/1167] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:29:15.014364 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9233aa-91df-4be9-b4ed-cbb40c8837c4 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:15.014754 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9233aa-91df-4be9-b4ed-cbb40c8837c4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:15.014925 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9233aa-91df-4be9-b4ed-cbb40c8837c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:15.031122 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-eb9233aa-91df-4be9-b4ed-cbb40c8837c4 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:15.032316 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-eb9233aa-91df-4be9-b4ed-cbb40c8837c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:15.095943 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 597/1168] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:29:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:29:15.118916 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a154e-8cd5-457f-9aa4-f714c329be98 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:15.217853 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a154e-8cd5-457f-9aa4-f714c329be98 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:15.251394 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b601d52-bf5a-4852-b325-ad9ce8701b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:15.252032 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b601d52-bf5a-4852-b325-ad9ce8701b9d None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:15.252317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b601d52-bf5a-4852-b325-ad9ce8701b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:15.252638 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b601d52-bf5a-4852-b325-ad9ce8701b9d None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:15.253382 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b601d52-bf5a-4852-b325-ad9ce8701b9d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:15.254760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b601d52-bf5a-4852-b325-ad9ce8701b9d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:15.272010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 572/1169] 10.222.0.59 () {60 vars in 1138 bytes} [Thu Jun 30 10:29:15 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:29:17.370817 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db3ca0-33bd-49ef-bb03-f09a886e429a None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:17.371445 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db3ca0-33bd-49ef-bb03-f09a886e429a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:17.371445 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db3ca0-33bd-49ef-bb03-f09a886e429a None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:17.372783 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 598/1170] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:29:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:29:17.377980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d975e-7cdb-4ca3-b802-d3a4750f1a7a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:17.378427 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d975e-7cdb-4ca3-b802-d3a4750f1a7a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:17.378530 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d975e-7cdb-4ca3-b802-d3a4750f1a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:17.394950 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-cd1d975e-7cdb-4ca3-b802-d3a4750f1a7a None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:17.396136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cd1d975e-7cdb-4ca3-b802-d3a4750f1a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:17.430124 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:17.462171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 573/1171] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:29:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:29:17.486924 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db3ca0-33bd-49ef-bb03-f09a886e429a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:17.575283 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:17.585129 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db3ca0-33bd-49ef-bb03-f09a886e429a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:17.618763 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671fed7-333c-41ce-8a91-778e0f860025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:17.619595 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671fed7-333c-41ce-8a91-778e0f860025 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:17.619879 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671fed7-333c-41ce-8a91-778e0f860025 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:17.620153 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671fed7-333c-41ce-8a91-778e0f860025 None admin] PATH_INFO: `/v3/domains/6666e4cf220a4460a3604b3a1601da24` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:17.630348 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671fed7-333c-41ce-8a91-778e0f860025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6666e4cf220a4460a3604b3a1601da24)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:17.631871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671fed7-333c-41ce-8a91-778e0f860025 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:17.633518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 599/1172] 10.222.0.59 () {56 vars in 1183 bytes} [Thu Jun 30 10:29:17 2022] GET /identity/v3/domains/6666e4cf220a4460a3604b3a1601da24 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:17.639298 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d975e-7cdb-4ca3-b802-d3a4750f1a7a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:17.736241 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d975e-7cdb-4ca3-b802-d3a4750f1a7a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:17.768078 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866f879-8ee6-40e7-92d9-967e2c797848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:17.768738 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866f879-8ee6-40e7-92d9-967e2c797848 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:17.769023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866f879-8ee6-40e7-92d9-967e2c797848 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:17.769300 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866f879-8ee6-40e7-92d9-967e2c797848 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:17.769988 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866f879-8ee6-40e7-92d9-967e2c797848 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:17.771410 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866f879-8ee6-40e7-92d9-967e2c797848 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:17.796230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 574/1173] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 30 10:29:17 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:29:19.844343 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce90033-1baf-45fa-b534-42588617391d None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:19.844933 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce90033-1baf-45fa-b534-42588617391d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:19.844933 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce90033-1baf-45fa-b534-42588617391d None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:19.846299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 600/1174] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:29:19.851610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea9f1f-179c-45cd-b734-39433278b97d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:19.851989 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea9f1f-179c-45cd-b734-39433278b97d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:19.852177 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea9f1f-179c-45cd-b734-39433278b97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:19.869199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d1ea9f1f-179c-45cd-b734-39433278b97d None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:19.870909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d1ea9f1f-179c-45cd-b734-39433278b97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:19.888196 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:19.936683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 575/1175] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:29:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:29:19.962074 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce90033-1baf-45fa-b534-42588617391d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:20.060897 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce90033-1baf-45fa-b534-42588617391d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:20.093425 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e37d2-cd1d-43bd-bb30-d98eebc6b190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:20.094266 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e37d2-cd1d-43bd-bb30-d98eebc6b190 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:20.094595 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e37d2-cd1d-43bd-bb30-d98eebc6b190 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:20.094817 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e37d2-cd1d-43bd-bb30-d98eebc6b190 None admin] PATH_INFO: `/v3/domains/6666e4cf220a4460a3604b3a1601da24` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:20.095983 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e37d2-cd1d-43bd-bb30-d98eebc6b190 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6666e4cf220a4460a3604b3a1601da24)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:20.097426 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e37d2-cd1d-43bd-bb30-d98eebc6b190 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:20.099170 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 601/1176] 10.222.0.59 () {56 vars in 1183 bytes} [Thu Jun 30 10:29:19 2022] GET /identity/v3/domains/6666e4cf220a4460a3604b3a1601da24 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:20.104920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea9f1f-179c-45cd-b734-39433278b97d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:20.203952 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea9f1f-179c-45cd-b734-39433278b97d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:20.236926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9769a-e627-4588-968d-7c7e2048d9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:20.237584 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9769a-e627-4588-968d-7c7e2048d9ad None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:20.237874 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9769a-e627-4588-968d-7c7e2048d9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:20.238164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9769a-e627-4588-968d-7c7e2048d9ad None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:20.238853 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9769a-e627-4588-968d-7c7e2048d9ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:20.240285 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9769a-e627-4588-968d-7c7e2048d9ad None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:20.261456 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 576/1177] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 30 10:29:20 2022] POST /identity/v3/users => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:29:22.282120 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c22727-9b7d-40cb-9bbc-452c7b1a7c11 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:22.282639 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c22727-9b7d-40cb-9bbc-452c7b1a7c11 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:22.282744 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c22727-9b7d-40cb-9bbc-452c7b1a7c11 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:22.284059 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 602/1178] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:29:22.289600 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bb751-3ac4-4ca1-b843-ee55278c1ece None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:22.290104 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bb751-3ac4-4ca1-b843-ee55278c1ece None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:22.290219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bb751-3ac4-4ca1-b843-ee55278c1ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:22.306539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9e7bb751-3ac4-4ca1-b843-ee55278c1ece None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:22.308240 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9e7bb751-3ac4-4ca1-b843-ee55278c1ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:22.310944 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:22.373482 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 577/1179] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:29:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:29:22.397795 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c22727-9b7d-40cb-9bbc-452c7b1a7c11 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:22.419174 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:22.495940 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c22727-9b7d-40cb-9bbc-452c7b1a7c11 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:22.527552 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b6419-932e-4419-adb9-2c209a4a10ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:22.528270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b6419-932e-4419-adb9-2c209a4a10ab None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:22.528576 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b6419-932e-4419-adb9-2c209a4a10ab None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:22.528851 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b6419-932e-4419-adb9-2c209a4a10ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:22.538554 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b6419-932e-4419-adb9-2c209a4a10ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:29:22.546503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-214b6419-932e-4419-adb9-2c209a4a10ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:29:22.546503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:29:22.546503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:29:22.546503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:29:22.546503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:29:22.546503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:29:22.546503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:29:22.546503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:29:22.546503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:29:22.546503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:29:22.546503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:29:22.546503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:29:22.546503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:29:22.546503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:29:22.546503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:29:22.546503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:29:22.547677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:29:22.547677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:29:22.547677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:29:22.547677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:29:22.547677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:29:22.547677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:29:22.547677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:29:22.547677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:29:22.547677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:29:22.547677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:29:22.547677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:29:22.547677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:29:22.547677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:29:22.547677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:29:22.547677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:29:22.547677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:29:22.548662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:29:22.548662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:29:22.548662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:29:22.548662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:29:22.548662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:29:22.548662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:29:22.548662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:29:22.548662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:29:22.548662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:29:22.548662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:29:22.548662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:29:22.548662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:29:22.548662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 603/1180] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:29:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:29:22.553467 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7bb751-3ac4-4ca1-b843-ee55278c1ece None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:22.648652 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7bb751-3ac4-4ca1-b843-ee55278c1ece None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:22.681511 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92b786-86c7-4921-9b0f-c4b3db63cdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:22.682158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92b786-86c7-4921-9b0f-c4b3db63cdc9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:22.683000 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92b786-86c7-4921-9b0f-c4b3db63cdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:22.683288 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92b786-86c7-4921-9b0f-c4b3db63cdc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:22.684022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92b786-86c7-4921-9b0f-c4b3db63cdc9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:29:22.684333 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92b786-86c7-4921-9b0f-c4b3db63cdc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:22.685730 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92b786-86c7-4921-9b0f-c4b3db63cdc9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:22.693898 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 578/1181] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:29:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:22.699657 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b6419-932e-4419-adb9-2c209a4a10ab None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:22.777090 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:22.796236 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b6419-932e-4419-adb9-2c209a4a10ab None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:22.827384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80831fdd-cc2f-4237-b778-d9907b622013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:22.828223 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80831fdd-cc2f-4237-b778-d9907b622013 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:22.828519 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80831fdd-cc2f-4237-b778-d9907b622013 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:22.828803 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80831fdd-cc2f-4237-b778-d9907b622013 None admin] PATH_INFO: `/v3/users/4864e11e631948d381bb2e8936675658` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:22.841787 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80831fdd-cc2f-4237-b778-d9907b622013 None admin] RBAC: Authorizing `identity:get_user(user_id=4864e11e631948d381bb2e8936675658)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:22.843186 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80831fdd-cc2f-4237-b778-d9907b622013 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:22.844818 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 604/1182] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:29:22 2022] GET /identity/v3/users/4864e11e631948d381bb2e8936675658 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:22.850542 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92b786-86c7-4921-9b0f-c4b3db63cdc9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:22.853327 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:22.947687 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92b786-86c7-4921-9b0f-c4b3db63cdc9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:22.980675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b82df-3eba-4b19-9b43-813a53824430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:22.981297 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b82df-3eba-4b19-9b43-813a53824430 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:22.981579 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b82df-3eba-4b19-9b43-813a53824430 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:22.981855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b82df-3eba-4b19-9b43-813a53824430 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:23.046526 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b82df-3eba-4b19-9b43-813a53824430 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:23.047911 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b82df-3eba-4b19-9b43-813a53824430 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:23.049664 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:23.143036 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 579/1183] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:29:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:29:23.148785 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80831fdd-cc2f-4237-b778-d9907b622013 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:23.243623 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80831fdd-cc2f-4237-b778-d9907b622013 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:23.276959 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a27e7-734f-49b7-9dcf-2f0e48d24893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:23.277814 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a27e7-734f-49b7-9dcf-2f0e48d24893 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:23.278099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a27e7-734f-49b7-9dcf-2f0e48d24893 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:23.278376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a27e7-734f-49b7-9dcf-2f0e48d24893 None admin] PATH_INFO: `/v3/projects/44dc2a86e900410dbcb2155839bc6326` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:23.279534 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a27e7-734f-49b7-9dcf-2f0e48d24893 None admin] RBAC: Authorizing `identity:get_project(project_id=44dc2a86e900410dbcb2155839bc6326)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:23.281027 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a27e7-734f-49b7-9dcf-2f0e48d24893 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:23.282717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 605/1184] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:29:23 2022] GET /identity/v3/projects/44dc2a86e900410dbcb2155839bc6326 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:23.288694 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b82df-3eba-4b19-9b43-813a53824430 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:23.383607 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b82df-3eba-4b19-9b43-813a53824430 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:23.385129 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:23.419127 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0445a7d5-88a1-4f1c-b161-1cb4b2deaa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:23.419767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445a7d5-88a1-4f1c-b161-1cb4b2deaa2f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:23.420052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445a7d5-88a1-4f1c-b161-1cb4b2deaa2f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:23.420328 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445a7d5-88a1-4f1c-b161-1cb4b2deaa2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:23.421191 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0445a7d5-88a1-4f1c-b161-1cb4b2deaa2f None admin] RBAC: Adding query filter params (role.id=ab64ea6d0475430195af26a049485569, scope.project.id=44dc2a86e900410dbcb2155839bc6326, user.id=4864e11e631948d381bb2e8936675658) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:29:23.421501 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0445a7d5-88a1-4f1c-b161-1cb4b2deaa2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:23.422978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0445a7d5-88a1-4f1c-b161-1cb4b2deaa2f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:23.428187 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 580/1185] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:29:23 2022] GET /identity/v3/role_assignments?user.id=4864e11e631948d381bb2e8936675658&scope.project.id=44dc2a86e900410dbcb2155839bc6326&role.id=ab64ea6d0475430195af26a049485569 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:25.422693 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4132a1-4502-47ab-ab5e-1d41f1a9cfde None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:25.423197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4132a1-4502-47ab-ab5e-1d41f1a9cfde None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:25.423282 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4132a1-4502-47ab-ab5e-1d41f1a9cfde None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:25.424674 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 606/1186] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:29:25.429926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbe692-1530-45f7-9f95-d1280befebdc None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:25.430356 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbe692-1530-45f7-9f95-d1280befebdc None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:25.430494 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbe692-1530-45f7-9f95-d1280befebdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:25.446920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-66fbe692-1530-45f7-9f95-d1280befebdc None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:25.448625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-66fbe692-1530-45f7-9f95-d1280befebdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:25.513551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 581/1187] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:29:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:29:25.536298 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4132a1-4502-47ab-ab5e-1d41f1a9cfde None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:25.545080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:25.634235 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4132a1-4502-47ab-ab5e-1d41f1a9cfde None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:25.667106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5e8ba-1259-4b5c-933b-67b7f7e51470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:25.667875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5e8ba-1259-4b5c-933b-67b7f7e51470 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:25.668160 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5e8ba-1259-4b5c-933b-67b7f7e51470 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:25.668432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5e8ba-1259-4b5c-933b-67b7f7e51470 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:25.678773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5e8ba-1259-4b5c-933b-67b7f7e51470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:29:25.686394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-afb5e8ba-1259-4b5c-933b-67b7f7e51470 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:29:25.686394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:29:25.686394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:29:25.686394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:29:25.686394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:29:25.686394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:29:25.686394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:29:25.686394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:29:25.686394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:29:25.686394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:29:25.686394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:29:25.686394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:29:25.686394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:29:25.686394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:29:25.686394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:29:25.686394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:29:25.687443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:29:25.687443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:29:25.687443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:29:25.687443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:29:25.687443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:29:25.687443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:29:25.687443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:29:25.687443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:29:25.687443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:29:25.687443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:29:25.687443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:29:25.687443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:29:25.687443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:29:25.687443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:29:25.687443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:29:25.687443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:29:25.688405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:29:25.688405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:29:25.688405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:29:25.688405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:29:25.688405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:29:25.688405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:29:25.688405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:29:25.688405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:29:25.688405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:29:25.688405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:29:25.688405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:29:25.688405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:29:25.688405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 607/1188] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:29:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:29:25.693612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fbe692-1530-45f7-9f95-d1280befebdc None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:25.786186 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:25.792750 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fbe692-1530-45f7-9f95-d1280befebdc None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:25.826988 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460504b-9b97-4ebd-935d-7cfde697c74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:25.827651 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460504b-9b97-4ebd-935d-7cfde697c74e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:25.827937 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460504b-9b97-4ebd-935d-7cfde697c74e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:25.828216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460504b-9b97-4ebd-935d-7cfde697c74e None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:25.828988 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460504b-9b97-4ebd-935d-7cfde697c74e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:29:25.829303 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460504b-9b97-4ebd-935d-7cfde697c74e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:25.830671 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460504b-9b97-4ebd-935d-7cfde697c74e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:25.838551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 582/1189] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:29:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:25.844887 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5e8ba-1259-4b5c-933b-67b7f7e51470 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:25.908456 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:25.941723 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5e8ba-1259-4b5c-933b-67b7f7e51470 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:25.973760 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435d29e-ec37-4e7e-a6aa-5da394f904fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:25.974607 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435d29e-ec37-4e7e-a6aa-5da394f904fc None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:25.975150 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435d29e-ec37-4e7e-a6aa-5da394f904fc None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:25.975420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435d29e-ec37-4e7e-a6aa-5da394f904fc None admin] PATH_INFO: `/v3/users/4864e11e631948d381bb2e8936675658` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:25.976606 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435d29e-ec37-4e7e-a6aa-5da394f904fc None admin] RBAC: Authorizing `identity:get_user(user_id=4864e11e631948d381bb2e8936675658)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:25.978022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435d29e-ec37-4e7e-a6aa-5da394f904fc None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:25.979644 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 608/1190] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:29:25 2022] GET /identity/v3/users/4864e11e631948d381bb2e8936675658 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:25.985351 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460504b-9b97-4ebd-935d-7cfde697c74e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:26.082545 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460504b-9b97-4ebd-935d-7cfde697c74e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:26.114178 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ac32d-c786-4265-a137-cad040fc2b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:26.115014 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ac32d-c786-4265-a137-cad040fc2b94 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:26.115299 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ac32d-c786-4265-a137-cad040fc2b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:26.115573 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ac32d-c786-4265-a137-cad040fc2b94 None admin] PATH_INFO: `/v3/projects/44dc2a86e900410dbcb2155839bc6326` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:26.116751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ac32d-c786-4265-a137-cad040fc2b94 None admin] RBAC: Authorizing `identity:get_project(project_id=44dc2a86e900410dbcb2155839bc6326)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:26.118181 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ac32d-c786-4265-a137-cad040fc2b94 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:26.120350 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 583/1191] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:29:25 2022] GET /identity/v3/projects/44dc2a86e900410dbcb2155839bc6326 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:26.126062 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435d29e-ec37-4e7e-a6aa-5da394f904fc None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:26.223766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435d29e-ec37-4e7e-a6aa-5da394f904fc None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:26.256821 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b40bca-1b09-4ec3-9808-61e139f45a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:26.258099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b40bca-1b09-4ec3-9808-61e139f45a12 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:26.258099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b40bca-1b09-4ec3-9808-61e139f45a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:26.258257 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b40bca-1b09-4ec3-9808-61e139f45a12 None admin] PATH_INFO: `/v3/projects/44dc2a86e900410dbcb2155839bc6326/users/4864e11e631948d381bb2e8936675658/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:26.260153 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b40bca-1b09-4ec3-9808-61e139f45a12 None admin] RBAC: Authorizing `identity:create_grant(project_id=44dc2a86e900410dbcb2155839bc6326, user_id=4864e11e631948d381bb2e8936675658, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:26.261692 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b40bca-1b09-4ec3-9808-61e139f45a12 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:26.264008 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:26.275006 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 609/1192] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 30 10:29:26 2022] PUT /identity/v3/projects/44dc2a86e900410dbcb2155839bc6326/users/4864e11e631948d381bb2e8936675658/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:28.274054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70c9e7-c44f-40f4-b3b6-7b6f3fe8629d None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:28.274517 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70c9e7-c44f-40f4-b3b6-7b6f3fe8629d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:28.274614 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70c9e7-c44f-40f4-b3b6-7b6f3fe8629d None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:28.275982 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 584/1193] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:29:28.281214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084c4e1-7fab-436b-ac24-625f27d3d141 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:28.281615 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084c4e1-7fab-436b-ac24-625f27d3d141 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:28.281759 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084c4e1-7fab-436b-ac24-625f27d3d141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:28.297937 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d084c4e1-7fab-436b-ac24-625f27d3d141 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:28.299092 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d084c4e1-7fab-436b-ac24-625f27d3d141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:28.362408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 610/1194] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:29:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:29:28.387114 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70c9e7-c44f-40f4-b3b6-7b6f3fe8629d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:28.415106 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:28.488169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70c9e7-c44f-40f4-b3b6-7b6f3fe8629d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:28.521305 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78aa5b-882c-4cf5-8196-6ce59af638e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:28.522027 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78aa5b-882c-4cf5-8196-6ce59af638e0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:28.522315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78aa5b-882c-4cf5-8196-6ce59af638e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:28.522595 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78aa5b-882c-4cf5-8196-6ce59af638e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:28.533133 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78aa5b-882c-4cf5-8196-6ce59af638e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:29:28.540681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-9f78aa5b-882c-4cf5-8196-6ce59af638e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:29:28.540681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:29:28.540681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:29:28.540681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:29:28.540681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:29:28.540681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:29:28.540681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:29:28.540681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:29:28.540681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:29:28.540681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:29:28.540681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:29:28.540681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:29:28.540681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:29:28.540681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:29:28.540681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:29:28.540681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:29:28.541819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:29:28.541819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:29:28.541819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:29:28.541819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:29:28.541819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:29:28.541819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:29:28.541819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:29:28.541819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:29:28.541819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:29:28.541819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:29:28.541819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:29:28.541819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:29:28.541819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:29:28.541819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:29:28.541819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:29:28.541819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:29:28.543046 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:29:28.543046 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:29:28.543046 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:29:28.543046 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:29:28.543046 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:29:28.543046 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:29:28.543046 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:29:28.543046 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:29:28.543046 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:29:28.543046 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:29:28.543046 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:29:28.543046 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:29:28.543046 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 585/1195] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:29:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:29:28.547919 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084c4e1-7fab-436b-ac24-625f27d3d141 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:28.641873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084c4e1-7fab-436b-ac24-625f27d3d141 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:28.664362 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:28.675757 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acf1a8-1861-47a9-b2e3-7e6c2b49a912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:28.676403 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acf1a8-1861-47a9-b2e3-7e6c2b49a912 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:28.676711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acf1a8-1861-47a9-b2e3-7e6c2b49a912 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:28.676988 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acf1a8-1861-47a9-b2e3-7e6c2b49a912 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:28.677714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acf1a8-1861-47a9-b2e3-7e6c2b49a912 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:29:28.678020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acf1a8-1861-47a9-b2e3-7e6c2b49a912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:28.679368 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acf1a8-1861-47a9-b2e3-7e6c2b49a912 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:28.687402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 611/1196] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:29:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:28.693205 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78aa5b-882c-4cf5-8196-6ce59af638e0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:28.778666 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:28.793924 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78aa5b-882c-4cf5-8196-6ce59af638e0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:28.826716 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e37622-fea2-44ae-8a13-1e673a4cf82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:28.827566 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e37622-fea2-44ae-8a13-1e673a4cf82d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:28.827851 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e37622-fea2-44ae-8a13-1e673a4cf82d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:28.828128 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e37622-fea2-44ae-8a13-1e673a4cf82d None admin] PATH_INFO: `/v3/users/4864e11e631948d381bb2e8936675658` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:28.829329 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e37622-fea2-44ae-8a13-1e673a4cf82d None admin] RBAC: Authorizing `identity:get_user(user_id=4864e11e631948d381bb2e8936675658)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:28.830779 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e37622-fea2-44ae-8a13-1e673a4cf82d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:28.832389 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 586/1197] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 30 10:29:28 2022] GET /identity/v3/users/4864e11e631948d381bb2e8936675658 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:28.838170 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acf1a8-1861-47a9-b2e3-7e6c2b49a912 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:28.931844 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acf1a8-1861-47a9-b2e3-7e6c2b49a912 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:28.963781 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aabe51b-d2a4-4261-9a3d-d341c569f09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:28.964401 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabe51b-d2a4-4261-9a3d-d341c569f09e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:28.964862 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabe51b-d2a4-4261-9a3d-d341c569f09e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:28.965139 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabe51b-d2a4-4261-9a3d-d341c569f09e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:29.017126 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:29.030114 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aabe51b-d2a4-4261-9a3d-d341c569f09e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:29.031476 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aabe51b-d2a4-4261-9a3d-d341c569f09e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:29.124578 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 612/1198] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:29:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:29:29.130325 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e37622-fea2-44ae-8a13-1e673a4cf82d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:29.225908 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e37622-fea2-44ae-8a13-1e673a4cf82d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:29.258741 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9054e51-676e-4f07-98ab-5e6211f00859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:29.259586 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9054e51-676e-4f07-98ab-5e6211f00859 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:29.259868 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9054e51-676e-4f07-98ab-5e6211f00859 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:29.260143 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9054e51-676e-4f07-98ab-5e6211f00859 None admin] PATH_INFO: `/v3/projects/44dc2a86e900410dbcb2155839bc6326` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:29.261374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9054e51-676e-4f07-98ab-5e6211f00859 None admin] RBAC: Authorizing `identity:get_project(project_id=44dc2a86e900410dbcb2155839bc6326)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:29.262809 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9054e51-676e-4f07-98ab-5e6211f00859 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:29.264492 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 587/1199] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 30 10:29:29 2022] GET /identity/v3/projects/44dc2a86e900410dbcb2155839bc6326 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:29.270431 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aabe51b-d2a4-4261-9a3d-d341c569f09e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:29.352385 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:29.367422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aabe51b-d2a4-4261-9a3d-d341c569f09e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:29.400371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11851985-887b-480e-8584-afcbbfe61086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:29.401668 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11851985-887b-480e-8584-afcbbfe61086 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:29.401957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11851985-887b-480e-8584-afcbbfe61086 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:29.402236 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11851985-887b-480e-8584-afcbbfe61086 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:29.403049 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11851985-887b-480e-8584-afcbbfe61086 None admin] RBAC: Adding query filter params (role.id=ab64ea6d0475430195af26a049485569, scope.project.id=44dc2a86e900410dbcb2155839bc6326, user.id=4864e11e631948d381bb2e8936675658) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:29:29.403361 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11851985-887b-480e-8584-afcbbfe61086 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:29.404807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11851985-887b-480e-8584-afcbbfe61086 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:29.410429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 613/1200] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:29:29 2022] GET /identity/v3/role_assignments?user.id=4864e11e631948d381bb2e8936675658&scope.project.id=44dc2a86e900410dbcb2155839bc6326&role.id=ab64ea6d0475430195af26a049485569 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:39.255069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:39.407869 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=25 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:25.031617 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c532716-f771-4522-a403-081eb46f66db None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:25.032479 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c532716-f771-4522-a403-081eb46f66db None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:25.032479 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c532716-f771-4522-a403-081eb46f66db None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:25.033789 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 588/1201] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:30:25.039900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfacd5b-42df-460c-b17a-ef1ba4a881d2 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:25.040401 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfacd5b-42df-460c-b17a-ef1ba4a881d2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:25.040566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfacd5b-42df-460c-b17a-ef1ba4a881d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:25.063825 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9dfacd5b-42df-460c-b17a-ef1ba4a881d2 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:30:25.063825 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9dfacd5b-42df-460c-b17a-ef1ba4a881d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:25.148277 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 614/1202] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:30:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:30:25.177376 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c532716-f771-4522-a403-081eb46f66db None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:25.326538 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c532716-f771-4522-a403-081eb46f66db None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:25.374085 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90087dd4-99ef-4338-9ea4-81713d59b88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:25.375021 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90087dd4-99ef-4338-9ea4-81713d59b88d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:25.375239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90087dd4-99ef-4338-9ea4-81713d59b88d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:25.375536 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90087dd4-99ef-4338-9ea4-81713d59b88d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:25.388012 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90087dd4-99ef-4338-9ea4-81713d59b88d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:25.389694 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90087dd4-99ef-4338-9ea4-81713d59b88d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:25.410699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-90087dd4-99ef-4338-9ea4-81713d59b88d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:30:25.410699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:25.410699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:25.410699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:25.410699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:25.410699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:25.410699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:25.410699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:25.410699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:25.410699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:25.410699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:25.410699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:25.410699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:30:25.410699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:30:25.410699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:30:25.411837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:30:25.411837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:25.411837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:25.411837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:25.411837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:25.411837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:25.411837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:25.411837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:25.411837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:25.411837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:25.411837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:25.411837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:25.411837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:25.411837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:25.411837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:25.411837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:25.411837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:25.413356 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:30:25.413356 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:30:25.413356 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:30:25.413356 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:30:25.413356 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 589/1203] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:30:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:25.418891 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfacd5b-42df-460c-b17a-ef1ba4a881d2 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:25.545048 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfacd5b-42df-460c-b17a-ef1ba4a881d2 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:25.576390 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:25.583750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a009c-8a1e-4c16-b360-9efbb43db38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:25.584370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a009c-8a1e-4c16-b360-9efbb43db38c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:25.584686 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a009c-8a1e-4c16-b360-9efbb43db38c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:25.584965 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a009c-8a1e-4c16-b360-9efbb43db38c None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:25.585712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a009c-8a1e-4c16-b360-9efbb43db38c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:25.585998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a009c-8a1e-4c16-b360-9efbb43db38c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:25.587370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a009c-8a1e-4c16-b360-9efbb43db38c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:25.603142 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 615/1204] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:25.609753 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90087dd4-99ef-4338-9ea4-81713d59b88d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:25.682881 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:25.737170 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90087dd4-99ef-4338-9ea4-81713d59b88d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:25.779457 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab31864-a27b-49e8-a651-24e8746b20a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:25.780550 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab31864-a27b-49e8-a651-24e8746b20a6 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:25.780813 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab31864-a27b-49e8-a651-24e8746b20a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:25.781209 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab31864-a27b-49e8-a651-24e8746b20a6 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:25.781924 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab31864-a27b-49e8-a651-24e8746b20a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:25.783661 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab31864-a27b-49e8-a651-24e8746b20a6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:25.808870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 590/1205] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 30 10:30:25 2022] POST /identity/v3/users => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:30:28.128988 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cda63-8100-4e64-99fc-f60f353923e3 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:28.129568 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cda63-8100-4e64-99fc-f60f353923e3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:28.129568 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cda63-8100-4e64-99fc-f60f353923e3 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:28.131058 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 616/1206] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:30:28.137499 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d3f3e-7e18-4660-86f9-7800f32a0452 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:28.138015 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d3f3e-7e18-4660-86f9-7800f32a0452 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:28.138169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d3f3e-7e18-4660-86f9-7800f32a0452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:28.157531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-228d3f3e-7e18-4660-86f9-7800f32a0452 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:30:28.158902 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-228d3f3e-7e18-4660-86f9-7800f32a0452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:28.237267 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 591/1207] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:30:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:30:28.267895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cda63-8100-4e64-99fc-f60f353923e3 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:28.404303 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cda63-8100-4e64-99fc-f60f353923e3 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:28.451340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadef98-e4ed-472e-9050-0d6574e54fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:28.452247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadef98-e4ed-472e-9050-0d6574e54fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:28.452494 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadef98-e4ed-472e-9050-0d6574e54fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:28.452889 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadef98-e4ed-472e-9050-0d6574e54fd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:28.465285 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadef98-e4ed-472e-9050-0d6574e54fd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:30:28.475478 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-edadef98-e4ed-472e-9050-0d6574e54fd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:30:28.475478 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:28.475478 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:28.475478 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:28.475478 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:28.475478 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:28.475478 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:28.475478 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:28.475478 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:28.475478 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:28.475478 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:28.475478 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:28.475478 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:30:28.475478 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:30:28.475478 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:30:28.475478 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:30:28.476588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:30:28.476588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:30:28.476588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:30:28.476588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:30:28.476588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:28.476588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:28.476588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:28.476588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:28.476588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:28.476588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:28.476588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:28.476588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:28.476588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:28.476588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:28.476588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:28.476588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:28.483197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:28.483197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:28.483197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:28.483197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:28.483197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:30:28.483197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:30:28.483197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:30:28.483197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:30:28.483197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:30:28.483197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:30:28.483197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:30:28.483197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:30:28.483197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 617/1208] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 30 10:30:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:28.485638 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d3f3e-7e18-4660-86f9-7800f32a0452 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:28.528633 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:28.605298 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d3f3e-7e18-4660-86f9-7800f32a0452 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:28.647642 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5a1b6-f553-424e-9e6f-c0a1e53fc3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:28.649439 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5a1b6-f553-424e-9e6f-c0a1e53fc3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:28.649439 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5a1b6-f553-424e-9e6f-c0a1e53fc3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:28.649439 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5a1b6-f553-424e-9e6f-c0a1e53fc3e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:28.652888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5a1b6-f553-424e-9e6f-c0a1e53fc3e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:28.652888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5a1b6-f553-424e-9e6f-c0a1e53fc3e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:28.652888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5a1b6-f553-424e-9e6f-c0a1e53fc3e5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:28.663380 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 592/1209] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 30 10:30:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:30:28.669794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadef98-e4ed-472e-9050-0d6574e54fd6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:28.735324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:28.799390 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadef98-e4ed-472e-9050-0d6574e54fd6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:28.837256 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920b11f-e9dd-4d39-9c23-7f82054fcad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:28.838777 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920b11f-e9dd-4d39-9c23-7f82054fcad7 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:28.839162 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920b11f-e9dd-4d39-9c23-7f82054fcad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:28.839536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920b11f-e9dd-4d39-9c23-7f82054fcad7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:28.859980 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920b11f-e9dd-4d39-9c23-7f82054fcad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:28.861656 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920b11f-e9dd-4d39-9c23-7f82054fcad7 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:28.887147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-3920b11f-e9dd-4d39-9c23-7f82054fcad7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:30:28.887147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:28.887147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:28.887147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:28.887147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:28.887147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:28.887147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:28.887147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:28.887147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:28.887147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:28.887147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:28.887147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:28.887147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:30:28.887147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:30:28.887147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:30:28.888369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:30:28.888369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:28.888369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:28.888369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:28.888369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:28.888369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:28.888369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:28.888369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:28.888369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:28.888369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:28.888369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:28.888369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:28.888369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:28.888369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:28.888369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:28.888369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:28.888369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:28.894234 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:30:28.894234 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:30:28.894234 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:30:28.894234 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:30:28.894234 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 618/1210] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:30:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:28.894594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5a1b6-f553-424e-9e6f-c0a1e53fc3e5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:29.008496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:29.011156 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5a1b6-f553-424e-9e6f-c0a1e53fc3e5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:29.052879 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985f7d5-e890-403e-82ef-1231f42a4ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:29.053651 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985f7d5-e890-403e-82ef-1231f42a4ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:29.053976 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985f7d5-e890-403e-82ef-1231f42a4ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:29.054279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985f7d5-e890-403e-82ef-1231f42a4ac8 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:29.055102 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985f7d5-e890-403e-82ef-1231f42a4ac8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:29.055454 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985f7d5-e890-403e-82ef-1231f42a4ac8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:29.057117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985f7d5-e890-403e-82ef-1231f42a4ac8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:29.072217 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 593/1211] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:30:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:29.078218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920b11f-e9dd-4d39-9c23-7f82054fcad7 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:29.197738 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920b11f-e9dd-4d39-9c23-7f82054fcad7 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:29.200376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:29.246311 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3928fe-b4d3-4548-8e8f-80e0681d54f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:29.247146 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3928fe-b4d3-4548-8e8f-80e0681d54f9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:29.247472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3928fe-b4d3-4548-8e8f-80e0681d54f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:29.247782 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3928fe-b4d3-4548-8e8f-80e0681d54f9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:29.260716 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3928fe-b4d3-4548-8e8f-80e0681d54f9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:29.261239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3928fe-b4d3-4548-8e8f-80e0681d54f9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:29.278033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-2a3928fe-b4d3-4548-8e8f-80e0681d54f9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:30:29.278033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:29.278033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:29.278033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:29.278033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:29.278033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:29.278033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:29.278033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:29.278033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:29.278033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:29.278033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:29.278033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:29.278033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:30:29.278033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:30:29.278033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:30:29.278033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:30:29.279299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:29.279299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:29.279299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:30:29.279299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:30:29.279299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:30:29.279299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:30:29.279299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:29.279299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:29.279299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:29.279299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:29.279299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:29.279299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:29.279299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:29.279299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:29.279299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:29.279299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:29.279299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:29.279299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:29.281695 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:29.281695 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:29.281695 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:30:29.281695 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:30:29.281695 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:30:29.281695 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:30:29.281695 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:30:29.281695 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:30:29.281695 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:30:29.281695 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:30:29.281695 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 619/1212] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:30:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:29.285185 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985f7d5-e890-403e-82ef-1231f42a4ac8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:29.417623 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985f7d5-e890-403e-82ef-1231f42a4ac8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:29.470442 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc71b85-9d8f-4ebb-9759-74a40f738b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:29.471513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc71b85-9d8f-4ebb-9759-74a40f738b2a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:29.472668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc71b85-9d8f-4ebb-9759-74a40f738b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:29.473113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc71b85-9d8f-4ebb-9759-74a40f738b2a None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:29.474670 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc71b85-9d8f-4ebb-9759-74a40f738b2a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:29.475556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc71b85-9d8f-4ebb-9759-74a40f738b2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:29.478082 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc71b85-9d8f-4ebb-9759-74a40f738b2a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:29.511122 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 594/1213] 10.222.0.59 () {56 vars in 1143 bytes} [Thu Jun 30 10:30:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:30:29.513235 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3928fe-b4d3-4548-8e8f-80e0681d54f9 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:29.649726 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3928fe-b4d3-4548-8e8f-80e0681d54f9 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:29.692029 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fceab5d-5c06-4ce5-9ff3-edc1acaf3e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:29.692753 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fceab5d-5c06-4ce5-9ff3-edc1acaf3e6a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:29.693044 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fceab5d-5c06-4ce5-9ff3-edc1acaf3e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:29.693352 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fceab5d-5c06-4ce5-9ff3-edc1acaf3e6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:29.739718 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:29.786272 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fceab5d-5c06-4ce5-9ff3-edc1acaf3e6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:29.787775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fceab5d-5c06-4ce5-9ff3-edc1acaf3e6a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:29.906167 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 620/1214] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:30:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:30:29.912134 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc71b85-9d8f-4ebb-9759-74a40f738b2a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:29.938158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:30.040614 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc71b85-9d8f-4ebb-9759-74a40f738b2a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:30.084870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c34c5-f91d-4f35-bb53-4c180c3ca217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:30.085689 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c34c5-f91d-4f35-bb53-4c180c3ca217 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:30.085984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c34c5-f91d-4f35-bb53-4c180c3ca217 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:30.086277 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c34c5-f91d-4f35-bb53-4c180c3ca217 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:30.099106 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c34c5-f91d-4f35-bb53-4c180c3ca217 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:30.100936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c34c5-f91d-4f35-bb53-4c180c3ca217 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:30.120000 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-4f0c34c5-f91d-4f35-bb53-4c180c3ca217 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:30:30.120000 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:30.120000 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:30.120000 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:30.120000 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:30.120000 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:30.120000 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:30.120000 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:30.120000 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:30.120000 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:30.120000 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:30.120000 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:30.120000 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:30:30.120000 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:30:30.120000 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:30:30.121627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:30:30.121627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:30.121627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:30.121627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:30.121627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:30.121627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:30.121627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:30.121627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:30.121627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:30.121627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:30.121627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:30.121627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:30.121627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:30.121627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:30.121627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:30.121627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:30.121627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:30.122997 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:30:30.122997 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:30:30.122997 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:30:30.122997 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:30:30.122997 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 595/1215] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:30:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:30.127093 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fceab5d-5c06-4ce5-9ff3-edc1acaf3e6a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:30.192813 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:30.236887 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fceab5d-5c06-4ce5-9ff3-edc1acaf3e6a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:30.276673 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af88267-a1df-4bbb-af43-67aed3357802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:30.277425 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af88267-a1df-4bbb-af43-67aed3357802 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:30.277723 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af88267-a1df-4bbb-af43-67aed3357802 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:30.278015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af88267-a1df-4bbb-af43-67aed3357802 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:30.278855 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af88267-a1df-4bbb-af43-67aed3357802 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:30.279168 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af88267-a1df-4bbb-af43-67aed3357802 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:30.280630 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af88267-a1df-4bbb-af43-67aed3357802 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:30.297525 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 621/1216] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:30.298788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c34c5-f91d-4f35-bb53-4c180c3ca217 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:30.377580 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:30.419984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c34c5-f91d-4f35-bb53-4c180c3ca217 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:30.479484 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f72ca-070b-4f6d-b314-fb4389488397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:30.481486 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f72ca-070b-4f6d-b314-fb4389488397 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:30.483254 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f72ca-070b-4f6d-b314-fb4389488397 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:30.483254 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f72ca-070b-4f6d-b314-fb4389488397 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:30.498810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f72ca-070b-4f6d-b314-fb4389488397 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:30.502340 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f72ca-070b-4f6d-b314-fb4389488397 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:30.530495 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-005f72ca-070b-4f6d-b314-fb4389488397 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:30:30.530495 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:30.530495 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:30.530495 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:30.530495 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:30.530495 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:30.530495 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:30.530495 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:30.530495 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:30.530495 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:30.530495 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:30.530495 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:30.530495 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:30:30.530495 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:30:30.530495 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:30:30.531833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:30:30.531833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:30.531833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:30.531833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:30.531833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:30.531833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:30.531833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:30.531833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:30.531833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:30.531833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:30.531833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:30.531833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:30.531833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:30.531833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:30.531833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:30.531833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:30.531833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:30.533053 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:30:30.533053 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:30:30.533053 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:30:30.533053 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:30:30.533053 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:30:30.533053 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:30:30.533053 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:30:30.533053 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:30:30.533515 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 596/1217] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:30:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:30.538847 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af88267-a1df-4bbb-af43-67aed3357802 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:30.648449 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af88267-a1df-4bbb-af43-67aed3357802 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:30.671503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:30.686315 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404709b-7a8c-4da7-bdc3-0d285274c86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:30.687028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404709b-7a8c-4da7-bdc3-0d285274c86b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:30.687311 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404709b-7a8c-4da7-bdc3-0d285274c86b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:30.687584 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404709b-7a8c-4da7-bdc3-0d285274c86b None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:30.688411 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404709b-7a8c-4da7-bdc3-0d285274c86b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:30.688757 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404709b-7a8c-4da7-bdc3-0d285274c86b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:30.690698 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404709b-7a8c-4da7-bdc3-0d285274c86b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:30.704546 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 622/1218] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:30:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:30:30.711233 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f72ca-070b-4f6d-b314-fb4389488397 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:30.825571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f72ca-070b-4f6d-b314-fb4389488397 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:30.860855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:30.866885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdd16c-ca7e-423f-beef-3ad1f047a936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:30.867572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdd16c-ca7e-423f-beef-3ad1f047a936 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:30.867882 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdd16c-ca7e-423f-beef-3ad1f047a936 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:30.868244 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdd16c-ca7e-423f-beef-3ad1f047a936 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:30.869850 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bdd16c-ca7e-423f-beef-3ad1f047a936 None admin] RBAC: Adding query filter params (role.id=1c667697d38a434fbb99c61bc846c4a5, scope.project.id=423854cc8f524ecb8d740d1cb0053856, user.id=48709a771ab64ed38018873313f37c84) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:30.870200 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bdd16c-ca7e-423f-beef-3ad1f047a936 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:30.871805 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bdd16c-ca7e-423f-beef-3ad1f047a936 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:30.888540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 597/1219] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:30:30 2022] GET /identity/v3/role_assignments?user.id=48709a771ab64ed38018873313f37c84&scope.project.id=423854cc8f524ecb8d740d1cb0053856&role.id=1c667697d38a434fbb99c61bc846c4a5 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:30:33.136962 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc74c54-6e17-48af-ad2a-a64a6e449d2c None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:33.137494 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc74c54-6e17-48af-ad2a-a64a6e449d2c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:33.137494 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc74c54-6e17-48af-ad2a-a64a6e449d2c None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:33.138861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 623/1220] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:30:33.144243 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc53d4c-1f2d-4a82-a067-1955f911b3ed None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:33.144686 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc53d4c-1f2d-4a82-a067-1955f911b3ed None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:33.144850 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc53d4c-1f2d-4a82-a067-1955f911b3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:33.161373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3dc53d4c-1f2d-4a82-a067-1955f911b3ed None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:30:33.162582 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3dc53d4c-1f2d-4a82-a067-1955f911b3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:33.240441 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 598/1221] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:30:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:30:33.265681 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc74c54-6e17-48af-ad2a-a64a6e449d2c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:33.375736 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc74c54-6e17-48af-ad2a-a64a6e449d2c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:33.417765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a9d4a-7fc2-40de-9509-39d2eaef3a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:33.418478 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a9d4a-7fc2-40de-9509-39d2eaef3a1b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:33.418761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a9d4a-7fc2-40de-9509-39d2eaef3a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:33.419033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a9d4a-7fc2-40de-9509-39d2eaef3a1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:33.430128 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a9d4a-7fc2-40de-9509-39d2eaef3a1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:30:33.440115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-149a9d4a-7fc2-40de-9509-39d2eaef3a1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:30:33.440115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:33.440115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:33.440115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:33.440115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:33.440115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:33.440115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:33.440115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:33.440115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:33.440115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:33.440115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:33.440115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:33.440115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:30:33.440115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:30:33.440115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:30:33.440115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:30:33.441254 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:30:33.441254 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:30:33.441254 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:30:33.441254 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:30:33.441254 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:33.441254 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:33.441254 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:33.441254 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:33.441254 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:33.441254 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:33.441254 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:33.441254 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:33.441254 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:33.441254 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:33.441254 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:33.441254 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:33.442373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:33.442373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:33.442373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:33.442373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:33.442373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:30:33.442373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:30:33.442373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:30:33.442373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:30:33.442373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:30:33.442373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:30:33.442373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:30:33.442373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:30:33.442373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 624/1222] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 30 10:30:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:33.448184 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc53d4c-1f2d-4a82-a067-1955f911b3ed None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:33.553796 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc53d4c-1f2d-4a82-a067-1955f911b3ed None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:33.577936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:33.589951 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ad018-8a02-4117-9f91-bd82ab094b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:33.590618 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ad018-8a02-4117-9f91-bd82ab094b8e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:33.590906 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ad018-8a02-4117-9f91-bd82ab094b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:33.591187 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ad018-8a02-4117-9f91-bd82ab094b8e None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:33.591931 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ad018-8a02-4117-9f91-bd82ab094b8e None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:33.592243 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ad018-8a02-4117-9f91-bd82ab094b8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:33.593656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ad018-8a02-4117-9f91-bd82ab094b8e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:33.601880 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 599/1223] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 30 10:30:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:33.608876 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a9d4a-7fc2-40de-9509-39d2eaef3a1b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:33.657401 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:33.719990 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a9d4a-7fc2-40de-9509-39d2eaef3a1b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:33.756260 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c407ee-783f-48e2-b6ca-4d1b0bbead31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:33.757127 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c407ee-783f-48e2-b6ca-4d1b0bbead31 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:33.757472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c407ee-783f-48e2-b6ca-4d1b0bbead31 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:33.757738 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c407ee-783f-48e2-b6ca-4d1b0bbead31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:33.769866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c407ee-783f-48e2-b6ca-4d1b0bbead31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:33.771299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c407ee-783f-48e2-b6ca-4d1b0bbead31 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:33.789953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-e6c407ee-783f-48e2-b6ca-4d1b0bbead31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:30:33.789953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:33.789953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:33.789953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:33.789953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:33.789953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:33.789953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:33.789953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:33.789953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:33.789953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:33.789953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:33.789953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:33.789953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:30:33.789953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:30:33.789953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:30:33.791341 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:30:33.791341 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:33.791341 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:33.791341 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:33.791341 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:33.791341 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:33.791341 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:33.791341 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:33.791341 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:33.791341 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:33.791341 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:33.791341 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:33.791341 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:33.791341 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:33.791341 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:33.791341 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:33.791341 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:33.792418 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:30:33.792418 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:30:33.792418 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:30:33.792418 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:30:33.792418 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 625/1224] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:30:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:33.795832 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ad018-8a02-4117-9f91-bd82ab094b8e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:33.906472 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ad018-8a02-4117-9f91-bd82ab094b8e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:33.941766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0da96d-cb64-4011-9deb-bff9dfbf789d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:33.942421 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0da96d-cb64-4011-9deb-bff9dfbf789d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:33.942702 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0da96d-cb64-4011-9deb-bff9dfbf789d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:33.942992 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0da96d-cb64-4011-9deb-bff9dfbf789d None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:33.943708 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0da96d-cb64-4011-9deb-bff9dfbf789d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:33.944014 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0da96d-cb64-4011-9deb-bff9dfbf789d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:33.945415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0da96d-cb64-4011-9deb-bff9dfbf789d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:33.958019 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 600/1225] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:33.964338 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c407ee-783f-48e2-b6ca-4d1b0bbead31 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:34.068039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:34.076886 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c407ee-783f-48e2-b6ca-4d1b0bbead31 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:34.115513 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63344f9-b5c0-4660-9d35-64ef7136c0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:34.116398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63344f9-b5c0-4660-9d35-64ef7136c0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:34.116714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63344f9-b5c0-4660-9d35-64ef7136c0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:34.116997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63344f9-b5c0-4660-9d35-64ef7136c0f7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:34.125372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63344f9-b5c0-4660-9d35-64ef7136c0f7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:34.126805 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63344f9-b5c0-4660-9d35-64ef7136c0f7 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:34.142219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-f63344f9-b5c0-4660-9d35-64ef7136c0f7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:30:34.142219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:34.142219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:34.142219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:34.142219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:34.142219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:34.142219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:34.142219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:34.142219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:34.142219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:34.142219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:34.142219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:34.142219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:30:34.142219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:30:34.142219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:30:34.142219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:30:34.143866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:34.143866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:34.143866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:30:34.143866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:30:34.143866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:30:34.143866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:30:34.143866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:34.143866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:34.143866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:34.143866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:34.143866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:34.143866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:34.143866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:34.143866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:34.143866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:34.143866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:34.143866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:34.143866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:34.145190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:34.145190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:34.145190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:30:34.145190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:30:34.145190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:30:34.145190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:30:34.145190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:30:34.145190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:30:34.145190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:30:34.145190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:30:34.145190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 626/1226] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:30:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:34.150210 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0da96d-cb64-4011-9deb-bff9dfbf789d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:34.204890 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:34.273155 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0da96d-cb64-4011-9deb-bff9dfbf789d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:34.312615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4921f-97ab-4490-bba2-d3f9319ff581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:34.313281 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4921f-97ab-4490-bba2-d3f9319ff581 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:34.313559 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4921f-97ab-4490-bba2-d3f9319ff581 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:34.313832 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4921f-97ab-4490-bba2-d3f9319ff581 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:34.314651 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4921f-97ab-4490-bba2-d3f9319ff581 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:34.314960 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4921f-97ab-4490-bba2-d3f9319ff581 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:34.316383 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4921f-97ab-4490-bba2-d3f9319ff581 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:34.336686 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 601/1227] 10.222.0.59 () {56 vars in 1143 bytes} [Thu Jun 30 10:30:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:34.342403 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63344f9-b5c0-4660-9d35-64ef7136c0f7 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:34.452242 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63344f9-b5c0-4660-9d35-64ef7136c0f7 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:34.488033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f195d-93b7-464d-9234-a63261c5bded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:34.488865 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f195d-93b7-464d-9234-a63261c5bded None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:34.489132 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f195d-93b7-464d-9234-a63261c5bded None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:34.489407 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f195d-93b7-464d-9234-a63261c5bded None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:34.501314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f195d-93b7-464d-9234-a63261c5bded None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:34.502748 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f195d-93b7-464d-9234-a63261c5bded None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:34.520138 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-030f195d-93b7-464d-9234-a63261c5bded None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:30:34.520138 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:34.520138 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:34.520138 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:34.520138 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:34.520138 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:34.520138 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:34.520138 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:34.520138 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:34.520138 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:34.520138 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:34.520138 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:34.520138 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:30:34.520138 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:30:34.520138 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:30:34.521318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:30:34.521318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:34.521318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:34.521318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:34.521318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:34.521318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:34.521318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:34.521318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:34.521318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:34.521318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:34.521318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:34.521318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:34.521318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:34.521318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:34.521318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:34.521318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:34.521318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:34.522279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:30:34.522279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:30:34.522279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:30:34.522279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:30:34.522279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 627/1228] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:30:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:34.527410 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4921f-97ab-4490-bba2-d3f9319ff581 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:34.646575 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4921f-97ab-4490-bba2-d3f9319ff581 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:34.649201 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:34.686330 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fb1b5-e493-451f-94c0-43f0c501c2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:34.687137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fb1b5-e493-451f-94c0-43f0c501c2fb None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:34.687445 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fb1b5-e493-451f-94c0-43f0c501c2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:34.687749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fb1b5-e493-451f-94c0-43f0c501c2fb None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:34.688559 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fb1b5-e493-451f-94c0-43f0c501c2fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:34.688932 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fb1b5-e493-451f-94c0-43f0c501c2fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:34.690470 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fb1b5-e493-451f-94c0-43f0c501c2fb None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:34.703503 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 602/1229] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:34.709321 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f195d-93b7-464d-9234-a63261c5bded None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:34.719617 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:34.828539 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f195d-93b7-464d-9234-a63261c5bded None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:34.867024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03fdbb-c582-4b76-935b-803a81a69e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:34.867928 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03fdbb-c582-4b76-935b-803a81a69e7a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:34.868302 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03fdbb-c582-4b76-935b-803a81a69e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:34.868657 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03fdbb-c582-4b76-935b-803a81a69e7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:34.877741 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03fdbb-c582-4b76-935b-803a81a69e7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:34.879326 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03fdbb-c582-4b76-935b-803a81a69e7a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:34.900957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-4f03fdbb-c582-4b76-935b-803a81a69e7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:30:34.900957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:34.900957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:34.900957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:34.900957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:34.900957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:34.900957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:34.900957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:34.900957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:34.900957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:34.900957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:34.900957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:34.900957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:30:34.900957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:30:34.900957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:30:34.902099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:30:34.902099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:34.902099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:34.902099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:34.902099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:34.902099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:34.902099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:34.902099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:34.902099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:34.902099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:34.902099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:34.902099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:34.902099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:34.902099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:34.902099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:34.902099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:34.902099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:34.903168 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:30:34.903168 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:30:34.903168 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:30:34.903168 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:30:34.903168 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:30:34.903168 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:30:34.903168 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:30:34.903168 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:30:34.903625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 628/1230] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:30:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:34.908809 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fb1b5-e493-451f-94c0-43f0c501c2fb None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:35.014990 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fb1b5-e493-451f-94c0-43f0c501c2fb None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:35.053651 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799a47d-5876-4477-8eae-3cf6b8531cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:35.054691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799a47d-5876-4477-8eae-3cf6b8531cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:35.054950 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799a47d-5876-4477-8eae-3cf6b8531cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:35.055259 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799a47d-5876-4477-8eae-3cf6b8531cb7 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:35.056123 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799a47d-5876-4477-8eae-3cf6b8531cb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:35.056465 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799a47d-5876-4477-8eae-3cf6b8531cb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:35.058349 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799a47d-5876-4477-8eae-3cf6b8531cb7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:35.073701 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 603/1231] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:30:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:30:35.079927 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03fdbb-c582-4b76-935b-803a81a69e7a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:35.155103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:35.192965 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03fdbb-c582-4b76-935b-803a81a69e7a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:35.231220 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bed8e9-d602-4ac4-90a2-745aac363a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:35.232152 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bed8e9-d602-4ac4-90a2-745aac363a6f None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:35.232439 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bed8e9-d602-4ac4-90a2-745aac363a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:35.232740 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bed8e9-d602-4ac4-90a2-745aac363a6f None admin] PATH_INFO: `/v3/projects/423854cc8f524ecb8d740d1cb0053856/users/48709a771ab64ed38018873313f37c84/roles/1c667697d38a434fbb99c61bc846c4a5` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:35.249675 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bed8e9-d602-4ac4-90a2-745aac363a6f None admin] RBAC: Authorizing `identity:create_grant(project_id=423854cc8f524ecb8d740d1cb0053856, user_id=48709a771ab64ed38018873313f37c84, role_id=1c667697d38a434fbb99c61bc846c4a5)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:35.251328 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bed8e9-d602-4ac4-90a2-745aac363a6f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:35.265083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 629/1232] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 30 10:30:35 2022] PUT /identity/v3/projects/423854cc8f524ecb8d740d1cb0053856/users/48709a771ab64ed38018873313f37c84/roles/1c667697d38a434fbb99c61bc846c4a5 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:30:37.345826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e62779-421c-4d3b-9b5b-5081252d4143 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:37.346388 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e62779-421c-4d3b-9b5b-5081252d4143 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:37.346388 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e62779-421c-4d3b-9b5b-5081252d4143 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:37.347752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 604/1233] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:30:37.354282 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607ac47-2ec3-48be-850e-05d144e7a542 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:37.354830 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607ac47-2ec3-48be-850e-05d144e7a542 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:37.354950 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607ac47-2ec3-48be-850e-05d144e7a542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:37.371393 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-2607ac47-2ec3-48be-850e-05d144e7a542 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:30:37.372736 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2607ac47-2ec3-48be-850e-05d144e7a542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:37.445570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 630/1234] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:30:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:30:37.472588 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e62779-421c-4d3b-9b5b-5081252d4143 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:37.499902 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:37.585636 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e62779-421c-4d3b-9b5b-5081252d4143 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:37.623757 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd10f86-1d0e-4669-90d8-10106dc67659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:37.624628 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd10f86-1d0e-4669-90d8-10106dc67659 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:37.624902 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd10f86-1d0e-4669-90d8-10106dc67659 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:37.625180 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd10f86-1d0e-4669-90d8-10106dc67659 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:37.638109 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd10f86-1d0e-4669-90d8-10106dc67659 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:30:37.646496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-ecd10f86-1d0e-4669-90d8-10106dc67659 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:30:37.646496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:37.646496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:37.646496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:37.646496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:37.646496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:37.646496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:37.646496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:37.646496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:37.646496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:37.646496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:37.646496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:37.646496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:30:37.646496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:30:37.646496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:30:37.646496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:30:37.647739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:30:37.647739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:30:37.647739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:30:37.647739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:30:37.647739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:37.647739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:37.647739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:37.647739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:37.647739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:37.647739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:37.647739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:37.647739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:37.647739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:37.647739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:37.647739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:37.647739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:37.648664 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:37.648664 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:37.648664 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:37.648664 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:37.648664 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:30:37.648664 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:30:37.648664 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:30:37.648664 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:30:37.648664 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:30:37.648664 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:30:37.648664 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:30:37.648664 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:30:37.648664 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 605/1235] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 30 10:30:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:37.653995 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607ac47-2ec3-48be-850e-05d144e7a542 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:37.706425 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:37.767870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607ac47-2ec3-48be-850e-05d144e7a542 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:37.803614 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2debe5-348a-4c4f-ad7f-93fb78132e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:37.804278 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2debe5-348a-4c4f-ad7f-93fb78132e9a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:37.804591 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2debe5-348a-4c4f-ad7f-93fb78132e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:37.804871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2debe5-348a-4c4f-ad7f-93fb78132e9a None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:37.805608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2debe5-348a-4c4f-ad7f-93fb78132e9a None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:37.805917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2debe5-348a-4c4f-ad7f-93fb78132e9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:37.807307 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2debe5-348a-4c4f-ad7f-93fb78132e9a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:37.816475 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 631/1236] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 30 10:30:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:37.822252 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd10f86-1d0e-4669-90d8-10106dc67659 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:37.916296 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:37.933006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd10f86-1d0e-4669-90d8-10106dc67659 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:37.974585 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00295d-a47e-495a-956a-60a700436d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:37.975948 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00295d-a47e-495a-956a-60a700436d22 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:37.976229 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00295d-a47e-495a-956a-60a700436d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:37.976525 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00295d-a47e-495a-956a-60a700436d22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:37.988108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00295d-a47e-495a-956a-60a700436d22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:37.989621 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00295d-a47e-495a-956a-60a700436d22 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:38.008615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-8e00295d-a47e-495a-956a-60a700436d22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:30:38.008615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:38.008615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:38.008615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:38.008615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:38.008615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:38.008615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:38.008615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:38.008615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:38.008615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:38.008615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:38.008615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:38.008615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:30:38.008615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:30:38.008615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:30:38.009748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:30:38.009748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:38.009748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:38.009748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:38.009748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:38.009748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:38.009748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:38.009748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:38.009748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:38.009748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:38.009748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:38.009748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:38.009748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:38.009748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:38.009748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:38.009748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:38.009748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:38.010696 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:30:38.010696 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:30:38.010696 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:30:38.010696 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:30:38.010696 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 606/1237] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:30:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:38.016554 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2debe5-348a-4c4f-ad7f-93fb78132e9a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:38.120977 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2debe5-348a-4c4f-ad7f-93fb78132e9a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:38.130123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:38.158695 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51dedfa-b61e-4d56-8a40-d8f01e32e6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:38.161125 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dedfa-b61e-4d56-8a40-d8f01e32e6e6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:38.161125 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dedfa-b61e-4d56-8a40-d8f01e32e6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:38.161305 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dedfa-b61e-4d56-8a40-d8f01e32e6e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:38.162023 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51dedfa-b61e-4d56-8a40-d8f01e32e6e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:38.163026 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51dedfa-b61e-4d56-8a40-d8f01e32e6e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:38.163707 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51dedfa-b61e-4d56-8a40-d8f01e32e6e6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:38.176725 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 632/1238] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:38.182245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00295d-a47e-495a-956a-60a700436d22 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:38.319584 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00295d-a47e-495a-956a-60a700436d22 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:38.360682 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9cd37-7700-4ed9-b467-40001ddf36dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:38.361538 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9cd37-7700-4ed9-b467-40001ddf36dc None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:38.361824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9cd37-7700-4ed9-b467-40001ddf36dc None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:38.362099 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9cd37-7700-4ed9-b467-40001ddf36dc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:38.365422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:38.371694 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9cd37-7700-4ed9-b467-40001ddf36dc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:38.373197 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9cd37-7700-4ed9-b467-40001ddf36dc None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:38.389076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-41a9cd37-7700-4ed9-b467-40001ddf36dc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:30:38.389076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:38.389076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:38.389076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:38.389076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:38.389076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:38.389076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:38.389076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:38.389076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:38.389076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:38.389076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:38.389076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:38.389076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:30:38.389076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:30:38.389076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:30:38.389076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:30:38.390152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:38.390152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:38.390152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:30:38.390152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:30:38.390152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:30:38.390152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:30:38.390152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:38.390152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:38.390152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:38.390152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:38.390152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:38.390152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:38.390152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:38.390152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:38.390152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:38.390152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:38.390152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:38.390152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:38.392012 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:38.392012 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:38.392012 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:30:38.392012 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:30:38.392012 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:30:38.392012 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:30:38.392012 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:30:38.392012 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:30:38.392012 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:30:38.392012 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:30:38.392012 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 607/1239] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:30:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:38.396359 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51dedfa-b61e-4d56-8a40-d8f01e32e6e6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:38.516469 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51dedfa-b61e-4d56-8a40-d8f01e32e6e6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:38.561152 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b3d9e-27fb-4139-924a-ed56b4a84729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:38.561897 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b3d9e-27fb-4139-924a-ed56b4a84729 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:38.562191 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b3d9e-27fb-4139-924a-ed56b4a84729 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:38.562508 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b3d9e-27fb-4139-924a-ed56b4a84729 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:38.563391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b3d9e-27fb-4139-924a-ed56b4a84729 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:38.563745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b3d9e-27fb-4139-924a-ed56b4a84729 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:38.565452 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b3d9e-27fb-4139-924a-ed56b4a84729 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:38.587308 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 633/1240] 10.222.0.59 () {56 vars in 1143 bytes} [Thu Jun 30 10:30:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:38.593836 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9cd37-7700-4ed9-b467-40001ddf36dc None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:38.714549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9cd37-7700-4ed9-b467-40001ddf36dc None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:38.758333 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718a55d-5bf6-4a11-90c0-baceb43cdf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:38.759452 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718a55d-5bf6-4a11-90c0-baceb43cdf7f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:38.760489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718a55d-5bf6-4a11-90c0-baceb43cdf7f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:38.760999 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718a55d-5bf6-4a11-90c0-baceb43cdf7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:38.837656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:38.847139 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718a55d-5bf6-4a11-90c0-baceb43cdf7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:38.848750 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718a55d-5bf6-4a11-90c0-baceb43cdf7f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:38.967986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 608/1241] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:30:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:30:38.974025 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b3d9e-27fb-4139-924a-ed56b4a84729 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:39.017265 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:39.101652 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b3d9e-27fb-4139-924a-ed56b4a84729 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:39.146647 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365dd2bd-c436-44de-b746-d6a6a0c4c54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:39.147467 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365dd2bd-c436-44de-b746-d6a6a0c4c54f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:39.147750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365dd2bd-c436-44de-b746-d6a6a0c4c54f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:39.148028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365dd2bd-c436-44de-b746-d6a6a0c4c54f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:39.161960 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365dd2bd-c436-44de-b746-d6a6a0c4c54f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:39.164727 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365dd2bd-c436-44de-b746-d6a6a0c4c54f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:39.188998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-365dd2bd-c436-44de-b746-d6a6a0c4c54f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:30:39.188998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:39.188998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:39.188998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:39.188998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:39.188998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:39.188998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:39.188998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:39.188998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:39.188998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:39.188998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:39.188998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:39.188998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:30:39.188998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:30:39.188998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:30:39.191045 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:30:39.191045 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:39.191045 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:39.191045 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:39.191045 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:39.191045 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:39.191045 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:39.191045 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:39.191045 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:39.191045 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:39.191045 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:39.191045 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:39.191045 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:39.191045 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:39.191045 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:39.191045 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:39.191045 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:39.191971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:30:39.191971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:30:39.191971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:30:39.191971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:30:39.199746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 634/1242] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:30:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:39.199921 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718a55d-5bf6-4a11-90c0-baceb43cdf7f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:39.316841 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:39.323800 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718a55d-5bf6-4a11-90c0-baceb43cdf7f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:39.363859 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433ed1e-b8b5-4389-bd9f-794bdadceeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:39.365237 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433ed1e-b8b5-4389-bd9f-794bdadceeae None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:39.365703 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433ed1e-b8b5-4389-bd9f-794bdadceeae None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:39.366007 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433ed1e-b8b5-4389-bd9f-794bdadceeae None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:39.366774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433ed1e-b8b5-4389-bd9f-794bdadceeae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:39.367085 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433ed1e-b8b5-4389-bd9f-794bdadceeae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:39.368455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433ed1e-b8b5-4389-bd9f-794bdadceeae None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:39.380371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 609/1243] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:39.386374 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365dd2bd-c436-44de-b746-d6a6a0c4c54f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:39.484716 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:39.508939 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365dd2bd-c436-44de-b746-d6a6a0c4c54f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:39.549448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6333e2a-23d3-4558-baef-09b2f81195fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:39.550394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6333e2a-23d3-4558-baef-09b2f81195fe None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:39.550683 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6333e2a-23d3-4558-baef-09b2f81195fe None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:39.550962 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6333e2a-23d3-4558-baef-09b2f81195fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:39.558100 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6333e2a-23d3-4558-baef-09b2f81195fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:39.559557 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6333e2a-23d3-4558-baef-09b2f81195fe None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:39.575384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-f6333e2a-23d3-4558-baef-09b2f81195fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:30:39.575384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:39.575384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:39.575384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:39.575384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:39.575384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:39.575384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:39.575384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:39.575384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:39.575384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:39.575384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:39.575384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:39.575384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:30:39.575384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:30:39.575384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:30:39.576376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:30:39.576376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:39.576376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:39.576376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:39.576376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:39.576376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:39.576376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:39.576376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:39.576376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:39.576376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:39.576376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:39.576376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:39.576376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:39.576376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:39.576376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:39.576376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:39.576376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:39.581472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:30:39.581472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:30:39.581472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:30:39.581472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:30:39.581472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:30:39.581472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:30:39.581472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:30:39.581472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:30:39.581472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 635/1244] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:30:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:39.583148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433ed1e-b8b5-4389-bd9f-794bdadceeae None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:39.709451 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433ed1e-b8b5-4389-bd9f-794bdadceeae None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:39.758345 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87081e3f-9cb0-43bb-9dcb-fed66fb15fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:39.759218 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87081e3f-9cb0-43bb-9dcb-fed66fb15fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:39.759562 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87081e3f-9cb0-43bb-9dcb-fed66fb15fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:39.759853 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87081e3f-9cb0-43bb-9dcb-fed66fb15fc7 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:39.760822 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87081e3f-9cb0-43bb-9dcb-fed66fb15fc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:39.761138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87081e3f-9cb0-43bb-9dcb-fed66fb15fc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:39.762930 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87081e3f-9cb0-43bb-9dcb-fed66fb15fc7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:39.780562 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 610/1245] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:30:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:39.785422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6333e2a-23d3-4558-baef-09b2f81195fe None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:39.918741 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6333e2a-23d3-4558-baef-09b2f81195fe None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:39.957549 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b402c6e-ea20-4f59-8d19-03fbdc22b838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:39.958588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b402c6e-ea20-4f59-8d19-03fbdc22b838 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:39.958879 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b402c6e-ea20-4f59-8d19-03fbdc22b838 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:39.959205 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b402c6e-ea20-4f59-8d19-03fbdc22b838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:39.960083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b402c6e-ea20-4f59-8d19-03fbdc22b838 None admin] RBAC: Adding query filter params (role.id=1c667697d38a434fbb99c61bc846c4a5, scope.project.id=423854cc8f524ecb8d740d1cb0053856, user.id=48709a771ab64ed38018873313f37c84) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:39.960369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b402c6e-ea20-4f59-8d19-03fbdc22b838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:39.961862 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b402c6e-ea20-4f59-8d19-03fbdc22b838 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:39.972709 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 636/1246] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:30:39 2022] GET /identity/v3/role_assignments?user.id=48709a771ab64ed38018873313f37c84&scope.project.id=423854cc8f524ecb8d740d1cb0053856&role.id=1c667697d38a434fbb99c61bc846c4a5 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:42.131916 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec67eee-9994-4000-b589-5da39a9a9278 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:42.132536 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec67eee-9994-4000-b589-5da39a9a9278 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:42.132536 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec67eee-9994-4000-b589-5da39a9a9278 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:42.133858 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 611/1247] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:30:42.139881 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b00b8-4a6d-4975-a43e-0742a2b3107b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:42.140383 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b00b8-4a6d-4975-a43e-0742a2b3107b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:42.140590 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b00b8-4a6d-4975-a43e-0742a2b3107b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:42.146110 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:42.164739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b48b00b8-4a6d-4975-a43e-0742a2b3107b None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:30:42.166632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b48b00b8-4a6d-4975-a43e-0742a2b3107b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:42.260886 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 637/1248] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:30:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:30:42.282752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec67eee-9994-4000-b589-5da39a9a9278 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:42.306027 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:42.421627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec67eee-9994-4000-b589-5da39a9a9278 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:42.461552 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64403a9b-a15a-4a59-a02a-d1c7991ba25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:42.462852 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64403a9b-a15a-4a59-a02a-d1c7991ba25d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:42.463136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64403a9b-a15a-4a59-a02a-d1c7991ba25d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:42.463411 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64403a9b-a15a-4a59-a02a-d1c7991ba25d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:42.475982 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64403a9b-a15a-4a59-a02a-d1c7991ba25d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:30:42.485760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-64403a9b-a15a-4a59-a02a-d1c7991ba25d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:30:42.485760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:42.485760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:42.485760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:42.485760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:42.485760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:42.485760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:42.485760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:42.485760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:42.485760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:42.485760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:42.485760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:42.485760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:30:42.485760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:30:42.485760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:30:42.485760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:30:42.486827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:30:42.486827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:30:42.486827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:30:42.486827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:30:42.486827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:42.486827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:42.486827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:42.486827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:42.486827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:42.486827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:42.486827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:42.486827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:42.486827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:42.486827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:42.486827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:42.486827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:42.487688 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:42.487688 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:42.487688 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:42.487688 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:42.487688 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:30:42.487688 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:30:42.487688 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:30:42.487688 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:30:42.487688 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:30:42.487688 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:30:42.487688 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:30:42.487688 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:30:42.488345 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 612/1249] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:30:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:42.495770 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b00b8-4a6d-4975-a43e-0742a2b3107b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:42.622042 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b00b8-4a6d-4975-a43e-0742a2b3107b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:42.659992 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:42.667071 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bb2f1-071f-45b6-a62e-0265fe87620b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:42.667977 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bb2f1-071f-45b6-a62e-0265fe87620b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:42.668449 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bb2f1-071f-45b6-a62e-0265fe87620b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:42.668774 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bb2f1-071f-45b6-a62e-0265fe87620b None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:42.669558 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223bb2f1-071f-45b6-a62e-0265fe87620b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:42.669867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223bb2f1-071f-45b6-a62e-0265fe87620b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:42.671240 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223bb2f1-071f-45b6-a62e-0265fe87620b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:42.681502 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 638/1250] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:30:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:30:42.687362 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64403a9b-a15a-4a59-a02a-d1c7991ba25d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:42.797068 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:42.828154 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64403a9b-a15a-4a59-a02a-d1c7991ba25d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:42.872156 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ccc49-e727-4ea6-8743-29881cc919d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:42.872976 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ccc49-e727-4ea6-8743-29881cc919d8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:42.873255 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ccc49-e727-4ea6-8743-29881cc919d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:42.873530 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ccc49-e727-4ea6-8743-29881cc919d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:42.886597 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ccc49-e727-4ea6-8743-29881cc919d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:42.888261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ccc49-e727-4ea6-8743-29881cc919d8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:42.912722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-362ccc49-e727-4ea6-8743-29881cc919d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:30:42.912722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:42.912722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:42.912722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:42.912722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:42.912722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:42.912722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:42.912722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:42.912722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:42.912722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:42.912722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:42.912722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:42.912722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:30:42.912722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:30:42.912722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:30:42.913938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:30:42.913938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:42.913938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:42.913938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:42.913938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:42.913938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:42.913938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:42.913938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:42.913938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:42.913938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:42.913938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:42.913938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:42.913938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:42.913938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:42.913938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:42.913938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:42.913938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:42.915073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:30:42.915073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:30:42.915073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:30:42.915073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:30:42.919013 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 613/1251] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:30:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:42.919900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bb2f1-071f-45b6-a62e-0265fe87620b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:43.058347 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bb2f1-071f-45b6-a62e-0265fe87620b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:43.101731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1194c-ed7f-411b-8644-e2d2e2da305d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:43.103006 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1194c-ed7f-411b-8644-e2d2e2da305d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:43.103311 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1194c-ed7f-411b-8644-e2d2e2da305d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:43.103639 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1194c-ed7f-411b-8644-e2d2e2da305d None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:43.106991 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1194c-ed7f-411b-8644-e2d2e2da305d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:43.107401 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1194c-ed7f-411b-8644-e2d2e2da305d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:43.109881 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1194c-ed7f-411b-8644-e2d2e2da305d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:43.124173 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 639/1252] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:43.130834 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ccc49-e727-4ea6-8743-29881cc919d8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:43.252165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ccc49-e727-4ea6-8743-29881cc919d8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:43.282664 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:43.292426 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cae3d-8e2e-4a4d-8d6f-a3e485efd2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:43.293358 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cae3d-8e2e-4a4d-8d6f-a3e485efd2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:43.293632 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cae3d-8e2e-4a4d-8d6f-a3e485efd2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:43.294019 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cae3d-8e2e-4a4d-8d6f-a3e485efd2d8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:43.303547 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cae3d-8e2e-4a4d-8d6f-a3e485efd2d8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:43.305727 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cae3d-8e2e-4a4d-8d6f-a3e485efd2d8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:43.324625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-b12cae3d-8e2e-4a4d-8d6f-a3e485efd2d8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:30:43.324625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:43.324625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:43.324625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:43.324625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:43.324625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:43.324625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:43.324625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:43.324625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:43.324625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:43.324625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:43.324625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:43.324625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:30:43.324625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:30:43.324625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:30:43.324625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:30:43.325660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:43.325660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:43.325660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:30:43.325660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:30:43.325660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:30:43.325660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:30:43.325660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:43.325660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:43.325660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:43.325660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:43.325660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:43.325660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:43.325660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:43.325660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:43.325660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:43.325660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:43.325660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:43.325660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:43.327017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:43.327017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:43.327017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:30:43.327017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:30:43.327017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:30:43.327017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:30:43.327017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:30:43.327017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:30:43.327017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:30:43.327017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:30:43.327017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 614/1253] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:30:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:43.332188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1194c-ed7f-411b-8644-e2d2e2da305d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:43.397563 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:43.446311 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1194c-ed7f-411b-8644-e2d2e2da305d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:43.494314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b70229-d5ef-4506-9ebb-908231bb0e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:43.495276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b70229-d5ef-4506-9ebb-908231bb0e65 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:43.495576 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b70229-d5ef-4506-9ebb-908231bb0e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:43.495931 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b70229-d5ef-4506-9ebb-908231bb0e65 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:43.497187 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b70229-d5ef-4506-9ebb-908231bb0e65 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:43.497660 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b70229-d5ef-4506-9ebb-908231bb0e65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:43.499457 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b70229-d5ef-4506-9ebb-908231bb0e65 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:43.519891 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 640/1254] 10.222.0.59 () {56 vars in 1143 bytes} [Thu Jun 30 10:30:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:43.528057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cae3d-8e2e-4a4d-8d6f-a3e485efd2d8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:43.657715 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cae3d-8e2e-4a4d-8d6f-a3e485efd2d8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:43.696395 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e66c9-6028-4dd7-ace2-21fd18dce024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:43.697697 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e66c9-6028-4dd7-ace2-21fd18dce024 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:43.697975 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e66c9-6028-4dd7-ace2-21fd18dce024 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:43.698246 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e66c9-6028-4dd7-ace2-21fd18dce024 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:43.762267 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:43.779269 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e66c9-6028-4dd7-ace2-21fd18dce024 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:43.781025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e66c9-6028-4dd7-ace2-21fd18dce024 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:43.920770 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 615/1255] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:30:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:30:43.922903 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b70229-d5ef-4506-9ebb-908231bb0e65 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:44.058822 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b70229-d5ef-4506-9ebb-908231bb0e65 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:44.080848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:44.106879 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467be8f2-0256-4584-acbb-1decf3d9d59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:44.108211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467be8f2-0256-4584-acbb-1decf3d9d59c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:44.108838 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467be8f2-0256-4584-acbb-1decf3d9d59c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:44.109127 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467be8f2-0256-4584-acbb-1decf3d9d59c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:44.122351 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467be8f2-0256-4584-acbb-1decf3d9d59c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:44.123969 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467be8f2-0256-4584-acbb-1decf3d9d59c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:44.148100 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-467be8f2-0256-4584-acbb-1decf3d9d59c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:30:44.148100 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:44.148100 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:44.148100 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:44.148100 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:44.148100 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:44.148100 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:44.148100 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:44.148100 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:44.148100 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:44.148100 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:44.148100 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:44.148100 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:30:44.148100 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:30:44.148100 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:30:44.149268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:30:44.149268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:44.149268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:44.149268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:44.149268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:44.149268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:44.149268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:44.149268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:44.149268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:44.149268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:44.149268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:44.149268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:44.149268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:44.149268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:44.149268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:44.149268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:44.149268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:44.150522 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:30:44.150522 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:30:44.150522 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:30:44.150522 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:30:44.152415 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 641/1256] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:30:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:30:44.158728 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e66c9-6028-4dd7-ace2-21fd18dce024 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:44.266741 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:44.280537 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e66c9-6028-4dd7-ace2-21fd18dce024 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:44.320288 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917580d-dc0a-48bf-9cff-78ad8c110779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:44.321102 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917580d-dc0a-48bf-9cff-78ad8c110779 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:44.321419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917580d-dc0a-48bf-9cff-78ad8c110779 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:44.321815 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917580d-dc0a-48bf-9cff-78ad8c110779 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:44.322759 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917580d-dc0a-48bf-9cff-78ad8c110779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:44.323181 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917580d-dc0a-48bf-9cff-78ad8c110779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:44.324768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917580d-dc0a-48bf-9cff-78ad8c110779 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:44.340533 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 616/1257] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:44.345485 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467be8f2-0256-4584-acbb-1decf3d9d59c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:44.485639 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467be8f2-0256-4584-acbb-1decf3d9d59c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:44.523662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65303355-3b05-4318-b8e3-7c53ecfb948b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:44.524739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65303355-3b05-4318-b8e3-7c53ecfb948b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:44.525640 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65303355-3b05-4318-b8e3-7c53ecfb948b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:44.525935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65303355-3b05-4318-b8e3-7c53ecfb948b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:44.533975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65303355-3b05-4318-b8e3-7c53ecfb948b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:44.535429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65303355-3b05-4318-b8e3-7c53ecfb948b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:44.552050 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-65303355-3b05-4318-b8e3-7c53ecfb948b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:30:44.552050 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:44.552050 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:44.552050 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:44.552050 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:44.552050 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:44.552050 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:44.552050 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:44.552050 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:44.552050 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:44.552050 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:44.552050 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:44.552050 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:30:44.552050 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:30:44.552050 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:30:44.553103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:30:44.553103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:44.553103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:44.553103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:44.553103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:44.553103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:44.553103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:44.553103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:44.553103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:44.553103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:44.553103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:44.553103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:44.553103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:44.553103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:44.553103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:44.553103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:44.553103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:44.554051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:30:44.554051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:30:44.554051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:30:44.554051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:30:44.554051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:30:44.554051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:30:44.554051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:30:44.554051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:30:44.558670 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 642/1258] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:30:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:44.559869 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917580d-dc0a-48bf-9cff-78ad8c110779 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:44.688701 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917580d-dc0a-48bf-9cff-78ad8c110779 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:44.731167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65b74a-672f-4eb5-994b-1ca91daeb557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:44.731937 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65b74a-672f-4eb5-994b-1ca91daeb557 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:44.732235 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65b74a-672f-4eb5-994b-1ca91daeb557 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:44.732567 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65b74a-672f-4eb5-994b-1ca91daeb557 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:44.733359 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65b74a-672f-4eb5-994b-1ca91daeb557 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:44.733671 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65b74a-672f-4eb5-994b-1ca91daeb557 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:44.735112 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65b74a-672f-4eb5-994b-1ca91daeb557 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:44.750539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 617/1259] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:30:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:44.757242 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65303355-3b05-4318-b8e3-7c53ecfb948b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:44.791870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:44.888773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65303355-3b05-4318-b8e3-7c53ecfb948b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:44.933478 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac75c08-4fc2-46b6-9e61-d9ecba51c31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:44.934183 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac75c08-4fc2-46b6-9e61-d9ecba51c31e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:44.934484 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac75c08-4fc2-46b6-9e61-d9ecba51c31e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:44.934804 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac75c08-4fc2-46b6-9e61-d9ecba51c31e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:44.935653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac75c08-4fc2-46b6-9e61-d9ecba51c31e None admin] RBAC: Adding query filter params (role.id=ab64ea6d0475430195af26a049485569, scope.project.id=423854cc8f524ecb8d740d1cb0053856, user.id=48709a771ab64ed38018873313f37c84) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:44.935968 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac75c08-4fc2-46b6-9e61-d9ecba51c31e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:44.937578 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac75c08-4fc2-46b6-9e61-d9ecba51c31e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:44.943755 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 643/1260] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:30:44 2022] GET /identity/v3/role_assignments?user.id=48709a771ab64ed38018873313f37c84&scope.project.id=423854cc8f524ecb8d740d1cb0053856&role.id=ab64ea6d0475430195af26a049485569 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:47.017319 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f8851-4f2f-495c-8008-46ecabc7a611 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:47.017877 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f8851-4f2f-495c-8008-46ecabc7a611 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:47.017877 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f8851-4f2f-495c-8008-46ecabc7a611 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:47.019232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 618/1261] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:30:47.024356 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5bb98-8a59-4f1d-8e06-739fb3d0b928 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:47.025288 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5bb98-8a59-4f1d-8e06-739fb3d0b928 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:47.025469 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5bb98-8a59-4f1d-8e06-739fb3d0b928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:47.045897 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e0d5bb98-8a59-4f1d-8e06-739fb3d0b928 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:30:47.047307 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e0d5bb98-8a59-4f1d-8e06-739fb3d0b928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:47.119859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 644/1262] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:30:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:30:47.142763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f8851-4f2f-495c-8008-46ecabc7a611 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:47.154087 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:47.242173 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f8851-4f2f-495c-8008-46ecabc7a611 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:47.276281 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c500027-0467-4597-9d56-852549e781e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:47.277030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c500027-0467-4597-9d56-852549e781e6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:47.277317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c500027-0467-4597-9d56-852549e781e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:47.277595 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c500027-0467-4597-9d56-852549e781e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:47.287415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c500027-0467-4597-9d56-852549e781e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:30:47.294926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-2c500027-0467-4597-9d56-852549e781e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:30:47.294926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:47.294926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:47.294926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:47.294926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:47.294926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:47.294926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:47.294926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:47.294926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:47.294926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:47.294926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:47.294926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:47.294926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:30:47.294926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:30:47.294926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:30:47.294926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:30:47.296006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:30:47.296006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:30:47.296006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:30:47.296006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:30:47.296006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:47.296006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:47.296006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:47.296006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:47.296006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:47.296006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:47.296006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:47.296006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:47.296006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:47.296006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:47.296006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:47.296006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:47.296909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:47.296909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:47.296909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:47.296909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:47.296909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:30:47.296909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:30:47.296909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:30:47.296909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:30:47.296909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:30:47.296909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:30:47.296909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:30:47.296909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:30:47.296909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 619/1263] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:30:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:47.302134 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5bb98-8a59-4f1d-8e06-739fb3d0b928 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:47.319683 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:47.397515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5bb98-8a59-4f1d-8e06-739fb3d0b928 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:47.429867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f998c-8378-4e0c-ade9-9a6e128aad40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:47.430515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f998c-8378-4e0c-ade9-9a6e128aad40 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:47.430797 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f998c-8378-4e0c-ade9-9a6e128aad40 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:47.431096 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f998c-8378-4e0c-ade9-9a6e128aad40 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:47.431819 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f998c-8378-4e0c-ade9-9a6e128aad40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:47.432125 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f998c-8378-4e0c-ade9-9a6e128aad40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:47.433498 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f998c-8378-4e0c-ade9-9a6e128aad40 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:47.441225 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 645/1264] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:30:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:47.447507 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c500027-0467-4597-9d56-852549e781e6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:47.513385 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:47.545980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c500027-0467-4597-9d56-852549e781e6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:47.578795 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c376c0-7c0e-43f9-ae5f-646385d0a998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:47.579573 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c376c0-7c0e-43f9-ae5f-646385d0a998 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:47.579856 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c376c0-7c0e-43f9-ae5f-646385d0a998 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:47.580133 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c376c0-7c0e-43f9-ae5f-646385d0a998 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:47.590409 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c376c0-7c0e-43f9-ae5f-646385d0a998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:47.591863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c376c0-7c0e-43f9-ae5f-646385d0a998 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:47.608751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-37c376c0-7c0e-43f9-ae5f-646385d0a998 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:30:47.608751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:47.608751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:47.608751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:47.608751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:47.608751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:47.608751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:47.608751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:47.608751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:47.608751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:47.608751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:47.608751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:47.608751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:30:47.608751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:30:47.608751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:30:47.609772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:30:47.609772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:47.609772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:47.609772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:47.609772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:47.609772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:47.609772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:47.609772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:47.609772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:47.609772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:47.609772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:47.609772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:47.609772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:47.609772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:47.609772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:47.609772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:47.609772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:47.615413 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:30:47.615413 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:30:47.615413 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:30:47.615413 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:30:47.615413 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 620/1265] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:30:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:47.615754 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f998c-8378-4e0c-ade9-9a6e128aad40 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:47.693988 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:47.713465 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f998c-8378-4e0c-ade9-9a6e128aad40 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:47.745938 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00b68d-db9a-4d2a-8902-bc42c851bae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:47.746581 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00b68d-db9a-4d2a-8902-bc42c851bae8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:47.746863 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00b68d-db9a-4d2a-8902-bc42c851bae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:47.747138 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00b68d-db9a-4d2a-8902-bc42c851bae8 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:47.747836 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00b68d-db9a-4d2a-8902-bc42c851bae8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:47.748141 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00b68d-db9a-4d2a-8902-bc42c851bae8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:47.749524 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00b68d-db9a-4d2a-8902-bc42c851bae8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:47.761514 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 646/1266] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:47.767108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c376c0-7c0e-43f9-ae5f-646385d0a998 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:47.871192 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c376c0-7c0e-43f9-ae5f-646385d0a998 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:47.890534 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:47.905027 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9a323-9e56-4117-87ef-73b2649dd203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:47.905824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9a323-9e56-4117-87ef-73b2649dd203 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:47.906106 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9a323-9e56-4117-87ef-73b2649dd203 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:47.906383 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9a323-9e56-4117-87ef-73b2649dd203 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:47.913816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9a323-9e56-4117-87ef-73b2649dd203 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:47.915261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9a323-9e56-4117-87ef-73b2649dd203 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:47.929826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-00c9a323-9e56-4117-87ef-73b2649dd203 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:30:47.929826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:47.929826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:47.929826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:47.929826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:47.929826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:47.929826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:47.929826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:47.929826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:47.929826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:47.929826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:47.929826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:47.929826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:30:47.929826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:30:47.929826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:30:47.929826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:30:47.930810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:47.930810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:47.930810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:30:47.930810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:30:47.930810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:30:47.930810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:30:47.930810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:47.930810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:47.930810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:47.930810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:47.930810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:47.930810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:47.930810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:47.930810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:47.930810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:47.930810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:47.930810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:47.930810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:47.932327 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:47.932327 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:47.932327 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:30:47.932327 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:30:47.932327 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:30:47.932327 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:30:47.932327 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:30:47.932327 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:30:47.932327 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:30:47.932327 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:30:47.932327 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 621/1267] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:30:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:47.937604 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00b68d-db9a-4d2a-8902-bc42c851bae8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:48.039686 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00b68d-db9a-4d2a-8902-bc42c851bae8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:48.082935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba70350-5495-433b-b563-64c27c438a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:48.083763 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba70350-5495-433b-b563-64c27c438a01 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:48.084116 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba70350-5495-433b-b563-64c27c438a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:48.084545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba70350-5495-433b-b563-64c27c438a01 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:48.085415 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba70350-5495-433b-b563-64c27c438a01 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:48.085732 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba70350-5495-433b-b563-64c27c438a01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:48.087155 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba70350-5495-433b-b563-64c27c438a01 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:48.095860 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:48.106018 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 647/1268] 10.222.0.59 () {56 vars in 1143 bytes} [Thu Jun 30 10:30:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:48.111611 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9a323-9e56-4117-87ef-73b2649dd203 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:48.208669 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9a323-9e56-4117-87ef-73b2649dd203 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:48.241186 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a95c20-f4e0-4ef1-90a3-36f23da1fa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:48.241955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a95c20-f4e0-4ef1-90a3-36f23da1fa4f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:48.242239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a95c20-f4e0-4ef1-90a3-36f23da1fa4f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:48.242516 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a95c20-f4e0-4ef1-90a3-36f23da1fa4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:48.253301 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a95c20-f4e0-4ef1-90a3-36f23da1fa4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:48.254751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a95c20-f4e0-4ef1-90a3-36f23da1fa4f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:48.271904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-78a95c20-f4e0-4ef1-90a3-36f23da1fa4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:30:48.271904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:48.271904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:48.271904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:48.271904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:48.271904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:48.271904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:48.271904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:48.271904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:48.271904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:48.271904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:48.271904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:48.271904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:30:48.271904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:30:48.271904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:30:48.273086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:30:48.273086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:48.273086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:48.273086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:48.273086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:48.273086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:48.273086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:48.273086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:48.273086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:48.273086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:48.273086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:48.273086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:48.273086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:48.273086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:48.273086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:48.273086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:48.273086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:48.274238 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:30:48.274238 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:30:48.274238 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:30:48.274238 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:30:48.274238 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 622/1269] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:48.279367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba70350-5495-433b-b563-64c27c438a01 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:48.376565 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba70350-5495-433b-b563-64c27c438a01 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:48.408856 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d18cea-d153-4cfd-a3d9-52b19a37024f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:48.409498 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d18cea-d153-4cfd-a3d9-52b19a37024f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:48.409777 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d18cea-d153-4cfd-a3d9-52b19a37024f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:48.410050 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d18cea-d153-4cfd-a3d9-52b19a37024f None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:48.410744 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d18cea-d153-4cfd-a3d9-52b19a37024f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:48.411051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d18cea-d153-4cfd-a3d9-52b19a37024f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:48.412391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d18cea-d153-4cfd-a3d9-52b19a37024f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:48.423599 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 648/1270] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:48.429140 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a95c20-f4e0-4ef1-90a3-36f23da1fa4f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:48.459944 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:48.527808 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a95c20-f4e0-4ef1-90a3-36f23da1fa4f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:48.560235 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5037efd-68c9-4343-82b1-0295510c3377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:48.561028 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5037efd-68c9-4343-82b1-0295510c3377 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:48.561315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5037efd-68c9-4343-82b1-0295510c3377 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:48.561594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5037efd-68c9-4343-82b1-0295510c3377 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:48.568101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5037efd-68c9-4343-82b1-0295510c3377 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:48.569575 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5037efd-68c9-4343-82b1-0295510c3377 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:48.583500 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-f5037efd-68c9-4343-82b1-0295510c3377 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:30:48.583500 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:48.583500 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:48.583500 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:48.583500 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:48.583500 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:48.583500 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:48.583500 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:48.583500 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:48.583500 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:48.583500 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:48.583500 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:48.583500 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:30:48.583500 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:30:48.583500 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:30:48.584553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:30:48.584553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:48.584553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:48.584553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:48.584553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:48.584553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:48.584553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:48.584553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:48.584553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:48.584553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:48.584553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:48.584553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:48.584553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:48.584553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:48.584553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:48.584553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:48.584553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:48.585624 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:30:48.585624 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:30:48.585624 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:30:48.585624 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:30:48.585624 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:30:48.585624 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:30:48.585624 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:30:48.585624 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:30:48.585624 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 623/1271] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:30:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:48.590891 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d18cea-d153-4cfd-a3d9-52b19a37024f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:48.647764 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:48.688458 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d18cea-d153-4cfd-a3d9-52b19a37024f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:48.722112 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157feb5-5dd0-449d-9125-48ffde6c60fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:48.722698 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157feb5-5dd0-449d-9125-48ffde6c60fe None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:48.722983 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157feb5-5dd0-449d-9125-48ffde6c60fe None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:48.723260 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157feb5-5dd0-449d-9125-48ffde6c60fe None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:48.724027 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157feb5-5dd0-449d-9125-48ffde6c60fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:48.724337 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157feb5-5dd0-449d-9125-48ffde6c60fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:48.726057 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157feb5-5dd0-449d-9125-48ffde6c60fe None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:48.737509 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 649/1272] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:30:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:48.743328 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5037efd-68c9-4343-82b1-0295510c3377 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:48.830315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:48.839245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5037efd-68c9-4343-82b1-0295510c3377 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:48.871133 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348ac28-9d25-4a25-8151-8b75bb509b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:48.871990 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348ac28-9d25-4a25-8151-8b75bb509b26 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:48.872271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348ac28-9d25-4a25-8151-8b75bb509b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:48.872565 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348ac28-9d25-4a25-8151-8b75bb509b26 None admin] PATH_INFO: `/v3/projects/423854cc8f524ecb8d740d1cb0053856/users/48709a771ab64ed38018873313f37c84/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:48.874449 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348ac28-9d25-4a25-8151-8b75bb509b26 None admin] RBAC: Authorizing `identity:create_grant(project_id=423854cc8f524ecb8d740d1cb0053856, user_id=48709a771ab64ed38018873313f37c84, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:48.875863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348ac28-9d25-4a25-8151-8b75bb509b26 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:48.888333 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 624/1273] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 30 10:30:48 2022] PUT /identity/v3/projects/423854cc8f524ecb8d740d1cb0053856/users/48709a771ab64ed38018873313f37c84/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:30:50.886324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bd10f-dec6-44fc-af37-142d07046da1 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:50.886904 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bd10f-dec6-44fc-af37-142d07046da1 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:50.886904 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bd10f-dec6-44fc-af37-142d07046da1 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:50.888272 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 650/1274] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:30:50.893386 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2126a91-e373-4f85-aff1-28ec26ae9558 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:50.893774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2126a91-e373-4f85-aff1-28ec26ae9558 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:50.893951 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2126a91-e373-4f85-aff1-28ec26ae9558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:50.911573 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a2126a91-e373-4f85-aff1-28ec26ae9558 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:30:50.912796 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a2126a91-e373-4f85-aff1-28ec26ae9558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:50.976922 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 625/1275] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:30:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:30:51.000101 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bd10f-dec6-44fc-af37-142d07046da1 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:51.101321 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bd10f-dec6-44fc-af37-142d07046da1 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:51.118159 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:51.135110 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff9882-97c4-4c95-99c8-c0ae523feb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:51.135904 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff9882-97c4-4c95-99c8-c0ae523feb46 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:51.136190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff9882-97c4-4c95-99c8-c0ae523feb46 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:51.136530 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff9882-97c4-4c95-99c8-c0ae523feb46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:51.146284 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff9882-97c4-4c95-99c8-c0ae523feb46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:30:51.154448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-70ff9882-97c4-4c95-99c8-c0ae523feb46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:30:51.154448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:51.154448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:51.154448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:51.154448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:51.154448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:51.154448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:51.154448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:51.154448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:51.154448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:51.154448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:51.154448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:51.154448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:30:51.154448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:30:51.154448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:30:51.154448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:30:51.155436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:30:51.155436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:30:51.155436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:30:51.155436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:30:51.155436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:51.155436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:51.155436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:51.155436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:51.155436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:51.155436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:51.155436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:51.155436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:51.155436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:51.155436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:51.155436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:51.155436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:51.156384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:51.156384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:51.156384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:51.156384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:51.156384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:30:51.156384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:30:51.156384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:30:51.156384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:30:51.156384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:30:51.156384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:30:51.156384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:30:51.156384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:30:51.156384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 651/1276] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 30 10:30:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:51.161545 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2126a91-e373-4f85-aff1-28ec26ae9558 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:51.239003 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:51.256875 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2126a91-e373-4f85-aff1-28ec26ae9558 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:51.289720 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b1a91-d744-4dab-8ae6-3c7551ae2b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:51.290368 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b1a91-d744-4dab-8ae6-3c7551ae2b21 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:51.290648 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b1a91-d744-4dab-8ae6-3c7551ae2b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:51.290919 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b1a91-d744-4dab-8ae6-3c7551ae2b21 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:51.291641 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b1a91-d744-4dab-8ae6-3c7551ae2b21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:51.291943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b1a91-d744-4dab-8ae6-3c7551ae2b21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:51.293346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b1a91-d744-4dab-8ae6-3c7551ae2b21 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:51.301126 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 626/1277] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 30 10:30:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:51.307219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff9882-97c4-4c95-99c8-c0ae523feb46 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:51.404288 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff9882-97c4-4c95-99c8-c0ae523feb46 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:51.436527 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a72d9-801f-46f2-8239-344c20f5a400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:51.437320 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a72d9-801f-46f2-8239-344c20f5a400 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:51.437602 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a72d9-801f-46f2-8239-344c20f5a400 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:51.437877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a72d9-801f-46f2-8239-344c20f5a400 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:51.449414 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a72d9-801f-46f2-8239-344c20f5a400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:51.450853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a72d9-801f-46f2-8239-344c20f5a400 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:51.467248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-189a72d9-801f-46f2-8239-344c20f5a400 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:30:51.467248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:51.467248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:51.467248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:51.467248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:51.467248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:51.467248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:51.467248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:51.467248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:51.467248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:51.467248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:51.467248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:51.467248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:30:51.467248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:30:51.467248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:30:51.468270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:30:51.468270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:51.468270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:51.468270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:51.468270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:51.468270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:51.468270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:51.468270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:51.468270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:51.468270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:51.468270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:51.468270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:51.468270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:51.468270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:51.468270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:51.468270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:51.468270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:51.473203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:30:51.473203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:30:51.473203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:30:51.473203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:30:51.473203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 652/1278] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:30:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:51.474201 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b1a91-d744-4dab-8ae6-3c7551ae2b21 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:51.571267 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b1a91-d744-4dab-8ae6-3c7551ae2b21 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:51.605222 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550a9e0-dc6e-41c7-8331-7212ce36aa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:51.605864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550a9e0-dc6e-41c7-8331-7212ce36aa89 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:51.606153 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550a9e0-dc6e-41c7-8331-7212ce36aa89 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:51.606432 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550a9e0-dc6e-41c7-8331-7212ce36aa89 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:51.607151 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550a9e0-dc6e-41c7-8331-7212ce36aa89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:51.607460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550a9e0-dc6e-41c7-8331-7212ce36aa89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:51.608972 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550a9e0-dc6e-41c7-8331-7212ce36aa89 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:51.620952 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 627/1279] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:51.629717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a72d9-801f-46f2-8239-344c20f5a400 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:51.659809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:51.729651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a72d9-801f-46f2-8239-344c20f5a400 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:51.761320 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06202243-13ef-4676-bcda-be40203d677b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:51.762097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06202243-13ef-4676-bcda-be40203d677b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:51.762372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06202243-13ef-4676-bcda-be40203d677b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:51.762640 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06202243-13ef-4676-bcda-be40203d677b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:51.769737 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06202243-13ef-4676-bcda-be40203d677b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:51.771145 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06202243-13ef-4676-bcda-be40203d677b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:51.784811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-06202243-13ef-4676-bcda-be40203d677b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:30:51.784811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:51.784811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:51.784811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:51.784811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:51.784811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:51.784811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:51.784811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:51.784811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:51.784811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:51.784811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:51.784811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:51.784811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:30:51.784811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:30:51.784811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:30:51.784811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:30:51.785963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:51.785963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:51.785963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:30:51.785963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:30:51.785963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:30:51.785963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:30:51.785963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:51.785963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:51.785963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:51.785963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:51.785963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:51.785963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:51.785963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:51.785963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:51.785963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:51.785963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:51.785963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:51.785963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:51.787146 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:51.787146 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:51.787146 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:30:51.787146 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:30:51.787146 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:30:51.787146 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:30:51.787146 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:30:51.787146 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:30:51.787146 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:30:51.787146 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:30:51.787146 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 653/1280] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:30:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:51.792410 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550a9e0-dc6e-41c7-8331-7212ce36aa89 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:51.796174 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:51.888362 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550a9e0-dc6e-41c7-8331-7212ce36aa89 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:51.921144 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093b42b-7220-4867-8dcf-7fb4c5b8ab1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:51.921733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093b42b-7220-4867-8dcf-7fb4c5b8ab1c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:51.922012 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093b42b-7220-4867-8dcf-7fb4c5b8ab1c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:51.922291 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093b42b-7220-4867-8dcf-7fb4c5b8ab1c None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:51.923109 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093b42b-7220-4867-8dcf-7fb4c5b8ab1c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:51.923425 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093b42b-7220-4867-8dcf-7fb4c5b8ab1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:51.924878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093b42b-7220-4867-8dcf-7fb4c5b8ab1c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:51.941831 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 628/1281] 10.222.0.59 () {56 vars in 1143 bytes} [Thu Jun 30 10:30:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:51.947791 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06202243-13ef-4676-bcda-be40203d677b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:52.047134 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:52.058938 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06202243-13ef-4676-bcda-be40203d677b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:52.091393 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef2dfa-6e38-4570-926d-7c430d06213a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:52.092033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef2dfa-6e38-4570-926d-7c430d06213a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:52.092314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef2dfa-6e38-4570-926d-7c430d06213a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:52.092625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef2dfa-6e38-4570-926d-7c430d06213a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:52.156142 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef2dfa-6e38-4570-926d-7c430d06213a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:52.157603 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef2dfa-6e38-4570-926d-7c430d06213a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:52.241550 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:52.251599 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 654/1282] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 30 10:30:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 10:30:52.257871 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093b42b-7220-4867-8dcf-7fb4c5b8ab1c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:52.319226 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:52.357400 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093b42b-7220-4867-8dcf-7fb4c5b8ab1c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:52.389952 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8ebdc-26b0-4505-9ba6-8caec3f26a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:52.390728 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8ebdc-26b0-4505-9ba6-8caec3f26a88 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:52.391013 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8ebdc-26b0-4505-9ba6-8caec3f26a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:52.391292 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8ebdc-26b0-4505-9ba6-8caec3f26a88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:52.401812 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8ebdc-26b0-4505-9ba6-8caec3f26a88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:52.403282 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8ebdc-26b0-4505-9ba6-8caec3f26a88 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:52.420614 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-18b8ebdc-26b0-4505-9ba6-8caec3f26a88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:30:52.420614 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:52.420614 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:52.420614 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:52.420614 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:52.420614 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:52.420614 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:52.420614 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:52.420614 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:52.420614 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:52.420614 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:52.420614 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:52.420614 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:30:52.420614 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:30:52.420614 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:30:52.421657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:30:52.421657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:52.421657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:52.421657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:52.421657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:52.421657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:52.421657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:52.421657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:52.421657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:52.421657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:52.421657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:52.421657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:52.421657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:52.421657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:52.421657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:52.421657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:52.421657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:52.422897 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:30:52.422897 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:30:52.422897 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:30:52.422897 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:30:52.422897 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 629/1283] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:30:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:52.427475 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef2dfa-6e38-4570-926d-7c430d06213a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:52.521515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef2dfa-6e38-4570-926d-7c430d06213a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:52.553640 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502fb01-35ba-41cc-a672-d5ac780aadd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:52.554273 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502fb01-35ba-41cc-a672-d5ac780aadd9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:52.554548 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502fb01-35ba-41cc-a672-d5ac780aadd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:52.554820 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502fb01-35ba-41cc-a672-d5ac780aadd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:52.555512 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502fb01-35ba-41cc-a672-d5ac780aadd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:52.555833 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502fb01-35ba-41cc-a672-d5ac780aadd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:52.557266 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502fb01-35ba-41cc-a672-d5ac780aadd9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:52.567881 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 655/1284] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 30 10:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:52.573807 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8ebdc-26b0-4505-9ba6-8caec3f26a88 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:52.672833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8ebdc-26b0-4505-9ba6-8caec3f26a88 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:52.688856 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:52.709581 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766de465-2a58-45dd-a2a4-eb277d00bdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:52.710354 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766de465-2a58-45dd-a2a4-eb277d00bdfd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:52.710633 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766de465-2a58-45dd-a2a4-eb277d00bdfd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:52.710903 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766de465-2a58-45dd-a2a4-eb277d00bdfd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:52.717964 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766de465-2a58-45dd-a2a4-eb277d00bdfd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:52.719395 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766de465-2a58-45dd-a2a4-eb277d00bdfd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:52.732857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-766de465-2a58-45dd-a2a4-eb277d00bdfd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:30:52.732857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:52.732857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:52.732857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:52.732857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:52.732857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:52.732857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:52.732857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:52.732857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:52.732857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:52.732857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:52.732857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:52.732857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:30:52.732857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:30:52.732857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:30:52.733923 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:30:52.733923 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:52.733923 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:52.733923 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:52.733923 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:52.733923 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:52.733923 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:52.733923 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:52.733923 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:52.733923 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:52.733923 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:52.733923 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:52.733923 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:52.733923 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:52.733923 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:52.733923 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:52.733923 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:52.735025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:30:52.735025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:30:52.735025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:30:52.735025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:30:52.735025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:30:52.735025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:30:52.735025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:30:52.735025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: ERROR keystone.server.flask.application Jun 30 10:30:52.735025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 630/1285] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 30 10:30:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:52.739812 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502fb01-35ba-41cc-a672-d5ac780aadd9 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:52.787806 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:52.835675 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502fb01-35ba-41cc-a672-d5ac780aadd9 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:52.866835 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93967e45-3b02-4314-a230-c10795521a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:52.867464 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93967e45-3b02-4314-a230-c10795521a27 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:52.867742 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93967e45-3b02-4314-a230-c10795521a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:52.868015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93967e45-3b02-4314-a230-c10795521a27 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:52.869312 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93967e45-3b02-4314-a230-c10795521a27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:52.869616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93967e45-3b02-4314-a230-c10795521a27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:52.871020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93967e45-3b02-4314-a230-c10795521a27 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:52.882376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 656/1286] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 30 10:30:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:52.888849 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766de465-2a58-45dd-a2a4-eb277d00bdfd None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:52.987064 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766de465-2a58-45dd-a2a4-eb277d00bdfd None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:53.020192 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77532ac-a52e-4289-91ad-257fc25d068e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:53.020859 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77532ac-a52e-4289-91ad-257fc25d068e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:53.021147 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77532ac-a52e-4289-91ad-257fc25d068e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:53.021428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77532ac-a52e-4289-91ad-257fc25d068e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:53.022247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77532ac-a52e-4289-91ad-257fc25d068e None admin] RBAC: Adding query filter params (role.id=ab64ea6d0475430195af26a049485569, scope.project.id=423854cc8f524ecb8d740d1cb0053856, user.id=48709a771ab64ed38018873313f37c84) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:53.022563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77532ac-a52e-4289-91ad-257fc25d068e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:53.023995 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77532ac-a52e-4289-91ad-257fc25d068e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:53.030034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 631/1287] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 30 10:30:52 2022] GET /identity/v3/role_assignments?user.id=48709a771ab64ed38018873313f37c84&scope.project.id=423854cc8f524ecb8d740d1cb0053856&role.id=ab64ea6d0475430195af26a049485569 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:55.078696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc878e-7847-4b64-82bd-09029efc09ae None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:55.079248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc878e-7847-4b64-82bd-09029efc09ae None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:55.079248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc878e-7847-4b64-82bd-09029efc09ae None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:55.080646 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 657/1288] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:30:55.085759 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f91af3-0142-4f5b-9179-54e4770d4a16 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:55.086189 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f91af3-0142-4f5b-9179-54e4770d4a16 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:55.086321 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f91af3-0142-4f5b-9179-54e4770d4a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:55.103986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c2f91af3-0142-4f5b-9179-54e4770d4a16 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:30:55.105192 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c2f91af3-0142-4f5b-9179-54e4770d4a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:55.133348 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:55.170571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 632/1289] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:30:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:30:55.192304 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc878e-7847-4b64-82bd-09029efc09ae None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:55.290031 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc878e-7847-4b64-82bd-09029efc09ae None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:55.300971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:55.324281 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3b7c5-9432-417f-96cd-e8bac0add348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:55.325094 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3b7c5-9432-417f-96cd-e8bac0add348 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:55.325377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3b7c5-9432-417f-96cd-e8bac0add348 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:55.325652 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3b7c5-9432-417f-96cd-e8bac0add348 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:55.326291 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3b7c5-9432-417f-96cd-e8bac0add348 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:55.327654 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3b7c5-9432-417f-96cd-e8bac0add348 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:55.339739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-7ef3b7c5-9432-417f-96cd-e8bac0add348 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 10:30:55.339739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:55.339739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:30:55.339739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:30:55.339739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:30:55.339739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:30:55.339739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:30:55.339739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:30:55.339739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 10:30:55.339739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:30:55.339739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:30:55.339739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:30:55.339739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:30:55.339739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:30:55.339739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:30:55.339739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:30:55.339739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:30:55.340998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:30:55.340998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:30:55.340998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:30:55.340998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:30:55.340998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:30:55.340998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:30:55.340998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:30:55.340998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:30:55.340998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:30:55.340998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:30:55.340998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:30:55.340998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:30:55.340998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:30:55.340998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:30:55.340998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:30:55.340998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:30:55.342020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:30:55.342020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:30:55.342020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:30:55.342020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:30:55.342020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:30:55.342020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:30:55.342020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:30:55.342020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:30:55.342020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:30:55.342020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:30:55.342020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:30:55.342020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:30:55.342020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 10:30:55.342020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:30:55.342020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 658/1290] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Jun 30 10:30:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:30:55.346814 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f91af3-0142-4f5b-9179-54e4770d4a16 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:55.443190 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f91af3-0142-4f5b-9179-54e4770d4a16 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:55.476646 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7fa79-0656-4a53-8cab-2d25d3c618f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:55.477185 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7fa79-0656-4a53-8cab-2d25d3c618f0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:55.477468 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7fa79-0656-4a53-8cab-2d25d3c618f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:55.477771 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7fa79-0656-4a53-8cab-2d25d3c618f0 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:55.478463 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7fa79-0656-4a53-8cab-2d25d3c618f0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:55.478770 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7fa79-0656-4a53-8cab-2d25d3c618f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:55.480130 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7fa79-0656-4a53-8cab-2d25d3c618f0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:55.484861 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 633/1291] 10.222.0.59 () {56 vars in 1116 bytes} [Thu Jun 30 10:30:55 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:55.490439 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3b7c5-9432-417f-96cd-e8bac0add348 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:55.585342 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3b7c5-9432-417f-96cd-e8bac0add348 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:55.617367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c12d37-4e72-48bb-9062-f7bb9c9eb840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:55.617938 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c12d37-4e72-48bb-9062-f7bb9c9eb840 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:55.618217 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c12d37-4e72-48bb-9062-f7bb9c9eb840 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:55.618512 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c12d37-4e72-48bb-9062-f7bb9c9eb840 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:55.619192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c12d37-4e72-48bb-9062-f7bb9c9eb840 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:55.619493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c12d37-4e72-48bb-9062-f7bb9c9eb840 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:55.620857 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c12d37-4e72-48bb-9062-f7bb9c9eb840 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:55.625113 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 659/1292] 10.222.0.59 () {56 vars in 1116 bytes} [Thu Jun 30 10:30:55 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:57.608444 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cd85a-d7ca-478a-bbca-2035ba58933f None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:57.608985 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cd85a-d7ca-478a-bbca-2035ba58933f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:57.608985 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cd85a-d7ca-478a-bbca-2035ba58933f None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:57.610302 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 634/1293] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:30:57.615268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85a713-bb70-4d7b-a87d-ac2f1dccae67 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:57.615656 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85a713-bb70-4d7b-a87d-ac2f1dccae67 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:57.615824 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85a713-bb70-4d7b-a87d-ac2f1dccae67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:57.632795 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-be85a713-bb70-4d7b-a87d-ac2f1dccae67 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:30:57.633971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-be85a713-bb70-4d7b-a87d-ac2f1dccae67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:57.661999 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:57.698628 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 660/1294] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:30:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:30:57.720621 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cd85a-d7ca-478a-bbca-2035ba58933f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:57.751489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:57.819171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cd85a-d7ca-478a-bbca-2035ba58933f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:57.851290 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbabf5-5fc9-465b-a588-7a51dd9c6a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:57.851926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbabf5-5fc9-465b-a588-7a51dd9c6a4f None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:57.852208 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbabf5-5fc9-465b-a588-7a51dd9c6a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:57.852482 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbabf5-5fc9-465b-a588-7a51dd9c6a4f None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:57.853724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cbabf5-5fc9-465b-a588-7a51dd9c6a4f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:57.855079 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cbabf5-5fc9-465b-a588-7a51dd9c6a4f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:57.867484 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 635/1295] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 30 10:30:57 2022] POST /identity/v3/services => generated 246 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:30:59.875211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ff32a-a9b6-41c6-b530-491dbe57bd6d None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:59.875768 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ff32a-a9b6-41c6-b530-491dbe57bd6d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:59.875768 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ff32a-a9b6-41c6-b530-491dbe57bd6d None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:59.877173 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 661/1296] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:30:59.882164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49411c65-d02e-4576-9933-191102234f1e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:59.882595 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49411c65-d02e-4576-9933-191102234f1e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:59.882705 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49411c65-d02e-4576-9933-191102234f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:59.899146 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-49411c65-d02e-4576-9933-191102234f1e None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:30:59.900310 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-49411c65-d02e-4576-9933-191102234f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:59.968833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 636/1297] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:30:59 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:30:59.991915 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ff32a-a9b6-41c6-b530-491dbe57bd6d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:00.102382 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ff32a-a9b6-41c6-b530-491dbe57bd6d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:00.139930 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8838913-3050-4e48-817b-19e0675cf8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:00.140735 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8838913-3050-4e48-817b-19e0675cf8fd None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:00.141016 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8838913-3050-4e48-817b-19e0675cf8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:00.141282 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8838913-3050-4e48-817b-19e0675cf8fd None admin] PATH_INFO: `/v3/services/placement` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:00.141914 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8838913-3050-4e48-817b-19e0675cf8fd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:00.143260 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8838913-3050-4e48-817b-19e0675cf8fd None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:00.154696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-b8838913-3050-4e48-817b-19e0675cf8fd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 10:31:00.154696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:31:00.154696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:31:00.154696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:31:00.154696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:31:00.154696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:31:00.154696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:31:00.154696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:31:00.154696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 10:31:00.154696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:31:00.154696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:31:00.154696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:31:00.154696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:31:00.154696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:31:00.154696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:31:00.154696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:31:00.154696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:31:00.155861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:31:00.155861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:31:00.155861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:31:00.155861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:31:00.155861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:31:00.155861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:31:00.155861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:31:00.155861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:31:00.155861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:31:00.155861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:31:00.155861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:31:00.155861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:31:00.155861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:31:00.155861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:31:00.155861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:31:00.155861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:31:00.157139 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:31:00.157139 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:31:00.157139 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:31:00.157139 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:31:00.157139 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:31:00.157139 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:31:00.157139 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:31:00.157139 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:31:00.157139 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:31:00.157139 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:31:00.157139 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:31:00.157139 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:31:00.157139 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 10:31:00.157139 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:31:00.157139 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 662/1298] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Jun 30 10:30:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:31:00.161870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49411c65-d02e-4576-9933-191102234f1e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:00.180454 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:00.262269 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49411c65-d02e-4576-9933-191102234f1e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:00.296203 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9de88-467c-4866-b295-8275a28c785e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:00.296895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9de88-467c-4866-b295-8275a28c785e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:00.297183 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9de88-467c-4866-b295-8275a28c785e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:00.297465 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9de88-467c-4866-b295-8275a28c785e None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:00.298168 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9de88-467c-4866-b295-8275a28c785e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:31:00.298480 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9de88-467c-4866-b295-8275a28c785e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:00.299860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9de88-467c-4866-b295-8275a28c785e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:00.304924 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 637/1299] 10.222.0.59 () {56 vars in 1116 bytes} [Thu Jun 30 10:31:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:31:00.310786 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8838913-3050-4e48-817b-19e0675cf8fd None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:00.341173 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:00.407258 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8838913-3050-4e48-817b-19e0675cf8fd None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:00.438829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5363b5-6701-42a8-8aee-d0c5525199c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:00.439459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5363b5-6701-42a8-8aee-d0c5525199c2 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:00.439738 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5363b5-6701-42a8-8aee-d0c5525199c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:00.440009 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5363b5-6701-42a8-8aee-d0c5525199c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:00.440799 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5363b5-6701-42a8-8aee-d0c5525199c2 None admin] RBAC: Adding query filter params (interface=public, service_id=05c0fe35c159417f86bbfdadfa506e88, region_id=RegionOne) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:31:00.441110 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5363b5-6701-42a8-8aee-d0c5525199c2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:00.442450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5363b5-6701-42a8-8aee-d0c5525199c2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:00.447283 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 663/1300] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Jun 30 10:31:00 2022] GET /identity/v3/endpoints?service_id=05c0fe35c159417f86bbfdadfa506e88&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:31:00.452970 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9de88-467c-4866-b295-8275a28c785e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:00.532781 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:00.550879 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9de88-467c-4866-b295-8275a28c785e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:00.583006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b526168-bbcd-4aae-b68b-301845bde2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:00.583650 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b526168-bbcd-4aae-b68b-301845bde2ea None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:00.583939 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b526168-bbcd-4aae-b68b-301845bde2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:00.584219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b526168-bbcd-4aae-b68b-301845bde2ea None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:00.584919 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b526168-bbcd-4aae-b68b-301845bde2ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:00.586289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b526168-bbcd-4aae-b68b-301845bde2ea None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:00.593431 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 638/1301] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Jun 30 10:31:00 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:31:02.589871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc793a8b-6985-4e30-a711-6b0d0e91c4e3 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:02.590382 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc793a8b-6985-4e30-a711-6b0d0e91c4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:02.590382 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc793a8b-6985-4e30-a711-6b0d0e91c4e3 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:02.591710 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 664/1302] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:31:02.596742 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b21f7a-cd2e-4790-84d7-43425d101a6a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:02.597113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b21f7a-cd2e-4790-84d7-43425d101a6a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:02.597314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b21f7a-cd2e-4790-84d7-43425d101a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:02.613810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-58b21f7a-cd2e-4790-84d7-43425d101a6a None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:31:02.614989 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-58b21f7a-cd2e-4790-84d7-43425d101a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:31:02.679500 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 639/1303] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:31:02 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:31:02.703411 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc793a8b-6985-4e30-a711-6b0d0e91c4e3 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:02.795111 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:02.802137 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc793a8b-6985-4e30-a711-6b0d0e91c4e3 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:02.834872 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff5d7d-d16a-4038-961b-4c162a16d243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:02.835645 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff5d7d-d16a-4038-961b-4c162a16d243 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:02.835929 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff5d7d-d16a-4038-961b-4c162a16d243 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:02.836206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff5d7d-d16a-4038-961b-4c162a16d243 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:02.836895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff5d7d-d16a-4038-961b-4c162a16d243 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:02.838242 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff5d7d-d16a-4038-961b-4c162a16d243 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:02.849731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-70ff5d7d-d16a-4038-961b-4c162a16d243 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 10:31:02.849731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:31:02.849731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:31:02.849731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:31:02.849731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:31:02.849731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:31:02.849731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:31:02.849731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:31:02.849731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 10:31:02.849731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:31:02.849731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:31:02.849731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:31:02.849731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:31:02.849731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:31:02.849731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:31:02.849731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:31:02.849731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:31:02.851188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:31:02.851188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:31:02.851188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:31:02.851188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:31:02.851188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:31:02.851188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:31:02.851188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:31:02.851188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:31:02.851188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:31:02.851188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:31:02.851188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:31:02.851188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:31:02.851188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:31:02.851188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:31:02.851188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:31:02.851188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:31:02.852068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:31:02.852068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( Jun 30 10:31:02.852068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:31:02.852068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:31:02.852068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:31:02.852068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:31:02.852068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:31:02.852068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:31:02.852068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:31:02.852068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:31:02.852068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:31:02.852068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:31:02.852068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 10:31:02.852068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: ERROR keystone.server.flask.application Jun 30 10:31:02.852068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 665/1304] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Jun 30 10:31:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:31:02.857553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b21f7a-cd2e-4790-84d7-43425d101a6a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:02.931421 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:02.954962 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b21f7a-cd2e-4790-84d7-43425d101a6a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:02.987844 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11e049-190e-479d-be1c-1f8a396faddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:02.988490 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11e049-190e-479d-be1c-1f8a396faddb None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:02.988805 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11e049-190e-479d-be1c-1f8a396faddb None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:02.989086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11e049-190e-479d-be1c-1f8a396faddb None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:02.989782 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11e049-190e-479d-be1c-1f8a396faddb None admin] RBAC: Adding query filter params (name=placement) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:31:02.990092 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11e049-190e-479d-be1c-1f8a396faddb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:02.991468 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11e049-190e-479d-be1c-1f8a396faddb None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:02.997052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 640/1305] 10.222.0.59 () {56 vars in 1116 bytes} [Thu Jun 30 10:31:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:31:03.002633 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff5d7d-d16a-4038-961b-4c162a16d243 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:03.106223 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff5d7d-d16a-4038-961b-4c162a16d243 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:03.139322 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a7490-2106-4cb6-a201-706d9ca9a536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:03.139964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a7490-2106-4cb6-a201-706d9ca9a536 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:03.140246 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a7490-2106-4cb6-a201-706d9ca9a536 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:03.140544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a7490-2106-4cb6-a201-706d9ca9a536 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:03.141275 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a7490-2106-4cb6-a201-706d9ca9a536 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:03.142630 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a7490-2106-4cb6-a201-706d9ca9a536 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:03.160390 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 666/1306] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Jun 30 10:31:03 2022] POST /identity/v3/endpoints => generated 331 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:31:12.993730 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=30 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:13.156122 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:05.718128 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d048f-2418-4620-a1f7-489fef7b5e3b None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:05.719027 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d048f-2418-4620-a1f7-489fef7b5e3b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:05.719464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d048f-2418-4620-a1f7-489fef7b5e3b None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:05.727172 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e44ae-8ad1-43bf-b53b-e178db8857c0 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:05.727565 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e44ae-8ad1-43bf-b53b-e178db8857c0 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:05.727815 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e44ae-8ad1-43bf-b53b-e178db8857c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:05.731367 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 641/1307] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:32:05 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:05.820633 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b01e44ae-8ad1-43bf-b53b-e178db8857c0 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:05.821989 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b01e44ae-8ad1-43bf-b53b-e178db8857c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:05.958196 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 667/1308] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:32:06.010488 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab96efb-516f-4b18-b97b-4f84b36b2759 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:06.010778 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab96efb-516f-4b18-b97b-4f84b36b2759 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:06.011133 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab96efb-516f-4b18-b97b-4f84b36b2759 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:06.012677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 642/1309] 10.222.0.59 () {54 vars in 964 bytes} [Thu Jun 30 10:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:06.020272 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5150a55-ea32-4ae1-8728-2bf7a6916c7a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:06.020594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5150a55-ea32-4ae1-8728-2bf7a6916c7a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:06.020882 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5150a55-ea32-4ae1-8728-2bf7a6916c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:06.121062 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e5150a55-ea32-4ae1-8728-2bf7a6916c7a None None] MFA Rules not processed for user `fa8cb52425ba42d9ae3576e6fb18dc88`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:06.122440 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e5150a55-ea32-4ae1-8728-2bf7a6916c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:06.145481 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:06.212303 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 668/1310] 10.222.0.59 () {58 vars in 1061 bytes} [Thu Jun 30 10:32:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:32:06.221886 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab96efb-516f-4b18-b97b-4f84b36b2759 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:06.223563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5ab96efb-516f-4b18-b97b-4f84b36b2759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:06.347810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab96efb-516f-4b18-b97b-4f84b36b2759 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:06.430319 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af85e3-2f6c-448d-886c-ae918a2fbb33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:06.431196 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af85e3-2f6c-448d-886c-ae918a2fbb33 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:06.431853 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af85e3-2f6c-448d-886c-ae918a2fbb33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:06.432276 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af85e3-2f6c-448d-886c-ae918a2fbb33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:06.434192 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a8af85e3-2f6c-448d-886c-ae918a2fbb33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:06.495300 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:06.556600 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af85e3-2f6c-448d-886c-ae918a2fbb33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:06.558066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af85e3-2f6c-448d-886c-ae918a2fbb33 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:06.596740 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 643/1311] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:32:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:32:08.967949 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098c4ff-eb51-4b68-9697-7ee188263a0c None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:08.968531 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098c4ff-eb51-4b68-9697-7ee188263a0c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:08.968531 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098c4ff-eb51-4b68-9697-7ee188263a0c None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:08.969947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 669/1312] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:08.975231 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c68c8-3b00-40a1-ae43-e77d2c307770 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:08.975898 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c68c8-3b00-40a1-ae43-e77d2c307770 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:08.976568 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c68c8-3b00-40a1-ae43-e77d2c307770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:09.045126 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-fc3c68c8-3b00-40a1-ae43-e77d2c307770 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:09.046346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fc3c68c8-3b00-40a1-ae43-e77d2c307770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:09.142964 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 644/1313] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:32:09.181984 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098c4ff-eb51-4b68-9697-7ee188263a0c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:09.183536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4098c4ff-eb51-4b68-9697-7ee188263a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:09.297081 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098c4ff-eb51-4b68-9697-7ee188263a0c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:09.368203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:09.370602 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b8420-4623-4801-b071-19a677794478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:09.371251 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b8420-4623-4801-b071-19a677794478 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:09.371713 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b8420-4623-4801-b071-19a677794478 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:09.372191 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b8420-4623-4801-b071-19a677794478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:09.374005 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c53b8420-4623-4801-b071-19a677794478 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:09.486839 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b8420-4623-4801-b071-19a677794478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:09.488283 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b8420-4623-4801-b071-19a677794478 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:09.506129 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 670/1314] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:32:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:32:11.894370 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d358d0-29b9-48a1-8fda-f2d133faaada None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:11.894897 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d358d0-29b9-48a1-8fda-f2d133faaada None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:11.894997 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d358d0-29b9-48a1-8fda-f2d133faaada None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:11.896324 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 645/1315] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:11.901976 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa13e3-68aa-465f-97ab-4cc6f238540b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:11.902388 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa13e3-68aa-465f-97ab-4cc6f238540b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:11.902562 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa13e3-68aa-465f-97ab-4cc6f238540b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:11.966024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c6fa13e3-68aa-465f-97ab-4cc6f238540b None None] MFA Rules not processed for user `47353d62c11845f29684fe955de36601`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:11.967216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c6fa13e3-68aa-465f-97ab-4cc6f238540b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:12.017029 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:12.061530 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 671/1316] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:11 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:32:12.112599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed8ac3-ab39-4d46-ac49-397038733f82 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:12.112891 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed8ac3-ab39-4d46-ac49-397038733f82 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:12.113173 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed8ac3-ab39-4d46-ac49-397038733f82 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:12.114577 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 646/1317] 10.222.0.59 () {54 vars in 964 bytes} [Thu Jun 30 10:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:12.120697 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72a4dc-0097-45d6-9009-3476d7bdb547 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:12.120987 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72a4dc-0097-45d6-9009-3476d7bdb547 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:12.121264 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72a4dc-0097-45d6-9009-3476d7bdb547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:12.195031 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9b72a4dc-0097-45d6-9009-3476d7bdb547 None None] MFA Rules not processed for user `fa8cb52425ba42d9ae3576e6fb18dc88`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:12.196151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9b72a4dc-0097-45d6-9009-3476d7bdb547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:12.272372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 672/1318] 10.222.0.59 () {58 vars in 1061 bytes} [Thu Jun 30 10:32:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:32:12.281784 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed8ac3-ab39-4d46-ac49-397038733f82 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:12.283298 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b6ed8ac3-ab39-4d46-ac49-397038733f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:12.293441 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:12.384554 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed8ac3-ab39-4d46-ac49-397038733f82 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:12.456315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa708f1-bad9-4f47-9723-485c5a2168de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:12.456907 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa708f1-bad9-4f47-9723-485c5a2168de service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:12.457192 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa708f1-bad9-4f47-9723-485c5a2168de service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:12.457465 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa708f1-bad9-4f47-9723-485c5a2168de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:12.459101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1fa708f1-bad9-4f47-9723-485c5a2168de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:12.520769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:12.566470 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa708f1-bad9-4f47-9723-485c5a2168de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:12.567904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa708f1-bad9-4f47-9723-485c5a2168de service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:12.586560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 647/1319] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:32:12 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:32:15.494653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd697b7-ae2f-48ef-9f42-e4c1612e7a00 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:15.495248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd697b7-ae2f-48ef-9f42-e4c1612e7a00 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:15.495248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd697b7-ae2f-48ef-9f42-e4c1612e7a00 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:15.496617 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 673/1320] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:15.501614 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d669b50-72a5-4fe7-b862-2a632f3e03e7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:15.502055 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d669b50-72a5-4fe7-b862-2a632f3e03e7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:15.502163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d669b50-72a5-4fe7-b862-2a632f3e03e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:15.564826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4d669b50-72a5-4fe7-b862-2a632f3e03e7 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:15.565992 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4d669b50-72a5-4fe7-b862-2a632f3e03e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:15.662158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 648/1321] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:32:15.700871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd697b7-ae2f-48ef-9f42-e4c1612e7a00 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:15.702398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9cd697b7-ae2f-48ef-9f42-e4c1612e7a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:15.751580 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:15.804718 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd697b7-ae2f-48ef-9f42-e4c1612e7a00 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:15.875803 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc585be-5adb-43a4-98ce-e47e24b7ecf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:15.876370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc585be-5adb-43a4-98ce-e47e24b7ecf4 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:15.876683 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc585be-5adb-43a4-98ce-e47e24b7ecf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:15.876959 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc585be-5adb-43a4-98ce-e47e24b7ecf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:15.878594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4fc585be-5adb-43a4-98ce-e47e24b7ecf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:15.973057 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:15.986535 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc585be-5adb-43a4-98ce-e47e24b7ecf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:15.987965 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc585be-5adb-43a4-98ce-e47e24b7ecf4 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:16.006318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 674/1322] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:32:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:32:18.713433 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0cab2-c832-4517-b94f-bba960144709 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:18.713963 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0cab2-c832-4517-b94f-bba960144709 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:18.714076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0cab2-c832-4517-b94f-bba960144709 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:18.715454 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 649/1323] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:32:18.720836 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217062ec-835f-4b53-84c1-7e0352e204f4 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:18.721275 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217062ec-835f-4b53-84c1-7e0352e204f4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:18.721372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217062ec-835f-4b53-84c1-7e0352e204f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:18.785219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-217062ec-835f-4b53-84c1-7e0352e204f4 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:18.786433 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-217062ec-835f-4b53-84c1-7e0352e204f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:18.888697 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 675/1324] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:32:18.925814 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0cab2-c832-4517-b94f-bba960144709 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:18.927361 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-69d0cab2-c832-4517-b94f-bba960144709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:18.947702 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:19.034696 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0cab2-c832-4517-b94f-bba960144709 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:19.109113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53377fe-6f3f-45e4-92c5-8b3f38d88d02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:19.109750 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53377fe-6f3f-45e4-92c5-8b3f38d88d02 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:19.110029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53377fe-6f3f-45e4-92c5-8b3f38d88d02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:19.110302 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53377fe-6f3f-45e4-92c5-8b3f38d88d02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:19.111917 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e53377fe-6f3f-45e4-92c5-8b3f38d88d02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:19.181628 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:19.219999 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53377fe-6f3f-45e4-92c5-8b3f38d88d02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:19.221490 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53377fe-6f3f-45e4-92c5-8b3f38d88d02 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:19.241561 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 650/1325] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:32:21.333625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b924c0b-47f1-4f67-b3a9-5a8e8edbee2f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:21.334130 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b924c0b-47f1-4f67-b3a9-5a8e8edbee2f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:21.334130 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b924c0b-47f1-4f67-b3a9-5a8e8edbee2f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:21.335717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 676/1326] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:21.341029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9416edb-fb83-4d50-b40e-728470b0e6e5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:21.341419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9416edb-fb83-4d50-b40e-728470b0e6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:21.341600 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9416edb-fb83-4d50-b40e-728470b0e6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:21.405731 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f9416edb-fb83-4d50-b40e-728470b0e6e5 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:21.406946 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f9416edb-fb83-4d50-b40e-728470b0e6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:21.502520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 651/1327] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:32:21.538666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b924c0b-47f1-4f67-b3a9-5a8e8edbee2f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:21.540295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6b924c0b-47f1-4f67-b3a9-5a8e8edbee2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:21.614694 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:21.662344 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b924c0b-47f1-4f67-b3a9-5a8e8edbee2f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:21.740247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98829b40-f8f3-4138-b697-a27f8a3a19a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:21.740922 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98829b40-f8f3-4138-b697-a27f8a3a19a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:21.741236 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98829b40-f8f3-4138-b697-a27f8a3a19a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:21.741509 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98829b40-f8f3-4138-b697-a27f8a3a19a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:21.743119 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-98829b40-f8f3-4138-b697-a27f8a3a19a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:21.849031 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:21.852193 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98829b40-f8f3-4138-b697-a27f8a3a19a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:21.854079 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98829b40-f8f3-4138-b697-a27f8a3a19a6 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:21.879414 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 677/1328] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:32:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:32:23.943920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f9922-34cb-4c65-a9a6-152f87b28f0b None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:23.945014 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f9922-34cb-4c65-a9a6-152f87b28f0b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:23.945014 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f9922-34cb-4c65-a9a6-152f87b28f0b None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:23.946397 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 652/1329] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:32:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:23.951556 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccd5b7-3690-48cc-8f6b-5b7e95aff54c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:23.951972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccd5b7-3690-48cc-8f6b-5b7e95aff54c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:23.952242 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccd5b7-3690-48cc-8f6b-5b7e95aff54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:24.021468 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f6ccd5b7-3690-48cc-8f6b-5b7e95aff54c None None] MFA Rules not processed for user `47353d62c11845f29684fe955de36601`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:24.023307 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f6ccd5b7-3690-48cc-8f6b-5b7e95aff54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:24.121544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 678/1330] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:23 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:32:24.158978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f9922-34cb-4c65-a9a6-152f87b28f0b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:24.160491 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4e4f9922-34cb-4c65-a9a6-152f87b28f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:24.190261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:24.265186 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f9922-34cb-4c65-a9a6-152f87b28f0b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:24.339042 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396e4a5-8004-407d-879f-a0ebd7685040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:24.339682 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396e4a5-8004-407d-879f-a0ebd7685040 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:24.339961 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396e4a5-8004-407d-879f-a0ebd7685040 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:24.340234 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396e4a5-8004-407d-879f-a0ebd7685040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:24.341868 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4396e4a5-8004-407d-879f-a0ebd7685040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:24.416891 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:24.448739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396e4a5-8004-407d-879f-a0ebd7685040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:24.450306 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396e4a5-8004-407d-879f-a0ebd7685040 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:24.476553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 653/1331] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:32:24 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:32:26.753044 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e123d6b-f7a5-48b5-92db-9ad198c62e9d None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:26.753566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e123d6b-f7a5-48b5-92db-9ad198c62e9d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:26.753566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e123d6b-f7a5-48b5-92db-9ad198c62e9d None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:26.754897 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 679/1332] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:26.760095 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eed4f4-93fd-412e-9891-ac838e960f0d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:26.760548 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eed4f4-93fd-412e-9891-ac838e960f0d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:26.760697 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eed4f4-93fd-412e-9891-ac838e960f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:26.825604 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a6eed4f4-93fd-412e-9891-ac838e960f0d None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:26.826841 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a6eed4f4-93fd-412e-9891-ac838e960f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:26.922433 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 654/1333] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:32:26.958465 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e123d6b-f7a5-48b5-92db-9ad198c62e9d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:26.960668 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8e123d6b-f7a5-48b5-92db-9ad198c62e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:27.027681 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:27.060991 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e123d6b-f7a5-48b5-92db-9ad198c62e9d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:27.130909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3faaa-2af7-4820-9d8c-d8a819794781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:27.132067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3faaa-2af7-4820-9d8c-d8a819794781 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:27.132342 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3faaa-2af7-4820-9d8c-d8a819794781 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:27.132644 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3faaa-2af7-4820-9d8c-d8a819794781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:27.134234 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1cb3faaa-2af7-4820-9d8c-d8a819794781 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:27.241653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3faaa-2af7-4820-9d8c-d8a819794781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:27.243098 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3faaa-2af7-4820-9d8c-d8a819794781 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:27.252990 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:27.263730 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 680/1334] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:32:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:32:29.303995 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833ee2d-eebe-4ac4-b28c-6e2db5bf8be0 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:29.304536 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833ee2d-eebe-4ac4-b28c-6e2db5bf8be0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:29.304630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833ee2d-eebe-4ac4-b28c-6e2db5bf8be0 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:29.305973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 655/1335] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:32:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:29.311222 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ad024-7e8d-4de7-8de7-a5c24ab0c69f None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:29.311661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ad024-7e8d-4de7-8de7-a5c24ab0c69f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:29.311773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ad024-7e8d-4de7-8de7-a5c24ab0c69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:29.374190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-2e2ad024-7e8d-4de7-8de7-a5c24ab0c69f None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:29.375380 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2e2ad024-7e8d-4de7-8de7-a5c24ab0c69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:29.467960 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 681/1336] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:32:29.508743 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833ee2d-eebe-4ac4-b28c-6e2db5bf8be0 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:29.510206 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1833ee2d-eebe-4ac4-b28c-6e2db5bf8be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:29.549759 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:29.613049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833ee2d-eebe-4ac4-b28c-6e2db5bf8be0 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:29.685736 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b6012-a23f-4a76-9ec8-88119d2ec49d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:29.687308 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b6012-a23f-4a76-9ec8-88119d2ec49d service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:29.687603 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b6012-a23f-4a76-9ec8-88119d2ec49d service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:29.687886 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b6012-a23f-4a76-9ec8-88119d2ec49d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:29.689554 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8a7b6012-a23f-4a76-9ec8-88119d2ec49d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:29.770683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:29.797204 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b6012-a23f-4a76-9ec8-88119d2ec49d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:29.798644 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b6012-a23f-4a76-9ec8-88119d2ec49d service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:29.816910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 656/1337] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:32:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:32:32.182127 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c577d84-0cd7-4bf8-84a7-3b1a688e9203 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:32.182687 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c577d84-0cd7-4bf8-84a7-3b1a688e9203 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:32.182687 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c577d84-0cd7-4bf8-84a7-3b1a688e9203 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:32.184070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 682/1338] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:32.189209 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e155e8-47ce-48e3-9f41-486881e3a2e7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:32.189654 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e155e8-47ce-48e3-9f41-486881e3a2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:32.189762 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e155e8-47ce-48e3-9f41-486881e3a2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:32.254669 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d4e155e8-47ce-48e3-9f41-486881e3a2e7 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:32.255882 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d4e155e8-47ce-48e3-9f41-486881e3a2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:32.353298 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 657/1339] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:32:32.388979 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c577d84-0cd7-4bf8-84a7-3b1a688e9203 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:32.390502 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6c577d84-0cd7-4bf8-84a7-3b1a688e9203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:32.465976 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:32.494584 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c577d84-0cd7-4bf8-84a7-3b1a688e9203 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:32.566353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33801b-8947-48b3-a5f1-c70d3c62108c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:32.566994 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33801b-8947-48b3-a5f1-c70d3c62108c service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:32.567280 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33801b-8947-48b3-a5f1-c70d3c62108c service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:32.567560 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33801b-8947-48b3-a5f1-c70d3c62108c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:32.569836 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7d33801b-8947-48b3-a5f1-c70d3c62108c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:32.674237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33801b-8947-48b3-a5f1-c70d3c62108c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:32.675649 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33801b-8947-48b3-a5f1-c70d3c62108c service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:32.693368 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 683/1340] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:32:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:32:36.595341 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f761052-44c8-447d-a045-4962f258b86b None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:36.595861 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f761052-44c8-447d-a045-4962f258b86b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:36.595953 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f761052-44c8-447d-a045-4962f258b86b None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:36.597320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 658/1341] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:32:36.603576 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1d3f1-29bc-4334-8dcf-04ff530cb85a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:36.604010 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1d3f1-29bc-4334-8dcf-04ff530cb85a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:36.604143 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1d3f1-29bc-4334-8dcf-04ff530cb85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:36.610212 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:36.675690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-16a1d3f1-29bc-4334-8dcf-04ff530cb85a None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:36.676964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-16a1d3f1-29bc-4334-8dcf-04ff530cb85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:36.780565 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 684/1342] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:32:36.818341 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f761052-44c8-447d-a045-4962f258b86b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:36.820973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8f761052-44c8-447d-a045-4962f258b86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:36.869962 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:36.916539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f761052-44c8-447d-a045-4962f258b86b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:36.920086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a02da4-7125-42c0-8c6a-4d15dcdcfdad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:36.920771 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a02da4-7125-42c0-8c6a-4d15dcdcfdad service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:36.921059 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a02da4-7125-42c0-8c6a-4d15dcdcfdad service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:36.921337 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a02da4-7125-42c0-8c6a-4d15dcdcfdad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:36.930405 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a02da4-7125-42c0-8c6a-4d15dcdcfdad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:36.931787 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a02da4-7125-42c0-8c6a-4d15dcdcfdad service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:36.941245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 659/1343] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:32:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:32:39.633886 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62e691-32a3-474d-9bac-1f18b12fd083 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:39.634411 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62e691-32a3-474d-9bac-1f18b12fd083 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:39.634508 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62e691-32a3-474d-9bac-1f18b12fd083 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:39.636100 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 685/1344] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:39.640956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91a6cc-6a70-4832-ae21-74f73dc60794 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:39.641373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91a6cc-6a70-4832-ae21-74f73dc60794 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:39.641515 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91a6cc-6a70-4832-ae21-74f73dc60794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:39.669637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4a91a6cc-6a70-4832-ae21-74f73dc60794 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:39.670813 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4a91a6cc-6a70-4832-ae21-74f73dc60794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:39.754245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 660/1345] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:32:39.793776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62e691-32a3-474d-9bac-1f18b12fd083 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:39.804798 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62e691-32a3-474d-9bac-1f18b12fd083 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:39.808669 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950eadfc-9d51-412d-bcaf-7c29701317e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:39.809316 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950eadfc-9d51-412d-bcaf-7c29701317e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:39.809594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950eadfc-9d51-412d-bcaf-7c29701317e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:39.809861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950eadfc-9d51-412d-bcaf-7c29701317e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:39.819985 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950eadfc-9d51-412d-bcaf-7c29701317e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:39.821468 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950eadfc-9d51-412d-bcaf-7c29701317e4 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:39.831876 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 686/1346] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:32:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:32:43.839193 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3f0c6-e453-4118-8c2d-ddf812305395 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:43.839621 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3f0c6-e453-4118-8c2d-ddf812305395 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:43.839754 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3f0c6-e453-4118-8c2d-ddf812305395 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:43.841171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 661/1347] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:43.847737 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3909e-60c7-4b55-9ee3-46427549d62a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:43.848165 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3909e-60c7-4b55-9ee3-46427549d62a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:43.848332 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3909e-60c7-4b55-9ee3-46427549d62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:43.869313 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-74f3909e-60c7-4b55-9ee3-46427549d62a None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:43.870526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-74f3909e-60c7-4b55-9ee3-46427549d62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:43.881936 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 687/1348] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:32:43.921322 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3f0c6-e453-4118-8c2d-ddf812305395 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:43.931996 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3f0c6-e453-4118-8c2d-ddf812305395 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:43.936455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530e7ce-48c0-4977-bdc7-6e3fa5db2f50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:43.937126 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530e7ce-48c0-4977-bdc7-6e3fa5db2f50 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:43.937413 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530e7ce-48c0-4977-bdc7-6e3fa5db2f50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:43.937695 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530e7ce-48c0-4977-bdc7-6e3fa5db2f50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:43.948816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530e7ce-48c0-4977-bdc7-6e3fa5db2f50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:43.950283 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530e7ce-48c0-4977-bdc7-6e3fa5db2f50 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:43.960514 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 662/1349] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:32:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:32:48.982174 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cab01-bca4-41d4-9ce1-058aa0ae2178 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:48.982706 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cab01-bca4-41d4-9ce1-058aa0ae2178 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:48.982807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cab01-bca4-41d4-9ce1-058aa0ae2178 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:48.984456 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 688/1350] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 30 10:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:48.991116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f8ef6-c496-4ca5-b85b-91591b566e91 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:48.991116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f8ef6-c496-4ca5-b85b-91591b566e91 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:48.991116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f8ef6-c496-4ca5-b85b-91591b566e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:49.104442 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f53f8ef6-c496-4ca5-b85b-91591b566e91 None None] MFA Rules not processed for user `48709a771ab64ed38018873313f37c84`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:49.105964 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f53f8ef6-c496-4ca5-b85b-91591b566e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:49.168442 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:49.223695 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 663/1351] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 30 10:32:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:32:53.441984 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10d361-e41e-4af4-b090-f7e763ace4f3 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:53.442695 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10d361-e41e-4af4-b090-f7e763ace4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:53.442695 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10d361-e41e-4af4-b090-f7e763ace4f3 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:53.444557 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 689/1352] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 30 10:32:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:53.449646 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8193815-d3c2-4918-9203-37060ca7a226 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:53.450101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8193815-d3c2-4918-9203-37060ca7a226 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:53.450192 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8193815-d3c2-4918-9203-37060ca7a226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:53.469363 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c8193815-d3c2-4918-9203-37060ca7a226 None None] MFA Rules not processed for user `48709a771ab64ed38018873313f37c84`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:53.470559 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c8193815-d3c2-4918-9203-37060ca7a226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:53.479603 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 664/1353] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 30 10:32:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:32:53.863419 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=72 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:54.994690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cefe3-2cd3-4276-9960-4e2b75ce2b22 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:54.995327 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cefe3-2cd3-4276-9960-4e2b75ce2b22 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:54.995327 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cefe3-2cd3-4276-9960-4e2b75ce2b22 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:54.996742 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 690/1354] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 30 10:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:55.002084 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c914f8-e4ce-4e75-b830-8e9f7d4c771c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:55.002857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c914f8-e4ce-4e75-b830-8e9f7d4c771c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:55.003143 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c914f8-e4ce-4e75-b830-8e9f7d4c771c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:55.021386 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-93c914f8-e4ce-4e75-b830-8e9f7d4c771c None None] MFA Rules not processed for user `48709a771ab64ed38018873313f37c84`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:55.022564 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-93c914f8-e4ce-4e75-b830-8e9f7d4c771c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:55.030977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 665/1355] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 30 10:32:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:32:58.587575 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d02a04-e3a3-4845-9339-35e307881dfb None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:58.588554 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d02a04-e3a3-4845-9339-35e307881dfb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:58.589095 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d02a04-e3a3-4845-9339-35e307881dfb None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:58.594855 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 691/1356] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:32:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:58.597061 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8a75c-2dea-4b1e-b1ad-e81e481d1c48 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:58.597942 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8a75c-2dea-4b1e-b1ad-e81e481d1c48 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:58.598314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8a75c-2dea-4b1e-b1ad-e81e481d1c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:58.621324 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b9f8a75c-2dea-4b1e-b1ad-e81e481d1c48 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:58.623619 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b9f8a75c-2dea-4b1e-b1ad-e81e481d1c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:58.631724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 666/1357] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:32:58.687030 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6c189-776f-48e8-9ffc-9425ca063e24 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:58.687317 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6c189-776f-48e8-9ffc-9425ca063e24 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:58.687793 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6c189-776f-48e8-9ffc-9425ca063e24 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:58.689628 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 692/1358] 10.222.0.59 () {54 vars in 961 bytes} [Thu Jun 30 10:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:32:58.699280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e69ff-4f6a-4f1f-ac6d-75c7901b8a64 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:58.700048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e69ff-4f6a-4f1f-ac6d-75c7901b8a64 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:58.700686 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e69ff-4f6a-4f1f-ac6d-75c7901b8a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:58.753479 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0f0e69ff-4f6a-4f1f-ac6d-75c7901b8a64 None None] MFA Rules not processed for user `1bfd036d747241d9bc314b60bf8648b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:58.755055 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0f0e69ff-4f6a-4f1f-ac6d-75c7901b8a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:58.842342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 667/1359] 10.222.0.59 () {58 vars in 1058 bytes} [Thu Jun 30 10:32:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:32:58.851891 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6c189-776f-48e8-9ffc-9425ca063e24 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:58.867487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6c189-776f-48e8-9ffc-9425ca063e24 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:58.873712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bc378-5117-4f3a-80a0-056cbbebb76c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:58.874778 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bc378-5117-4f3a-80a0-056cbbebb76c service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:58.875403 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bc378-5117-4f3a-80a0-056cbbebb76c service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:58.875904 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bc378-5117-4f3a-80a0-056cbbebb76c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:58.885933 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464bc378-5117-4f3a-80a0-056cbbebb76c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:58.887970 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464bc378-5117-4f3a-80a0-056cbbebb76c service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:58.900633 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 693/1360] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:32:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:33:01.122777 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640d1e4-3143-4a7d-a485-c8725a680ab2 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:01.123269 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640d1e4-3143-4a7d-a485-c8725a680ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:01.123363 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640d1e4-3143-4a7d-a485-c8725a680ab2 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:01.124989 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 668/1361] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:01.129905 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1258762-6de1-4254-9a3d-1f0ce6301860 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:01.130307 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1258762-6de1-4254-9a3d-1f0ce6301860 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:01.130470 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1258762-6de1-4254-9a3d-1f0ce6301860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:01.148675 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b1258762-6de1-4254-9a3d-1f0ce6301860 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:01.149874 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b1258762-6de1-4254-9a3d-1f0ce6301860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:01.157834 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 694/1362] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:33:01.201293 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640d1e4-3143-4a7d-a485-c8725a680ab2 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:01.217456 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640d1e4-3143-4a7d-a485-c8725a680ab2 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:01.223210 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8615e-0cfe-4f0c-8c61-1c9630e0483d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:01.223976 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8615e-0cfe-4f0c-8c61-1c9630e0483d service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:01.224270 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8615e-0cfe-4f0c-8c61-1c9630e0483d service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:01.224587 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8615e-0cfe-4f0c-8c61-1c9630e0483d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:01.234018 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8615e-0cfe-4f0c-8c61-1c9630e0483d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:01.236837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8615e-0cfe-4f0c-8c61-1c9630e0483d service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:01.248291 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 669/1363] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:33:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:33:03.633658 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d129f-dad6-4dbc-9cbb-2f750f87d588 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:03.634118 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d129f-dad6-4dbc-9cbb-2f750f87d588 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:03.634222 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d129f-dad6-4dbc-9cbb-2f750f87d588 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:03.635861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 695/1364] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:03.641141 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bf4df-9e9c-4a7f-904c-f7b2577b304f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:03.641902 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bf4df-9e9c-4a7f-904c-f7b2577b304f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:03.642329 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bf4df-9e9c-4a7f-904c-f7b2577b304f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:03.669311 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-5c5bf4df-9e9c-4a7f-904c-f7b2577b304f None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:03.670910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5c5bf4df-9e9c-4a7f-904c-f7b2577b304f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:03.679957 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 670/1365] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:33:03.725325 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8b6f4-07f0-4782-84a4-bc4936e38321 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:03.725613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8b6f4-07f0-4782-84a4-bc4936e38321 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:03.726143 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8b6f4-07f0-4782-84a4-bc4936e38321 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:03.727507 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 696/1366] 10.222.0.59 () {54 vars in 961 bytes} [Thu Jun 30 10:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:03.733008 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c601d-d8d6-4809-9b05-794db3f5574e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:03.733368 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c601d-d8d6-4809-9b05-794db3f5574e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:03.733732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c601d-d8d6-4809-9b05-794db3f5574e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:03.751298 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ce9c601d-d8d6-4809-9b05-794db3f5574e None None] MFA Rules not processed for user `1bfd036d747241d9bc314b60bf8648b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:03.752560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ce9c601d-d8d6-4809-9b05-794db3f5574e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:03.762021 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 671/1367] 10.222.0.59 () {58 vars in 1058 bytes} [Thu Jun 30 10:33:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:33:03.769753 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8b6f4-07f0-4782-84a4-bc4936e38321 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:03.784302 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8b6f4-07f0-4782-84a4-bc4936e38321 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:03.789890 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae638dde-c9c4-43c4-be88-57cf9d152b53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:03.790509 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae638dde-c9c4-43c4-be88-57cf9d152b53 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:03.790789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae638dde-c9c4-43c4-be88-57cf9d152b53 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:03.791061 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae638dde-c9c4-43c4-be88-57cf9d152b53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:03.799136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae638dde-c9c4-43c4-be88-57cf9d152b53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:03.800737 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae638dde-c9c4-43c4-be88-57cf9d152b53 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:03.810790 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 697/1368] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:33:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:33:05.901714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1cd86-6aa1-439e-924b-c18aa9dc1000 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:05.902700 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1cd86-6aa1-439e-924b-c18aa9dc1000 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:05.903008 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1cd86-6aa1-439e-924b-c18aa9dc1000 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:05.904634 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 672/1369] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:33:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:05.909705 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d3dbc-f027-493d-9c02-82aa6666adb7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:05.910520 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d3dbc-f027-493d-9c02-82aa6666adb7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:05.911024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d3dbc-f027-493d-9c02-82aa6666adb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:05.930343 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-473d3dbc-f027-493d-9c02-82aa6666adb7 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:05.931676 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-473d3dbc-f027-493d-9c02-82aa6666adb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:05.940020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 698/1370] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:33:05.984681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1cd86-6aa1-439e-924b-c18aa9dc1000 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:06.000477 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1cd86-6aa1-439e-924b-c18aa9dc1000 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:06.006819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a58fdd-2d85-4e29-8a2b-1abe9bc92221 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:06.007547 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a58fdd-2d85-4e29-8a2b-1abe9bc92221 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:06.007906 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a58fdd-2d85-4e29-8a2b-1abe9bc92221 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:06.008198 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a58fdd-2d85-4e29-8a2b-1abe9bc92221 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:06.017235 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a58fdd-2d85-4e29-8a2b-1abe9bc92221 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:06.018983 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a58fdd-2d85-4e29-8a2b-1abe9bc92221 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:06.029111 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 673/1371] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:33:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:33:06.671586 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18800a23-0af5-4ca9-ab1e-49503ff89526 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:06.672023 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18800a23-0af5-4ca9-ab1e-49503ff89526 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:06.672217 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18800a23-0af5-4ca9-ab1e-49503ff89526 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:06.673821 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 699/1372] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:06.679270 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d425ac5-b173-44e2-a8eb-dd14429efab2 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:06.679800 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d425ac5-b173-44e2-a8eb-dd14429efab2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:06.680152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d425ac5-b173-44e2-a8eb-dd14429efab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:06.699395 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0d425ac5-b173-44e2-a8eb-dd14429efab2 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:06.700717 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0d425ac5-b173-44e2-a8eb-dd14429efab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:06.709763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 674/1373] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:33:07.054378 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab14f6-98d5-48f5-b10e-b4bbac847f1a None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:07.054378 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab14f6-98d5-48f5-b10e-b4bbac847f1a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:07.054378 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab14f6-98d5-48f5-b10e-b4bbac847f1a None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:07.055179 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 700/1374] 10.222.0.59 () {54 vars in 963 bytes} [Thu Jun 30 10:33:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:07.060963 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54fb63-e3ee-44f9-ad78-a6aa246c1291 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:07.061492 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54fb63-e3ee-44f9-ad78-a6aa246c1291 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:07.061648 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54fb63-e3ee-44f9-ad78-a6aa246c1291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:07.069369 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:07.113063 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-2b54fb63-e3ee-44f9-ad78-a6aa246c1291 None None] MFA Rules not processed for user `afb7ea0cfb9c423799848b912724cd75`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:07.114278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2b54fb63-e3ee-44f9-ad78-a6aa246c1291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:07.179959 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 675/1375] 10.222.0.59 () {58 vars in 1060 bytes} [Thu Jun 30 10:33:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:33:07.188027 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab14f6-98d5-48f5-b10e-b4bbac847f1a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:07.199181 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab14f6-98d5-48f5-b10e-b4bbac847f1a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:07.202703 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef810f-3d24-45c8-b28e-e718fa794a0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:07.203340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef810f-3d24-45c8-b28e-e718fa794a0a service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:07.203624 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef810f-3d24-45c8-b28e-e718fa794a0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:07.203904 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef810f-3d24-45c8-b28e-e718fa794a0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:07.213771 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef810f-3d24-45c8-b28e-e718fa794a0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:07.215868 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef810f-3d24-45c8-b28e-e718fa794a0a service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:07.225800 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 701/1376] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:33:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:33:08.114977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4b6c5-e1f9-4e04-9ecf-cd36ec1a1b07 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:08.115484 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4b6c5-e1f9-4e04-9ecf-cd36ec1a1b07 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:08.115484 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4b6c5-e1f9-4e04-9ecf-cd36ec1a1b07 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:08.116859 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 676/1377] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:33:08.122333 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b85dcd-d393-44c4-9bbf-d98e36c47fbc None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:08.122738 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b85dcd-d393-44c4-9bbf-d98e36c47fbc None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:08.122944 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b85dcd-d393-44c4-9bbf-d98e36c47fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:08.140694 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c7b85dcd-d393-44c4-9bbf-d98e36c47fbc None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:08.141894 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c7b85dcd-d393-44c4-9bbf-d98e36c47fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:08.150399 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 702/1378] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:33:08.193560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4b6c5-e1f9-4e04-9ecf-cd36ec1a1b07 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:08.207832 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4b6c5-e1f9-4e04-9ecf-cd36ec1a1b07 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:08.213741 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076ce5a-eeed-4cd5-a97b-da265de0af84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:08.214370 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076ce5a-eeed-4cd5-a97b-da265de0af84 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:08.214659 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076ce5a-eeed-4cd5-a97b-da265de0af84 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:08.214939 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076ce5a-eeed-4cd5-a97b-da265de0af84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:08.223160 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076ce5a-eeed-4cd5-a97b-da265de0af84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:08.224783 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076ce5a-eeed-4cd5-a97b-da265de0af84 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:08.234590 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 677/1379] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:33:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:33:10.316369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728e111-f9c8-4b0f-816c-d1fbae3fe47c None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:10.316879 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728e111-f9c8-4b0f-816c-d1fbae3fe47c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:10.317012 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728e111-f9c8-4b0f-816c-d1fbae3fe47c None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:10.318512 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 703/1380] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:10.323694 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311cac3-5c02-45da-a507-1f7573278892 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:10.324140 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311cac3-5c02-45da-a507-1f7573278892 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:10.324414 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311cac3-5c02-45da-a507-1f7573278892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:10.343089 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a311cac3-5c02-45da-a507-1f7573278892 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:10.344313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a311cac3-5c02-45da-a507-1f7573278892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:10.353411 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 678/1381] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:33:10.399039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728e111-f9c8-4b0f-816c-d1fbae3fe47c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:10.415651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728e111-f9c8-4b0f-816c-d1fbae3fe47c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:10.421071 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c43a8-074c-4768-bcea-d5a7478939ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:10.421705 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c43a8-074c-4768-bcea-d5a7478939ae service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:10.421992 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c43a8-074c-4768-bcea-d5a7478939ae service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:10.422272 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c43a8-074c-4768-bcea-d5a7478939ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:10.430589 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c43a8-074c-4768-bcea-d5a7478939ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:10.432173 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c43a8-074c-4768-bcea-d5a7478939ae service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:10.441684 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 704/1382] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:33:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:33:12.525920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b330f5f-c381-4098-9b23-bdc7647cf325 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:12.526464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b330f5f-c381-4098-9b23-bdc7647cf325 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:12.526464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b330f5f-c381-4098-9b23-bdc7647cf325 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:12.527857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 679/1383] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:12.533118 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dfd86-d21e-4949-a598-d017e0864827 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:12.533517 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dfd86-d21e-4949-a598-d017e0864827 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:12.533679 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dfd86-d21e-4949-a598-d017e0864827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:12.551881 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-670dfd86-d21e-4949-a598-d017e0864827 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:12.553647 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-670dfd86-d21e-4949-a598-d017e0864827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:12.561774 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 705/1384] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:33:12.603814 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b330f5f-c381-4098-9b23-bdc7647cf325 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:12.619452 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b330f5f-c381-4098-9b23-bdc7647cf325 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:12.625008 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213cef1-f8ae-4697-9106-e67624a3e83b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:12.625738 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213cef1-f8ae-4697-9106-e67624a3e83b service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:12.626198 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213cef1-f8ae-4697-9106-e67624a3e83b service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:12.626545 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213cef1-f8ae-4697-9106-e67624a3e83b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:12.635576 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213cef1-f8ae-4697-9106-e67624a3e83b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:12.637314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213cef1-f8ae-4697-9106-e67624a3e83b service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:12.647455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 680/1385] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:33:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:33:14.685716 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda7c2e-96ff-473f-a358-167248df3df7 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:14.686344 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda7c2e-96ff-473f-a358-167248df3df7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:14.686344 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda7c2e-96ff-473f-a358-167248df3df7 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:14.691483 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 706/1386] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:33:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:14.693335 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa5755-c1f4-4f3f-94d3-bbe182ef74ed None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:14.693967 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa5755-c1f4-4f3f-94d3-bbe182ef74ed None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:14.693967 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa5755-c1f4-4f3f-94d3-bbe182ef74ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:14.719827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-38fa5755-c1f4-4f3f-94d3-bbe182ef74ed None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:14.721481 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-38fa5755-c1f4-4f3f-94d3-bbe182ef74ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:14.741419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 681/1387] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:33:14.778763 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda7c2e-96ff-473f-a358-167248df3df7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:14.794347 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda7c2e-96ff-473f-a358-167248df3df7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:14.800112 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc5fe2-4e58-4dc1-bd3a-83bd7ebe3aad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:14.800768 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc5fe2-4e58-4dc1-bd3a-83bd7ebe3aad service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:14.801049 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc5fe2-4e58-4dc1-bd3a-83bd7ebe3aad service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:14.801340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc5fe2-4e58-4dc1-bd3a-83bd7ebe3aad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:14.811006 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc5fe2-4e58-4dc1-bd3a-83bd7ebe3aad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:14.812638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc5fe2-4e58-4dc1-bd3a-83bd7ebe3aad service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:14.823283 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 707/1388] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:33:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:33:17.422451 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db4b39-fcf1-4bef-a3a6-197c798a1990 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:17.422982 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db4b39-fcf1-4bef-a3a6-197c798a1990 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:17.423100 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db4b39-fcf1-4bef-a3a6-197c798a1990 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:17.424404 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 682/1389] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:17.430350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebaf61-ab9a-4ac9-9b0b-97ed72b83482 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:17.430931 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebaf61-ab9a-4ac9-9b0b-97ed72b83482 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:17.430931 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebaf61-ab9a-4ac9-9b0b-97ed72b83482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:17.451995 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9eebaf61-ab9a-4ac9-9b0b-97ed72b83482 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:17.453719 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9eebaf61-ab9a-4ac9-9b0b-97ed72b83482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:17.465605 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 708/1390] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:33:17.518100 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db4b39-fcf1-4bef-a3a6-197c798a1990 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:17.536005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db4b39-fcf1-4bef-a3a6-197c798a1990 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:17.542931 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793c197-d32d-4df5-9a7c-3055b50f2dc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:17.543709 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793c197-d32d-4df5-9a7c-3055b50f2dc9 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:17.544070 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793c197-d32d-4df5-9a7c-3055b50f2dc9 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:17.544486 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793c197-d32d-4df5-9a7c-3055b50f2dc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:17.555055 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793c197-d32d-4df5-9a7c-3055b50f2dc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:17.557386 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793c197-d32d-4df5-9a7c-3055b50f2dc9 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:17.569368 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 683/1391] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:33:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:33:19.667058 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87fee5-0a84-48df-8dbe-b4fb8382eb1f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:19.667583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87fee5-0a84-48df-8dbe-b4fb8382eb1f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:19.667699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87fee5-0a84-48df-8dbe-b4fb8382eb1f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:19.669573 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 709/1392] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:33:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:19.674608 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae2f21-eefe-499d-9adc-37bfdac79803 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:19.675021 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae2f21-eefe-499d-9adc-37bfdac79803 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:19.675200 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae2f21-eefe-499d-9adc-37bfdac79803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:19.695182 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a7ae2f21-eefe-499d-9adc-37bfdac79803 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:19.696429 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a7ae2f21-eefe-499d-9adc-37bfdac79803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:19.704761 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 684/1393] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:33:19.752619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87fee5-0a84-48df-8dbe-b4fb8382eb1f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:19.767050 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87fee5-0a84-48df-8dbe-b4fb8382eb1f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:19.773072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7b464-79bd-4a66-b247-22e6dcdc7ee5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:19.773705 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7b464-79bd-4a66-b247-22e6dcdc7ee5 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:19.773993 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7b464-79bd-4a66-b247-22e6dcdc7ee5 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:19.774271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7b464-79bd-4a66-b247-22e6dcdc7ee5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:19.782635 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7b464-79bd-4a66-b247-22e6dcdc7ee5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:19.784219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7b464-79bd-4a66-b247-22e6dcdc7ee5 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:19.794279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 710/1394] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:33:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:33:21.870386 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08133529-b2fa-4656-b844-bccbde3b8bce None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:21.870901 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08133529-b2fa-4656-b844-bccbde3b8bce None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:21.870901 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08133529-b2fa-4656-b844-bccbde3b8bce None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:21.872370 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 685/1395] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:21.877642 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f14c13-0902-449c-aae2-7e2134bef62b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:21.878081 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f14c13-0902-449c-aae2-7e2134bef62b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:21.878206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f14c13-0902-449c-aae2-7e2134bef62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:21.896306 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e2f14c13-0902-449c-aae2-7e2134bef62b None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:21.897562 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e2f14c13-0902-449c-aae2-7e2134bef62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:21.905350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 711/1396] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:33:21.949702 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08133529-b2fa-4656-b844-bccbde3b8bce None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:21.964442 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08133529-b2fa-4656-b844-bccbde3b8bce None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:21.969817 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b07121-2e83-4527-915c-5de3be23fa14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:21.970447 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b07121-2e83-4527-915c-5de3be23fa14 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:21.970734 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b07121-2e83-4527-915c-5de3be23fa14 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:21.971010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b07121-2e83-4527-915c-5de3be23fa14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:21.980143 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b07121-2e83-4527-915c-5de3be23fa14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:21.981762 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b07121-2e83-4527-915c-5de3be23fa14 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:21.991786 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 686/1397] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:33:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:33:22.467726 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cef59-1ac3-4e38-a0c9-eeee2640d98f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:22.468017 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cef59-1ac3-4e38-a0c9-eeee2640d98f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:22.468294 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cef59-1ac3-4e38-a0c9-eeee2640d98f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:22.469704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 712/1398] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:22.474961 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e52c7-4e4e-4721-a00a-76ee46b87df5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:22.475261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e52c7-4e4e-4721-a00a-76ee46b87df5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:22.475547 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e52c7-4e4e-4721-a00a-76ee46b87df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:22.493412 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9f2e52c7-4e4e-4721-a00a-76ee46b87df5 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:22.494609 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9f2e52c7-4e4e-4721-a00a-76ee46b87df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:22.502604 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 687/1399] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:33:22.558995 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405c3a5-a52e-4df1-88a1-f5fa5db1ce82 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:22.559354 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405c3a5-a52e-4df1-88a1-f5fa5db1ce82 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:22.559694 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405c3a5-a52e-4df1-88a1-f5fa5db1ce82 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:22.561119 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 713/1400] 10.222.0.59 () {54 vars in 962 bytes} [Thu Jun 30 10:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:22.566220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3cbd5-deea-40e5-b7c0-bb49fb72bf17 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:22.566519 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3cbd5-deea-40e5-b7c0-bb49fb72bf17 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:22.566802 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3cbd5-deea-40e5-b7c0-bb49fb72bf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:22.615168 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-31b3cbd5-deea-40e5-b7c0-bb49fb72bf17 None None] MFA Rules not processed for user `2522b8560d224aa1a973207a79ce6a99`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:22.616374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-31b3cbd5-deea-40e5-b7c0-bb49fb72bf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:22.648483 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:22.677157 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 688/1401] 10.222.0.59 () {58 vars in 1059 bytes} [Thu Jun 30 10:33:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:33:22.684716 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405c3a5-a52e-4df1-88a1-f5fa5db1ce82 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:22.696028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405c3a5-a52e-4df1-88a1-f5fa5db1ce82 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:22.699547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4088fe-ab6c-487d-8b80-b1c4d1c386ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2522b8560d224aa1a973207a79ce6a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:22.700141 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4088fe-ab6c-487d-8b80-b1c4d1c386ba service glance] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:22.700416 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4088fe-ab6c-487d-8b80-b1c4d1c386ba service glance] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:22.700731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4088fe-ab6c-487d-8b80-b1c4d1c386ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:22.710191 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4088fe-ab6c-487d-8b80-b1c4d1c386ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:22.711613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4088fe-ab6c-487d-8b80-b1c4d1c386ba service glance] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:22.721602 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 714/1402] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:33:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:33:23.443286 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811c721-1a51-49e3-8d48-de37f3a57329 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:23.443801 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811c721-1a51-49e3-8d48-de37f3a57329 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:23.444079 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811c721-1a51-49e3-8d48-de37f3a57329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:23.493307 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-5811c721-1a51-49e3-8d48-de37f3a57329 None None] MFA Rules not processed for user `a2bd48e6390241448fe2cf098ab64df3`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:23.494430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5811c721-1a51-49e3-8d48-de37f3a57329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:23.556907 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 689/1403] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 30 10:33:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:33:23.596468 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c35faf-6f63-49d5-aacd-5231c66e64c2 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:23.596958 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c35faf-6f63-49d5-aacd-5231c66e64c2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:23.597062 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c35faf-6f63-49d5-aacd-5231c66e64c2 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:23.598457 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 715/1404] 10.222.0.59 () {54 vars in 942 bytes} [Thu Jun 30 10:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:23.605749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcd2b0-076a-4411-b10f-e75449c268db None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:23.606044 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcd2b0-076a-4411-b10f-e75449c268db None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:23.606348 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcd2b0-076a-4411-b10f-e75449c268db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:23.654946 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-99bcd2b0-076a-4411-b10f-e75449c268db None None] MFA Rules not processed for user `c15327c36c8c49ac87a3b3e9ab49eea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:23.656141 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-99bcd2b0-076a-4411-b10f-e75449c268db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:23.729332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 690/1405] 10.222.0.59 () {58 vars in 1039 bytes} [Thu Jun 30 10:33:23 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:33:23.738763 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c35faf-6f63-49d5-aacd-5231c66e64c2 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:23.752686 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c35faf-6f63-49d5-aacd-5231c66e64c2 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:23.758225 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a73f61-39a4-4f18-9c5c-0fc25a11b689 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c15327c36c8c49ac87a3b3e9ab49eea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:23.758862 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a73f61-39a4-4f18-9c5c-0fc25a11b689 service swift] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:23.759143 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a73f61-39a4-4f18-9c5c-0fc25a11b689 service swift] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:23.759419 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a73f61-39a4-4f18-9c5c-0fc25a11b689 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:23.767649 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a73f61-39a4-4f18-9c5c-0fc25a11b689 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:23.769326 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a73f61-39a4-4f18-9c5c-0fc25a11b689 service swift] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:23.777286 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 716/1406] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 30 10:33:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:33:24.070865 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a893677-43d3-4985-a1d4-11ee1af26563 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:24.071658 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a893677-43d3-4985-a1d4-11ee1af26563 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:24.072093 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a893677-43d3-4985-a1d4-11ee1af26563 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:24.073803 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 691/1407] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:33:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:24.079033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d538b5-81cb-4c36-8260-9db058cb2e21 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:24.079322 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d538b5-81cb-4c36-8260-9db058cb2e21 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:24.079597 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d538b5-81cb-4c36-8260-9db058cb2e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:24.085751 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=67 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:24.099959 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c9d538b5-81cb-4c36-8260-9db058cb2e21 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:24.101453 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c9d538b5-81cb-4c36-8260-9db058cb2e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:24.109496 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 717/1408] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:33:24.154724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a893677-43d3-4985-a1d4-11ee1af26563 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:24.171698 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a893677-43d3-4985-a1d4-11ee1af26563 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:24.177483 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915c2ba-74ac-4a8f-9ad7-ccd2e2627c97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:24.178136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915c2ba-74ac-4a8f-9ad7-ccd2e2627c97 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:24.178449 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915c2ba-74ac-4a8f-9ad7-ccd2e2627c97 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:24.178721 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915c2ba-74ac-4a8f-9ad7-ccd2e2627c97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:24.188420 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915c2ba-74ac-4a8f-9ad7-ccd2e2627c97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:24.190078 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915c2ba-74ac-4a8f-9ad7-ccd2e2627c97 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:24.196220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:24.204916 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 692/1409] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:33:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:33:34.093891 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:45.972789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7a709-d773-4395-b0cd-9e22fc64edb3 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:45.973503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7a709-d773-4395-b0cd-9e22fc64edb3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:45.973503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7a709-d773-4395-b0cd-9e22fc64edb3 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:45.974769 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 718/1410] 10.222.0.59 () {54 vars in 918 bytes} [Thu Jun 30 10:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:45.980250 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e023b-055b-482a-be7a-94a6917e83d4 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:45.980774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e023b-055b-482a-be7a-94a6917e83d4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:45.980880 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e023b-055b-482a-be7a-94a6917e83d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:45.999968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-af2e023b-055b-482a-be7a-94a6917e83d4 None None] MFA Rules not processed for user `48709a771ab64ed38018873313f37c84`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:46.001352 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-af2e023b-055b-482a-be7a-94a6917e83d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:46.010707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 693/1411] 10.222.0.59 () {58 vars in 1015 bytes} [Thu Jun 30 10:33:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:33:46.027846 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38a10c-c527-463e-b1a0-65a4daee333b None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:46.028200 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38a10c-c527-463e-b1a0-65a4daee333b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:46.028481 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38a10c-c527-463e-b1a0-65a4daee333b None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:46.029889 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 719/1412] 10.222.0.59 () {54 vars in 918 bytes} [Thu Jun 30 10:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:46.034612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cd099-5835-4ffd-b029-234d255bc25b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:46.034913 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cd099-5835-4ffd-b029-234d255bc25b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:46.035192 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cd099-5835-4ffd-b029-234d255bc25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:46.054286 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-900cd099-5835-4ffd-b029-234d255bc25b None None] MFA Rules not processed for user `1bfd036d747241d9bc314b60bf8648b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:46.055469 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-900cd099-5835-4ffd-b029-234d255bc25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:46.064588 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 694/1413] 10.222.0.59 () {58 vars in 1015 bytes} [Thu Jun 30 10:33:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:33:48.536436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589fcdf-656a-463e-9664-2a8bcae4e6e2 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:48.536908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589fcdf-656a-463e-9664-2a8bcae4e6e2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:48.537051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589fcdf-656a-463e-9664-2a8bcae4e6e2 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:48.538449 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 720/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:33:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:48.543568 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65999b3c-bfdc-44ec-a923-289521cad7c3 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:48.543970 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65999b3c-bfdc-44ec-a923-289521cad7c3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:48.544132 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65999b3c-bfdc-44ec-a923-289521cad7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:48.561298 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-65999b3c-bfdc-44ec-a923-289521cad7c3 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:48.562479 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-65999b3c-bfdc-44ec-a923-289521cad7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:48.570555 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 695/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:33:48.613984 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589fcdf-656a-463e-9664-2a8bcae4e6e2 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:48.629898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589fcdf-656a-463e-9664-2a8bcae4e6e2 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:48.635204 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142bbba-895e-43cb-a516-4539cf60c593 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:48.635829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142bbba-895e-43cb-a516-4539cf60c593 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:48.636115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142bbba-895e-43cb-a516-4539cf60c593 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:48.636395 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142bbba-895e-43cb-a516-4539cf60c593 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:48.644782 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142bbba-895e-43cb-a516-4539cf60c593 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:48.646947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142bbba-895e-43cb-a516-4539cf60c593 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:48.656222 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 721/1416] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:33:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:33:49.564167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccfbed-cbd5-4e63-ab66-253aa290dee7 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:49.564759 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccfbed-cbd5-4e63-ab66-253aa290dee7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:49.564759 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccfbed-cbd5-4e63-ab66-253aa290dee7 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:49.566070 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 696/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:49.571497 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2070d68-2dbd-45f2-ab25-83996d77be40 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:49.571932 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2070d68-2dbd-45f2-ab25-83996d77be40 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:49.572056 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2070d68-2dbd-45f2-ab25-83996d77be40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:49.590526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a2070d68-2dbd-45f2-ab25-83996d77be40 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:49.591719 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a2070d68-2dbd-45f2-ab25-83996d77be40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:49.599311 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 722/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:33:49.750244 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eccfbed-cbd5-4e63-ab66-253aa290dee7 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:49.764174 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eccfbed-cbd5-4e63-ab66-253aa290dee7 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:49.769561 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625e674-cbc0-4509-bc20-5e856cc277a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:49.770724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625e674-cbc0-4509-bc20-5e856cc277a6 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:49.771007 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625e674-cbc0-4509-bc20-5e856cc277a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:49.771284 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625e674-cbc0-4509-bc20-5e856cc277a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:49.779276 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625e674-cbc0-4509-bc20-5e856cc277a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:49.780909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625e674-cbc0-4509-bc20-5e856cc277a6 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:49.790883 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 697/1419] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:33:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:33:50.678763 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7e08b-6839-46c4-a64e-86361bf7797d None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:50.679303 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7e08b-6839-46c4-a64e-86361bf7797d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:50.679403 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7e08b-6839-46c4-a64e-86361bf7797d None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:50.680835 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 723/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:50.685640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392362d-33a7-4031-ad7c-b5aeeb16d7ec None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:50.686112 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392362d-33a7-4031-ad7c-b5aeeb16d7ec None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:50.686220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392362d-33a7-4031-ad7c-b5aeeb16d7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:50.704465 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-5392362d-33a7-4031-ad7c-b5aeeb16d7ec None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:50.705695 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5392362d-33a7-4031-ad7c-b5aeeb16d7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:50.713391 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 698/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:33:50.861206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7e08b-6839-46c4-a64e-86361bf7797d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:50.876207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7e08b-6839-46c4-a64e-86361bf7797d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:50.881580 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd8376-52e1-495b-97a0-bad13ae4af46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:50.882203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd8376-52e1-495b-97a0-bad13ae4af46 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:50.882490 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd8376-52e1-495b-97a0-bad13ae4af46 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:50.882765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd8376-52e1-495b-97a0-bad13ae4af46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:50.891001 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd8376-52e1-495b-97a0-bad13ae4af46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:50.892607 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd8376-52e1-495b-97a0-bad13ae4af46 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:50.901875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 724/1422] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:33:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:33:51.759197 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52175c4d-d45c-4b5c-8dd9-43202d328c96 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:51.759747 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52175c4d-d45c-4b5c-8dd9-43202d328c96 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:51.759747 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52175c4d-d45c-4b5c-8dd9-43202d328c96 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:51.761168 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 699/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:51.766266 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21682685-784f-4282-a65b-47fc4f68af1d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:51.766661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21682685-784f-4282-a65b-47fc4f68af1d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:51.766831 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21682685-784f-4282-a65b-47fc4f68af1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:51.785405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-21682685-784f-4282-a65b-47fc4f68af1d None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:51.786609 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-21682685-784f-4282-a65b-47fc4f68af1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:51.794311 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 725/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:33:51.943224 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52175c4d-d45c-4b5c-8dd9-43202d328c96 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:51.957084 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52175c4d-d45c-4b5c-8dd9-43202d328c96 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:51.962961 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac3138-b980-442e-8f6e-6c902aa6d929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:51.963584 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac3138-b980-442e-8f6e-6c902aa6d929 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:51.963867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac3138-b980-442e-8f6e-6c902aa6d929 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:51.964140 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac3138-b980-442e-8f6e-6c902aa6d929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:51.972075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac3138-b980-442e-8f6e-6c902aa6d929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:51.973656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac3138-b980-442e-8f6e-6c902aa6d929 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:51.983040 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 700/1425] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:33:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:33:52.841223 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878ea9e-797d-4a03-a938-83c9544207c4 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:52.841763 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878ea9e-797d-4a03-a938-83c9544207c4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:52.841763 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878ea9e-797d-4a03-a938-83c9544207c4 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:52.843199 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 726/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:52.848151 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3724d4-1280-4fdb-b2c7-239018bffe2e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:52.848581 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3724d4-1280-4fdb-b2c7-239018bffe2e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:52.848740 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3724d4-1280-4fdb-b2c7-239018bffe2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:52.867091 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-de3724d4-1280-4fdb-b2c7-239018bffe2e None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:52.868282 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-de3724d4-1280-4fdb-b2c7-239018bffe2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:52.876203 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 701/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:33:53.028299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878ea9e-797d-4a03-a938-83c9544207c4 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:53.042544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878ea9e-797d-4a03-a938-83c9544207c4 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:53.047833 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91b988-bdfd-4f66-a2c2-1b93df3d0ce0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:53.048459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91b988-bdfd-4f66-a2c2-1b93df3d0ce0 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:53.048775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91b988-bdfd-4f66-a2c2-1b93df3d0ce0 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:53.049056 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91b988-bdfd-4f66-a2c2-1b93df3d0ce0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:53.057947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91b988-bdfd-4f66-a2c2-1b93df3d0ce0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:53.059539 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91b988-bdfd-4f66-a2c2-1b93df3d0ce0 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:53.069414 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 727/1428] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:33:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:33:53.861591 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3e2fd-c507-4393-94d8-ddd258b39a73 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:53.862148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3e2fd-c507-4393-94d8-ddd258b39a73 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:53.862148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3e2fd-c507-4393-94d8-ddd258b39a73 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:53.863536 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 702/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:53.868490 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d7341-bbe1-4b48-87fd-d1ebad90c536 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:53.868925 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d7341-bbe1-4b48-87fd-d1ebad90c536 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:53.869080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d7341-bbe1-4b48-87fd-d1ebad90c536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:53.887258 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-df8d7341-bbe1-4b48-87fd-d1ebad90c536 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:53.888386 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-df8d7341-bbe1-4b48-87fd-d1ebad90c536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:53.896679 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 728/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:33:54.045574 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3e2fd-c507-4393-94d8-ddd258b39a73 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:54.059853 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3e2fd-c507-4393-94d8-ddd258b39a73 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:54.065046 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b3c95-2c25-420c-93e8-7b68371e0cd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:54.065668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b3c95-2c25-420c-93e8-7b68371e0cd9 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:54.065948 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b3c95-2c25-420c-93e8-7b68371e0cd9 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:54.066220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b3c95-2c25-420c-93e8-7b68371e0cd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:54.074588 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b3c95-2c25-420c-93e8-7b68371e0cd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:54.076171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b3c95-2c25-420c-93e8-7b68371e0cd9 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:54.085925 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 703/1431] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:33:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:33:54.893558 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63043e-76fb-4936-b2f9-845cf7e47681 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:54.894102 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63043e-76fb-4936-b2f9-845cf7e47681 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:54.894229 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63043e-76fb-4936-b2f9-845cf7e47681 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:54.895613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 729/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:54.900761 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6e544-5b0e-4356-9585-1a9cc821d75f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:54.901173 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6e544-5b0e-4356-9585-1a9cc821d75f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:54.901316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6e544-5b0e-4356-9585-1a9cc821d75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:54.919241 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-63e6e544-5b0e-4356-9585-1a9cc821d75f None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:54.920410 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-63e6e544-5b0e-4356-9585-1a9cc821d75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:54.928661 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 704/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:33:55.076957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63043e-76fb-4936-b2f9-845cf7e47681 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:55.091072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63043e-76fb-4936-b2f9-845cf7e47681 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:55.096364 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8febe4-8cea-4c27-828c-ddd62774260d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:55.097019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8febe4-8cea-4c27-828c-ddd62774260d service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:55.097304 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8febe4-8cea-4c27-828c-ddd62774260d service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:55.097585 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8febe4-8cea-4c27-828c-ddd62774260d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:55.105827 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8febe4-8cea-4c27-828c-ddd62774260d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:55.107403 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8febe4-8cea-4c27-828c-ddd62774260d service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:55.117327 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 730/1434] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:33:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:33:55.917361 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb7f66-cff5-4087-a283-d05ddead1507 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:55.917899 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb7f66-cff5-4087-a283-d05ddead1507 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:55.917899 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb7f66-cff5-4087-a283-d05ddead1507 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:55.919276 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 705/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:55.924005 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b838533-48f7-4cbb-8537-dd413d0d16ad None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:55.924453 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b838533-48f7-4cbb-8537-dd413d0d16ad None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:55.924596 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b838533-48f7-4cbb-8537-dd413d0d16ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:55.942114 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8b838533-48f7-4cbb-8537-dd413d0d16ad None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:55.943286 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8b838533-48f7-4cbb-8537-dd413d0d16ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:55.950978 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 731/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:33:56.105551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb7f66-cff5-4087-a283-d05ddead1507 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:56.119672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb7f66-cff5-4087-a283-d05ddead1507 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:56.124971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661a577-6267-44eb-b5f2-5d365d85e5eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:56.125598 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661a577-6267-44eb-b5f2-5d365d85e5eb service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:56.125886 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661a577-6267-44eb-b5f2-5d365d85e5eb service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:56.126168 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661a577-6267-44eb-b5f2-5d365d85e5eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:56.134721 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661a577-6267-44eb-b5f2-5d365d85e5eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:56.136337 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661a577-6267-44eb-b5f2-5d365d85e5eb service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:56.146266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 706/1437] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:33:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:33:56.946259 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55f539-794b-4776-94f1-0399fa53abf1 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:56.946852 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55f539-794b-4776-94f1-0399fa53abf1 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:56.946852 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55f539-794b-4776-94f1-0399fa53abf1 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:56.948188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 732/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:56.953171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b171e2-3f84-4e6e-8690-ec4eeb339db4 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:56.953600 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b171e2-3f84-4e6e-8690-ec4eeb339db4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:56.953735 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b171e2-3f84-4e6e-8690-ec4eeb339db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:56.971347 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-66b171e2-3f84-4e6e-8690-ec4eeb339db4 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:56.972578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-66b171e2-3f84-4e6e-8690-ec4eeb339db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:56.981115 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 707/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:33:57.131090 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55f539-794b-4776-94f1-0399fa53abf1 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:57.145470 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55f539-794b-4776-94f1-0399fa53abf1 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:57.150677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e6415-3a53-466f-b465-e0c8706a2222 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:57.151290 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e6415-3a53-466f-b465-e0c8706a2222 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:57.151575 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e6415-3a53-466f-b465-e0c8706a2222 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:57.151844 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e6415-3a53-466f-b465-e0c8706a2222 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:57.159665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e6415-3a53-466f-b465-e0c8706a2222 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:57.161750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e6415-3a53-466f-b465-e0c8706a2222 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:57.170836 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 733/1440] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:33:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:33:59.101794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0a173-d8eb-4995-8bc2-18008fd3f08d None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:59.102374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0a173-d8eb-4995-8bc2-18008fd3f08d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:59.102374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0a173-d8eb-4995-8bc2-18008fd3f08d None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:59.103741 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 708/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:33:59.108879 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af513de-44f8-40ac-81f8-c28a56b28a55 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:59.109354 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af513de-44f8-40ac-81f8-c28a56b28a55 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:59.109474 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af513de-44f8-40ac-81f8-c28a56b28a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:59.127352 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-6af513de-44f8-40ac-81f8-c28a56b28a55 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:33:59.128556 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6af513de-44f8-40ac-81f8-c28a56b28a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:59.136622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 734/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:33:59.174934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0a173-d8eb-4995-8bc2-18008fd3f08d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:59.185304 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0a173-d8eb-4995-8bc2-18008fd3f08d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:59.188746 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48edd6ed-3508-42c8-a91d-d0b57409a433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:59.189368 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edd6ed-3508-42c8-a91d-d0b57409a433 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:59.189653 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edd6ed-3508-42c8-a91d-d0b57409a433 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:59.189928 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edd6ed-3508-42c8-a91d-d0b57409a433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:59.199055 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48edd6ed-3508-42c8-a91d-d0b57409a433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:59.200485 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48edd6ed-3508-42c8-a91d-d0b57409a433 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:59.210205 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 709/1443] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:33:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:34:01.385462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f1622-3317-412d-bc3d-141f9b416735 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:01.386042 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f1622-3317-412d-bc3d-141f9b416735 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:01.386042 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f1622-3317-412d-bc3d-141f9b416735 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:01.387399 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 735/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:01.392785 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469113bb-b46b-45c5-a995-0fb4d85e7a8e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:01.393244 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469113bb-b46b-45c5-a995-0fb4d85e7a8e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:01.393363 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469113bb-b46b-45c5-a995-0fb4d85e7a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:01.411182 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-469113bb-b46b-45c5-a995-0fb4d85e7a8e None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:01.412371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-469113bb-b46b-45c5-a995-0fb4d85e7a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:01.420080 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 710/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:01.458115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f1622-3317-412d-bc3d-141f9b416735 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:01.468458 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f1622-3317-412d-bc3d-141f9b416735 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:01.471911 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56068acb-2561-4047-a43d-fc665920c74e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:01.472550 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56068acb-2561-4047-a43d-fc665920c74e service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:01.472836 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56068acb-2561-4047-a43d-fc665920c74e service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:01.473111 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56068acb-2561-4047-a43d-fc665920c74e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:01.482050 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56068acb-2561-4047-a43d-fc665920c74e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:01.483458 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56068acb-2561-4047-a43d-fc665920c74e service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:01.492848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 736/1446] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:34:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:34:03.820471 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c6b26-1202-4d46-b109-9d0730600eb5 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:03.821048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c6b26-1202-4d46-b109-9d0730600eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:03.821048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c6b26-1202-4d46-b109-9d0730600eb5 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:03.822439 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 711/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:03.827731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a3ad8-8deb-4c91-ba63-eadd3900ef3a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:03.828174 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a3ad8-8deb-4c91-ba63-eadd3900ef3a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:03.828285 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a3ad8-8deb-4c91-ba63-eadd3900ef3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:03.845608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ad9a3ad8-8deb-4c91-ba63-eadd3900ef3a None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:03.846794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ad9a3ad8-8deb-4c91-ba63-eadd3900ef3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:03.855271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 737/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:03.894459 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c6b26-1202-4d46-b109-9d0730600eb5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:03.904913 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c6b26-1202-4d46-b109-9d0730600eb5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:03.908382 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466ff00-1d9a-4ab3-8ef6-5b34f1d918fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:03.909039 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466ff00-1d9a-4ab3-8ef6-5b34f1d918fd service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:03.909326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466ff00-1d9a-4ab3-8ef6-5b34f1d918fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:03.909605 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466ff00-1d9a-4ab3-8ef6-5b34f1d918fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:03.918878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466ff00-1d9a-4ab3-8ef6-5b34f1d918fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:03.920315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466ff00-1d9a-4ab3-8ef6-5b34f1d918fd service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:03.930261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 712/1449] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:34:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:34:06.078370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcf4c7-4c8a-4c7f-923f-626dd3af12cd None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:06.078970 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcf4c7-4c8a-4c7f-923f-626dd3af12cd None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:06.078970 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcf4c7-4c8a-4c7f-923f-626dd3af12cd None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:06.080261 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 738/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:06.086323 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4faf6ab-3112-4037-8b95-18d04963737f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:06.086791 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4faf6ab-3112-4037-8b95-18d04963737f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:06.086901 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4faf6ab-3112-4037-8b95-18d04963737f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:06.105355 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a4faf6ab-3112-4037-8b95-18d04963737f None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:06.106550 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a4faf6ab-3112-4037-8b95-18d04963737f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:06.114430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 713/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:34:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:06.153161 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcf4c7-4c8a-4c7f-923f-626dd3af12cd None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:06.163694 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcf4c7-4c8a-4c7f-923f-626dd3af12cd None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:06.167189 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510debf0-a876-4538-872e-7a972b63ecd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:06.167812 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510debf0-a876-4538-872e-7a972b63ecd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:06.168096 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510debf0-a876-4538-872e-7a972b63ecd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:06.168373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510debf0-a876-4538-872e-7a972b63ecd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:06.177215 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510debf0-a876-4538-872e-7a972b63ecd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:06.178640 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510debf0-a876-4538-872e-7a972b63ecd7 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:06.187903 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 739/1452] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:34:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:34:08.284790 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520dc379-e0a1-40f0-a70a-0ee7eb7ae369 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:08.285257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520dc379-e0a1-40f0-a70a-0ee7eb7ae369 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:08.285365 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520dc379-e0a1-40f0-a70a-0ee7eb7ae369 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:08.286770 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 714/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:08.291881 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42958d-1c5b-4150-bd28-ffcc9db60ec7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:08.292264 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42958d-1c5b-4150-bd28-ffcc9db60ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:08.292447 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42958d-1c5b-4150-bd28-ffcc9db60ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:08.309793 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-3b42958d-1c5b-4150-bd28-ffcc9db60ec7 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:08.310979 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3b42958d-1c5b-4150-bd28-ffcc9db60ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:08.319212 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 740/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:08.358333 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520dc379-e0a1-40f0-a70a-0ee7eb7ae369 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:08.368727 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520dc379-e0a1-40f0-a70a-0ee7eb7ae369 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:08.372804 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db189d7b-5c80-4cae-8ace-11dc7a9a513b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:08.373423 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db189d7b-5c80-4cae-8ace-11dc7a9a513b service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:08.373702 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db189d7b-5c80-4cae-8ace-11dc7a9a513b service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:08.373974 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db189d7b-5c80-4cae-8ace-11dc7a9a513b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:08.383163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db189d7b-5c80-4cae-8ace-11dc7a9a513b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:08.384622 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db189d7b-5c80-4cae-8ace-11dc7a9a513b service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:08.393822 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 715/1455] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:34:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:34:10.587135 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d098995-62d4-41ee-a11a-c7b7eba00705 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:10.587665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d098995-62d4-41ee-a11a-c7b7eba00705 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:10.587665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d098995-62d4-41ee-a11a-c7b7eba00705 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:10.589024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 741/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:10.594158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1784026-5a63-4e7b-9c11-018fafde2661 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:10.594574 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1784026-5a63-4e7b-9c11-018fafde2661 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:10.594691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1784026-5a63-4e7b-9c11-018fafde2661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:10.612199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b1784026-5a63-4e7b-9c11-018fafde2661 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:10.613553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b1784026-5a63-4e7b-9c11-018fafde2661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:10.621247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 716/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:10.658849 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d098995-62d4-41ee-a11a-c7b7eba00705 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:10.669595 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d098995-62d4-41ee-a11a-c7b7eba00705 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:10.673035 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e1099-a8e7-4dd5-bc4e-5f36b80ae95b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:10.673654 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e1099-a8e7-4dd5-bc4e-5f36b80ae95b service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:10.673930 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e1099-a8e7-4dd5-bc4e-5f36b80ae95b service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:10.674204 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e1099-a8e7-4dd5-bc4e-5f36b80ae95b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:10.682932 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e1099-a8e7-4dd5-bc4e-5f36b80ae95b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:10.684343 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e1099-a8e7-4dd5-bc4e-5f36b80ae95b service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:10.693981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 742/1458] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:34:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:34:12.761441 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044ade5-87cd-441b-8175-9d9a0001aba8 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:12.762018 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044ade5-87cd-441b-8175-9d9a0001aba8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:12.762018 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044ade5-87cd-441b-8175-9d9a0001aba8 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:12.763368 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 717/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:12.768630 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7be760-b423-4fda-bdff-0716f40c6ad0 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:12.769060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7be760-b423-4fda-bdff-0716f40c6ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:12.769174 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7be760-b423-4fda-bdff-0716f40c6ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:12.786880 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-7e7be760-b423-4fda-bdff-0716f40c6ad0 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:12.788060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7e7be760-b423-4fda-bdff-0716f40c6ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:12.795709 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 743/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:12.832860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044ade5-87cd-441b-8175-9d9a0001aba8 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:12.843210 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044ade5-87cd-441b-8175-9d9a0001aba8 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:12.846616 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c360e-485b-46d2-b8c0-f1f5c9dc1359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:12.847230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c360e-485b-46d2-b8c0-f1f5c9dc1359 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:12.848032 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c360e-485b-46d2-b8c0-f1f5c9dc1359 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:12.848307 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c360e-485b-46d2-b8c0-f1f5c9dc1359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:12.857128 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c360e-485b-46d2-b8c0-f1f5c9dc1359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:12.858550 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c360e-485b-46d2-b8c0-f1f5c9dc1359 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:12.868325 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 718/1461] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:34:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:34:14.928986 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68968afc-ec2c-4d89-825c-2a9fa6f3e2e6 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:14.929574 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68968afc-ec2c-4d89-825c-2a9fa6f3e2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:14.929574 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68968afc-ec2c-4d89-825c-2a9fa6f3e2e6 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:14.930953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 744/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:14.936210 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579f20b-8d6f-4b65-a1d2-224f82df1bad None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:14.936664 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579f20b-8d6f-4b65-a1d2-224f82df1bad None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:14.936807 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579f20b-8d6f-4b65-a1d2-224f82df1bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:14.942763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=79 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:14.955010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3579f20b-8d6f-4b65-a1d2-224f82df1bad None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:14.956200 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3579f20b-8d6f-4b65-a1d2-224f82df1bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:14.963933 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 719/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:15.001856 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68968afc-ec2c-4d89-825c-2a9fa6f3e2e6 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:15.007228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=73 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:15.013659 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68968afc-ec2c-4d89-825c-2a9fa6f3e2e6 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:15.017204 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbcd36-b97e-4af8-bce4-8ec145f9b072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:15.017884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbcd36-b97e-4af8-bce4-8ec145f9b072 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:15.018167 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbcd36-b97e-4af8-bce4-8ec145f9b072 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:15.018442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbcd36-b97e-4af8-bce4-8ec145f9b072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:15.027239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbcd36-b97e-4af8-bce4-8ec145f9b072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:15.028681 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbcd36-b97e-4af8-bce4-8ec145f9b072 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:15.038480 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 745/1464] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:34:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:34:17.117109 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094b57e-650a-45c1-997a-263507246092 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:17.117669 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094b57e-650a-45c1-997a-263507246092 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:17.117669 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094b57e-650a-45c1-997a-263507246092 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:17.119063 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 720/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:17.124160 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e8fa3-6448-49cc-8de8-0af8ed2dcbaf None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:17.124596 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e8fa3-6448-49cc-8de8-0af8ed2dcbaf None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:17.124755 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e8fa3-6448-49cc-8de8-0af8ed2dcbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:17.142437 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d14e8fa3-6448-49cc-8de8-0af8ed2dcbaf None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:17.143623 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d14e8fa3-6448-49cc-8de8-0af8ed2dcbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:17.151864 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 746/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:17.186965 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094b57e-650a-45c1-997a-263507246092 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:17.198008 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094b57e-650a-45c1-997a-263507246092 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:17.201479 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22693e68-e792-4003-93db-134bedc86baf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:17.202103 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22693e68-e792-4003-93db-134bedc86baf service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:17.202389 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22693e68-e792-4003-93db-134bedc86baf service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:17.202674 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22693e68-e792-4003-93db-134bedc86baf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:17.212134 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22693e68-e792-4003-93db-134bedc86baf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:17.213606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22693e68-e792-4003-93db-134bedc86baf service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:17.222898 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 721/1467] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:34:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:34:19.256862 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4eb1a-80da-41b3-8dc2-dd37208ef978 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:19.257424 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4eb1a-80da-41b3-8dc2-dd37208ef978 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:19.257424 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4eb1a-80da-41b3-8dc2-dd37208ef978 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:19.258952 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 747/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:19.264182 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f5798-797c-463e-8e28-b47012ce5bb2 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:19.264964 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f5798-797c-463e-8e28-b47012ce5bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:19.265252 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f5798-797c-463e-8e28-b47012ce5bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:19.283057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6b4f5798-797c-463e-8e28-b47012ce5bb2 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:19.284241 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6b4f5798-797c-463e-8e28-b47012ce5bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:19.292471 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 722/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:19.328901 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4eb1a-80da-41b3-8dc2-dd37208ef978 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:19.340351 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4eb1a-80da-41b3-8dc2-dd37208ef978 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:19.343888 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1f6b8-9c78-4e1b-ab60-67998b448588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:19.344545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1f6b8-9c78-4e1b-ab60-67998b448588 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:19.344836 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1f6b8-9c78-4e1b-ab60-67998b448588 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:19.345113 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1f6b8-9c78-4e1b-ab60-67998b448588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:19.354696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1f6b8-9c78-4e1b-ab60-67998b448588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:19.356128 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1f6b8-9c78-4e1b-ab60-67998b448588 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:19.365392 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 748/1470] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:34:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:34:29.278160 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=11 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:29.361578 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=14 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:39.116427 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc30844-5412-41e6-880f-003d8486326a None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:39.117007 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc30844-5412-41e6-880f-003d8486326a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:39.117007 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc30844-5412-41e6-880f-003d8486326a None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:39.118398 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 723/1471] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:39.123890 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d22b50-bb4d-4a6d-b08c-eda8801b8de9 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:39.124326 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d22b50-bb4d-4a6d-b08c-eda8801b8de9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:39.124433 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d22b50-bb4d-4a6d-b08c-eda8801b8de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:39.142263 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-23d22b50-bb4d-4a6d-b08c-eda8801b8de9 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:39.143438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-23d22b50-bb4d-4a6d-b08c-eda8801b8de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:39.152025 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 749/1472] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:39.199020 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece738c-c00a-410c-a77a-5fe33873833d None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:39.199312 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece738c-c00a-410c-a77a-5fe33873833d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:39.199597 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece738c-c00a-410c-a77a-5fe33873833d None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:39.200997 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 724/1473] 10.222.0.59 () {54 vars in 962 bytes} [Thu Jun 30 10:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:39.205736 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5d0a4-ffa2-4b88-8133-b4ecdc17b046 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:39.206033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5d0a4-ffa2-4b88-8133-b4ecdc17b046 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:39.206316 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5d0a4-ffa2-4b88-8133-b4ecdc17b046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:39.224535 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8fd5d0a4-ffa2-4b88-8133-b4ecdc17b046 None None] MFA Rules not processed for user `2522b8560d224aa1a973207a79ce6a99`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:39.225757 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8fd5d0a4-ffa2-4b88-8133-b4ecdc17b046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:39.232382 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 750/1474] 10.222.0.59 () {58 vars in 1059 bytes} [Thu Jun 30 10:34:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:39.240083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece738c-c00a-410c-a77a-5fe33873833d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:39.250751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece738c-c00a-410c-a77a-5fe33873833d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:39.254833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bf5b5-cdeb-4256-8324-a5891c87a9a0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2522b8560d224aa1a973207a79ce6a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:39.255571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bf5b5-cdeb-4256-8324-a5891c87a9a0 service glance] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:39.255859 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bf5b5-cdeb-4256-8324-a5891c87a9a0 service glance] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:39.256138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bf5b5-cdeb-4256-8324-a5891c87a9a0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:39.265628 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bf5b5-cdeb-4256-8324-a5891c87a9a0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:39.267069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bf5b5-cdeb-4256-8324-a5891c87a9a0 service glance] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:39.276675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 725/1475] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:34:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:34:41.376853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b7cec-735e-4f13-ac53-8393434456e8 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:41.377413 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b7cec-735e-4f13-ac53-8393434456e8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:41.377518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b7cec-735e-4f13-ac53-8393434456e8 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:41.379360 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 751/1476] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:34:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:41.384787 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1713f-7e23-40c8-8042-fb9084127c77 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:41.385243 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1713f-7e23-40c8-8042-fb9084127c77 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:41.385342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1713f-7e23-40c8-8042-fb9084127c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:41.403571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8ce1713f-7e23-40c8-8042-fb9084127c77 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:41.404775 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8ce1713f-7e23-40c8-8042-fb9084127c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:41.412299 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 726/1477] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:41.435842 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b7cec-735e-4f13-ac53-8393434456e8 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:41.449753 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b7cec-735e-4f13-ac53-8393434456e8 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:41.454263 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035a452-963d-45f7-97e0-d837bc841344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:41.454931 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035a452-963d-45f7-97e0-d837bc841344 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:41.455217 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035a452-963d-45f7-97e0-d837bc841344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:41.455488 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035a452-963d-45f7-97e0-d837bc841344 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:41.456224 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035a452-963d-45f7-97e0-d837bc841344 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:41.458678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: WARNING py.warnings [None req-2035a452-963d-45f7-97e0-d837bc841344 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:34:41.458678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: warnings.warn(msg) Jun 30 10:34:41.458678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: Jun 30 10:34:41.459850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035a452-963d-45f7-97e0-d837bc841344 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:41.480897 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 752/1478] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 30 10:34:41 2022] GET /identity/v3/projects => generated 2553 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:34:43.524259 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007bb5d-c32f-4043-8a43-385789d7fbb8 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:43.524790 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007bb5d-c32f-4043-8a43-385789d7fbb8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:43.524790 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007bb5d-c32f-4043-8a43-385789d7fbb8 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:43.526159 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 727/1479] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:34:43.531466 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c150a-737d-4c78-9f50-a7c7fa738a1a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:43.531892 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c150a-737d-4c78-9f50-a7c7fa738a1a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:43.532029 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c150a-737d-4c78-9f50-a7c7fa738a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:43.549522 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f23c150a-737d-4c78-9f50-a7c7fa738a1a None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:43.550720 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f23c150a-737d-4c78-9f50-a7c7fa738a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:43.558401 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 753/1480] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:43.601575 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007bb5d-c32f-4043-8a43-385789d7fbb8 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:43.616105 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007bb5d-c32f-4043-8a43-385789d7fbb8 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:43.621492 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e636e-f191-4a5e-8b03-87887ae46b0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:43.622118 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e636e-f191-4a5e-8b03-87887ae46b0a service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:43.622408 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e636e-f191-4a5e-8b03-87887ae46b0a service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:43.622688 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e636e-f191-4a5e-8b03-87887ae46b0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:43.631233 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e636e-f191-4a5e-8b03-87887ae46b0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:43.632859 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e636e-f191-4a5e-8b03-87887ae46b0a service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:43.642125 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 728/1481] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:34:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:34:45.858860 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a724119-862a-41e1-b06d-f83a65f90b2a None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:45.859444 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a724119-862a-41e1-b06d-f83a65f90b2a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:45.859444 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a724119-862a-41e1-b06d-f83a65f90b2a None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:45.860847 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 754/1482] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:45.866641 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfee3f-25ae-4e47-8cda-2afadb4b6126 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:45.867082 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfee3f-25ae-4e47-8cda-2afadb4b6126 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:45.867258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfee3f-25ae-4e47-8cda-2afadb4b6126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:45.885525 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a9bfee3f-25ae-4e47-8cda-2afadb4b6126 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:45.886766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a9bfee3f-25ae-4e47-8cda-2afadb4b6126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:45.894544 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 729/1483] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:45.930692 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a724119-862a-41e1-b06d-f83a65f90b2a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:45.942209 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a724119-862a-41e1-b06d-f83a65f90b2a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:45.945725 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7505efb-9cb5-428c-966f-096ac3a2568a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:45.946349 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7505efb-9cb5-428c-966f-096ac3a2568a service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:45.946631 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7505efb-9cb5-428c-966f-096ac3a2568a service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:45.946904 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7505efb-9cb5-428c-966f-096ac3a2568a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:45.955568 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7505efb-9cb5-428c-966f-096ac3a2568a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:45.957039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7505efb-9cb5-428c-966f-096ac3a2568a service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:45.966570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 755/1484] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:34:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:34:48.088248 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c41cec-d0c9-4940-b795-a8c219cc0d32 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:48.088838 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c41cec-d0c9-4940-b795-a8c219cc0d32 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:48.088838 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c41cec-d0c9-4940-b795-a8c219cc0d32 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:48.090175 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 730/1485] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:48.095246 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b729900-6572-4c8c-9ac7-8e7027b85c8b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:48.095689 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b729900-6572-4c8c-9ac7-8e7027b85c8b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:48.095795 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b729900-6572-4c8c-9ac7-8e7027b85c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:48.113346 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-6b729900-6572-4c8c-9ac7-8e7027b85c8b None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:48.114553 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6b729900-6572-4c8c-9ac7-8e7027b85c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:48.122289 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 756/1486] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:48.162359 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c41cec-d0c9-4940-b795-a8c219cc0d32 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:48.172840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c41cec-d0c9-4940-b795-a8c219cc0d32 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:48.176365 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7d95c-0e4d-43e2-a87f-034bac31e628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:48.176973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7d95c-0e4d-43e2-a87f-034bac31e628 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:48.177258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7d95c-0e4d-43e2-a87f-034bac31e628 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:48.177536 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7d95c-0e4d-43e2-a87f-034bac31e628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:48.186356 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7d95c-0e4d-43e2-a87f-034bac31e628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:48.187790 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7d95c-0e4d-43e2-a87f-034bac31e628 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:48.197633 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 731/1487] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:34:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:34:50.311800 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02989d-ad36-40cc-a727-15b2979b9ce6 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:50.312297 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02989d-ad36-40cc-a727-15b2979b9ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:50.312420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02989d-ad36-40cc-a727-15b2979b9ce6 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:50.313756 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 757/1488] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:50.318841 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c7247-8c84-472c-af1c-93529c6031a9 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:50.319286 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c7247-8c84-472c-af1c-93529c6031a9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:50.319404 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c7247-8c84-472c-af1c-93529c6031a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:50.336899 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-302c7247-8c84-472c-af1c-93529c6031a9 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:50.338096 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-302c7247-8c84-472c-af1c-93529c6031a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:50.345827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 732/1489] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:50.387309 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02989d-ad36-40cc-a727-15b2979b9ce6 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:50.397847 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02989d-ad36-40cc-a727-15b2979b9ce6 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:50.401288 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698036d-3eb9-4b6e-a018-e2cda694439b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:50.401911 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698036d-3eb9-4b6e-a018-e2cda694439b service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:50.402187 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698036d-3eb9-4b6e-a018-e2cda694439b service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:50.402459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698036d-3eb9-4b6e-a018-e2cda694439b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:50.413577 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698036d-3eb9-4b6e-a018-e2cda694439b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:50.415060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698036d-3eb9-4b6e-a018-e2cda694439b service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:50.424805 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 758/1490] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:34:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:34:52.622734 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1959ff-b328-4f72-8ba7-bd6c29b99dd6 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:52.623252 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1959ff-b328-4f72-8ba7-bd6c29b99dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:52.623252 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1959ff-b328-4f72-8ba7-bd6c29b99dd6 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:52.624668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 733/1491] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 30 10:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:34:52.629934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6076c-93a9-4a8a-a69a-ee0ca052d184 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:52.630335 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6076c-93a9-4a8a-a69a-ee0ca052d184 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:52.630499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6076c-93a9-4a8a-a69a-ee0ca052d184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:52.648291 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-6fc6076c-93a9-4a8a-a69a-ee0ca052d184 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:52.649522 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6fc6076c-93a9-4a8a-a69a-ee0ca052d184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:52.657309 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 759/1492] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 30 10:34:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:52.697154 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1959ff-b328-4f72-8ba7-bd6c29b99dd6 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:52.707559 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1959ff-b328-4f72-8ba7-bd6c29b99dd6 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:52.711033 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b40c37-e3fb-4144-a02f-994b80754de4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:52.711651 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b40c37-e3fb-4144-a02f-994b80754de4 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:52.711932 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b40c37-e3fb-4144-a02f-994b80754de4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:52.712203 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b40c37-e3fb-4144-a02f-994b80754de4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:52.720856 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b40c37-e3fb-4144-a02f-994b80754de4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:52.722772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b40c37-e3fb-4144-a02f-994b80754de4 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:52.732152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 734/1493] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:34:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:35:02.643246 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=33 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:35:02.728124 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=33 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:18.127834 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e389ba-a0dc-4b4d-81c3-be20ac4ed2b5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:18.128383 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e389ba-a0dc-4b4d-81c3-be20ac4ed2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:18.128383 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e389ba-a0dc-4b4d-81c3-be20ac4ed2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:18.145995 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b4e389ba-a0dc-4b4d-81c3-be20ac4ed2b5 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:36:18.147198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b4e389ba-a0dc-4b4d-81c3-be20ac4ed2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:36:18.155064 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 760/1494] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:36:18.163006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c224b5-b498-4c34-bdfb-d2e866f9d799 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:18.163487 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c224b5-b498-4c34-bdfb-d2e866f9d799 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:18.163629 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c224b5-b498-4c34-bdfb-d2e866f9d799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:18.181553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-75c224b5-b498-4c34-bdfb-d2e866f9d799 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:36:18.182750 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-75c224b5-b498-4c34-bdfb-d2e866f9d799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:36:18.192109 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 735/1495] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:36:18.196741 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e389ba-a0dc-4b4d-81c3-be20ac4ed2b5 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:18.206284 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e389ba-a0dc-4b4d-81c3-be20ac4ed2b5 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:18.210688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a54d4-6604-4a73-9e38-14e1ccc26c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:18.211323 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a54d4-6604-4a73-9e38-14e1ccc26c3d admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:18.211603 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a54d4-6604-4a73-9e38-14e1ccc26c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:18.211879 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a54d4-6604-4a73-9e38-14e1ccc26c3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:18.212651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a54d4-6604-4a73-9e38-14e1ccc26c3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:36:18.212959 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a54d4-6604-4a73-9e38-14e1ccc26c3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:18.213961 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: WARNING py.warnings [None req-e00a54d4-6604-4a73-9e38-14e1ccc26c3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:36:18.213961 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: warnings.warn(msg) Jun 30 10:36:18.213961 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: Jun 30 10:36:18.214855 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a54d4-6604-4a73-9e38-14e1ccc26c3d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:18.226085 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 761/1496] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:36:18.234341 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c224b5-b498-4c34-bdfb-d2e866f9d799 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:18.243840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c224b5-b498-4c34-bdfb-d2e866f9d799 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:18.248319 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fd5b8-a6c8-415d-95a1-86be59e7caf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:18.248991 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fd5b8-a6c8-415d-95a1-86be59e7caf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:18.249275 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fd5b8-a6c8-415d-95a1-86be59e7caf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:18.249550 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fd5b8-a6c8-415d-95a1-86be59e7caf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:18.250227 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fd5b8-a6c8-415d-95a1-86be59e7caf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:18.252631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: WARNING py.warnings [None req-305fd5b8-a6c8-415d-95a1-86be59e7caf1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:36:18.252631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: warnings.warn(msg) Jun 30 10:36:18.252631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: Jun 30 10:36:18.253889 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fd5b8-a6c8-415d-95a1-86be59e7caf1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:18.290871 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 736/1497] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:36:18 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:36:18.296309 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a54d4-6604-4a73-9e38-14e1ccc26c3d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:18.310548 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a54d4-6604-4a73-9e38-14e1ccc26c3d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:18.366310 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ee5cd-dcc9-4af0-8a27-a92a39f1d056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:18.366971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ee5cd-dcc9-4af0-8a27-a92a39f1d056 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:18.367255 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ee5cd-dcc9-4af0-8a27-a92a39f1d056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:18.367531 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ee5cd-dcc9-4af0-8a27-a92a39f1d056 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:18.368213 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ee5cd-dcc9-4af0-8a27-a92a39f1d056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:18.369239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: WARNING py.warnings [None req-819ee5cd-dcc9-4af0-8a27-a92a39f1d056 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:36:18.369239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: warnings.warn(msg) Jun 30 10:36:18.369239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: Jun 30 10:36:18.370459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ee5cd-dcc9-4af0-8a27-a92a39f1d056 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:18.389957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 762/1498] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:36:18 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:36:18.394152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fd5b8-a6c8-415d-95a1-86be59e7caf1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:18.404260 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fd5b8-a6c8-415d-95a1-86be59e7caf1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:18.408799 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c3915-2918-4176-a819-4e55ae3c4232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:18.409451 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c3915-2918-4176-a819-4e55ae3c4232 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:18.409739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c3915-2918-4176-a819-4e55ae3c4232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:18.410019 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c3915-2918-4176-a819-4e55ae3c4232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:18.410740 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c3915-2918-4176-a819-4e55ae3c4232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:18.411763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: WARNING py.warnings [None req-f17c3915-2918-4176-a819-4e55ae3c4232 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:36:18.411763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: warnings.warn(msg) Jun 30 10:36:18.411763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: Jun 30 10:36:18.412664 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c3915-2918-4176-a819-4e55ae3c4232 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:18.425677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 737/1499] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:36:18.429500 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ee5cd-dcc9-4af0-8a27-a92a39f1d056 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:18.439845 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ee5cd-dcc9-4af0-8a27-a92a39f1d056 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:18.444491 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e86594-44f9-4097-8053-08fc1624b50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:18.445200 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e86594-44f9-4097-8053-08fc1624b50b admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:18.445485 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e86594-44f9-4097-8053-08fc1624b50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:18.445761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e86594-44f9-4097-8053-08fc1624b50b admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:18.446477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e86594-44f9-4097-8053-08fc1624b50b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:18.447471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: WARNING py.warnings [None req-d9e86594-44f9-4097-8053-08fc1624b50b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:36:18.447471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: warnings.warn(msg) Jun 30 10:36:18.447471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: Jun 30 10:36:18.448387 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e86594-44f9-4097-8053-08fc1624b50b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:18.461794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 763/1500] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:36:18.465974 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c3915-2918-4176-a819-4e55ae3c4232 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:18.476150 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c3915-2918-4176-a819-4e55ae3c4232 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:18.480941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c0339-b345-4c3c-9d35-2bf693f09566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:18.481809 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c0339-b345-4c3c-9d35-2bf693f09566 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:18.482096 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c0339-b345-4c3c-9d35-2bf693f09566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:18.482375 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c0339-b345-4c3c-9d35-2bf693f09566 admin admin] PATH_INFO: `/v3/projects/4e6aafe8f5194b708d7db914260974ff/users/6afe8ea2d64846c29d4b8892c440e31c/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:18.497367 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c0339-b345-4c3c-9d35-2bf693f09566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e6aafe8f5194b708d7db914260974ff, user_id=6afe8ea2d64846c29d4b8892c440e31c, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:18.498395 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: WARNING py.warnings [None req-0d8c0339-b345-4c3c-9d35-2bf693f09566 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:36:18.498395 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: warnings.warn(msg) Jun 30 10:36:18.498395 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: Jun 30 10:36:18.500329 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c0339-b345-4c3c-9d35-2bf693f09566 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:18.512857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 738/1501] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:36:18 2022] PUT /identity/v3/projects/4e6aafe8f5194b708d7db914260974ff/users/6afe8ea2d64846c29d4b8892c440e31c/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:36:18.524913 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61bf38-91b2-4728-8ae6-cb7f759aaa80 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:18.525202 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61bf38-91b2-4728-8ae6-cb7f759aaa80 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:18.525479 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61bf38-91b2-4728-8ae6-cb7f759aaa80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:18.551952 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-af61bf38-91b2-4728-8ae6-cb7f759aaa80 None None] MFA Rules not processed for user `6afe8ea2d64846c29d4b8892c440e31c`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:36:18.553195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-af61bf38-91b2-4728-8ae6-cb7f759aaa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:36:18.618380 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 764/1502] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:36:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:36:18.631615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6e928-2fba-4729-826e-3be848e8513c None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:18.631907 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6e928-2fba-4729-826e-3be848e8513c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:18.632183 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6e928-2fba-4729-826e-3be848e8513c None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:18.633665 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 739/1503] 10.222.0.59 () {54 vars in 963 bytes} [Thu Jun 30 10:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:36:18.638578 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56621b-3aff-4ba2-a963-0b690ef895b8 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:18.638867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56621b-3aff-4ba2-a963-0b690ef895b8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:18.639143 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56621b-3aff-4ba2-a963-0b690ef895b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:18.656993 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-2e56621b-3aff-4ba2-a963-0b690ef895b8 None None] MFA Rules not processed for user `afb7ea0cfb9c423799848b912724cd75`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:36:18.658626 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2e56621b-3aff-4ba2-a963-0b690ef895b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:36:18.701102 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:18.709492 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 765/1504] 10.222.0.59 () {58 vars in 1060 bytes} [Thu Jun 30 10:36:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:36:18.717185 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6e928-2fba-4729-826e-3be848e8513c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:18.728253 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6e928-2fba-4729-826e-3be848e8513c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:18.731769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948d87d-fe36-4324-8cc0-c6e433d3b04e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:18.732389 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948d87d-fe36-4324-8cc0-c6e433d3b04e service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:18.732702 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948d87d-fe36-4324-8cc0-c6e433d3b04e service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:18.732979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948d87d-fe36-4324-8cc0-c6e433d3b04e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:18.741707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948d87d-fe36-4324-8cc0-c6e433d3b04e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:18.743140 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948d87d-fe36-4324-8cc0-c6e433d3b04e service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:18.751832 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 740/1505] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:36:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:36:18.792551 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a4fee-35fe-4cf9-8bca-cdc3a841bfca None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:18.792843 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a4fee-35fe-4cf9-8bca-cdc3a841bfca None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:18.793118 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a4fee-35fe-4cf9-8bca-cdc3a841bfca None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:18.794398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 766/1506] 10.222.0.59 () {52 vars in 829 bytes} [Thu Jun 30 10:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:36:18.798695 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948d87d-fe36-4324-8cc0-c6e433d3b04e service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:18.860051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948d87d-fe36-4324-8cc0-c6e433d3b04e service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:18.864462 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b510fd-3266-4f71-b3ee-777a4675f188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:18.865332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b510fd-3266-4f71-b3ee-777a4675f188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:18.865608 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b510fd-3266-4f71-b3ee-777a4675f188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:18.865879 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b510fd-3266-4f71-b3ee-777a4675f188 admin admin] PATH_INFO: `/v3/users/6afe8ea2d64846c29d4b8892c440e31c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:18.867029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b510fd-3266-4f71-b3ee-777a4675f188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6afe8ea2d64846c29d4b8892c440e31c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:18.868097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: WARNING py.warnings [None req-03b510fd-3266-4f71-b3ee-777a4675f188 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:36:18.868097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: warnings.warn(msg) Jun 30 10:36:18.868097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: Jun 30 10:36:18.869403 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b510fd-3266-4f71-b3ee-777a4675f188 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:18.934828 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-03b510fd-3266-4f71-b3ee-777a4675f188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6afe8ea2d64846c29d4b8892c440e31c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:36:18.935426 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-03b510fd-3266-4f71-b3ee-777a4675f188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6afe8ea2d64846c29d4b8892c440e31c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:36:18.948163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-03b510fd-3266-4f71-b3ee-777a4675f188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6afe8ea2d64846c29d4b8892c440e31c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:36:18.949002 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-03b510fd-3266-4f71-b3ee-777a4675f188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6afe8ea2d64846c29d4b8892c440e31c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:36:18.958849 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-03b510fd-3266-4f71-b3ee-777a4675f188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6afe8ea2d64846c29d4b8892c440e31c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:36:18.975694 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:18.986022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 741/1507] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:36:18 2022] DELETE /identity/v3/users/6afe8ea2d64846c29d4b8892c440e31c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:36:18.990395 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74231805-c9c9-40de-96ce-c78126b47307 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:18.990681 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74231805-c9c9-40de-96ce-c78126b47307 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:18.990956 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74231805-c9c9-40de-96ce-c78126b47307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:19.007915 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-74231805-c9c9-40de-96ce-c78126b47307 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:36:19.009132 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-74231805-c9c9-40de-96ce-c78126b47307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:36:19.069073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 767/1508] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:36:19.080290 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b510fd-3266-4f71-b3ee-777a4675f188 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:19.082019 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-03b510fd-3266-4f71-b3ee-777a4675f188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:36:19.137232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b510fd-3266-4f71-b3ee-777a4675f188 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:19.140791 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb443e8-2a45-494e-a97c-11b2e572196e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:19.141444 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb443e8-2a45-494e-a97c-11b2e572196e service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:19.142265 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb443e8-2a45-494e-a97c-11b2e572196e service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:19.142556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb443e8-2a45-494e-a97c-11b2e572196e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:19.151292 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb443e8-2a45-494e-a97c-11b2e572196e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:19.152767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb443e8-2a45-494e-a97c-11b2e572196e service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:19.162713 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 742/1509] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:36:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:36:19.514193 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74231805-c9c9-40de-96ce-c78126b47307 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:19.515732 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-74231805-c9c9-40de-96ce-c78126b47307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:36:19.528328 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74231805-c9c9-40de-96ce-c78126b47307 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:19.533306 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d7f2f-5884-4256-a0ce-9f86dac2d478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:19.534106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d7f2f-5884-4256-a0ce-9f86dac2d478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:19.534392 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d7f2f-5884-4256-a0ce-9f86dac2d478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:19.534671 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d7f2f-5884-4256-a0ce-9f86dac2d478 admin admin] PATH_INFO: `/v3/projects/4e6aafe8f5194b708d7db914260974ff` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:19.535894 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d7f2f-5884-4256-a0ce-9f86dac2d478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e6aafe8f5194b708d7db914260974ff)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:19.538672 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: WARNING py.warnings [None req-1c5d7f2f-5884-4256-a0ce-9f86dac2d478 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:36:19.538672 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: warnings.warn(msg) Jun 30 10:36:19.538672 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: Jun 30 10:36:19.538672 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d7f2f-5884-4256-a0ce-9f86dac2d478 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:19.602523 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1c5d7f2f-5884-4256-a0ce-9f86dac2d478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e6aafe8f5194b708d7db914260974ff', 'request_id': 'req-1c5d7f2f-5884-4256-a0ce-9f86dac2d478'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:36:19.614660 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1c5d7f2f-5884-4256-a0ce-9f86dac2d478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e6aafe8f5194b708d7db914260974ff', 'request_id': 'req-1c5d7f2f-5884-4256-a0ce-9f86dac2d478'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:36:19.629422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1c5d7f2f-5884-4256-a0ce-9f86dac2d478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e6aafe8f5194b708d7db914260974ff', 'request_id': 'req-1c5d7f2f-5884-4256-a0ce-9f86dac2d478'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:36:19.640653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1c5d7f2f-5884-4256-a0ce-9f86dac2d478 admin admin] The token cache is being invalidate because project 4e6aafe8f5194b708d7db914260974ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:36:19.640962 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1c5d7f2f-5884-4256-a0ce-9f86dac2d478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:36:19.641634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1c5d7f2f-5884-4256-a0ce-9f86dac2d478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:36:19.643523 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 768/1510] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:36:19 2022] DELETE /identity/v3/projects/4e6aafe8f5194b708d7db914260974ff => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:36:29.158874 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:29.637613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:37:58.883465 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcba93-504b-43cf-b4ac-4e141c7b8e80 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:37:58.884047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcba93-504b-43cf-b4ac-4e141c7b8e80 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:37:58.884047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcba93-504b-43cf-b4ac-4e141c7b8e80 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:37:58.885430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 743/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:37:58.890152 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358c7f8-fb2b-44ad-a5e6-38efdf3edb99 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:37:58.890583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358c7f8-fb2b-44ad-a5e6-38efdf3edb99 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:37:58.890688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358c7f8-fb2b-44ad-a5e6-38efdf3edb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:37:58.909093 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f358c7f8-fb2b-44ad-a5e6-38efdf3edb99 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:37:58.910301 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f358c7f8-fb2b-44ad-a5e6-38efdf3edb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:37:58.968986 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 769/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:37:59.127186 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcba93-504b-43cf-b4ac-4e141c7b8e80 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:37:59.128925 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-eafcba93-504b-43cf-b4ac-4e141c7b8e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:37:59.204351 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcba93-504b-43cf-b4ac-4e141c7b8e80 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:37:59.209642 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473ef74-5687-4543-901e-763beb1bd517 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:37:59.210278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473ef74-5687-4543-901e-763beb1bd517 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:37:59.210564 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473ef74-5687-4543-901e-763beb1bd517 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:37:59.210840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473ef74-5687-4543-901e-763beb1bd517 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:37:59.218901 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473ef74-5687-4543-901e-763beb1bd517 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:37:59.221114 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473ef74-5687-4543-901e-763beb1bd517 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:37:59.230762 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 744/1513] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:38:00.054168 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669df40b-9917-4d52-9187-245a705f7626 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:38:00.054701 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669df40b-9917-4d52-9187-245a705f7626 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:38:00.054701 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669df40b-9917-4d52-9187-245a705f7626 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:38:00.056042 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 770/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:38:00.060945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd0a54-6e37-455b-bb9e-588ef885a7a6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:38:00.061371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd0a54-6e37-455b-bb9e-588ef885a7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:38:00.061508 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd0a54-6e37-455b-bb9e-588ef885a7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:38:00.079749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4fcd0a54-6e37-455b-bb9e-588ef885a7a6 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:38:00.081005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4fcd0a54-6e37-455b-bb9e-588ef885a7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:38:00.088811 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 745/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:38:00.239537 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669df40b-9917-4d52-9187-245a705f7626 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:38:00.253451 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669df40b-9917-4d52-9187-245a705f7626 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:38:00.258727 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd34bec-d314-4b06-8a97-11e28dbb694e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:38:00.259350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd34bec-d314-4b06-8a97-11e28dbb694e service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:38:00.259660 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd34bec-d314-4b06-8a97-11e28dbb694e service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:38:00.259986 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd34bec-d314-4b06-8a97-11e28dbb694e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:38:00.268674 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd34bec-d314-4b06-8a97-11e28dbb694e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:38:00.270271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd34bec-d314-4b06-8a97-11e28dbb694e service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:38:00.279808 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 771/1516] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:38:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:38:01.610847 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae64337-7eea-4ebc-bbe5-75f357031c34 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:38:01.611562 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae64337-7eea-4ebc-bbe5-75f357031c34 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:38:01.611562 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae64337-7eea-4ebc-bbe5-75f357031c34 None None] PATH_INFO: `/v3` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:38:01.612685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 746/1517] 10.222.0.61 () {54 vars in 925 bytes} [Thu Jun 30 10:38:01 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:38:01.618606 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c3e32-b5ae-44aa-b9fc-8a24a3b6e87f None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:38:01.619090 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c3e32-b5ae-44aa-b9fc-8a24a3b6e87f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:38:01.619196 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c3e32-b5ae-44aa-b9fc-8a24a3b6e87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:38:01.636855 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-1b8c3e32-b5ae-44aa-b9fc-8a24a3b6e87f None None] MFA Rules not processed for user `48709a771ab64ed38018873313f37c84`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:38:01.638042 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1b8c3e32-b5ae-44aa-b9fc-8a24a3b6e87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:38:01.698762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 772/1518] 10.222.0.61 () {58 vars in 1015 bytes} [Thu Jun 30 10:38:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:38:05.555996 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffaf70-5117-4ee0-abf2-f8b096f35570 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:38:05.556555 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffaf70-5117-4ee0-abf2-f8b096f35570 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:38:05.556691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffaf70-5117-4ee0-abf2-f8b096f35570 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:38:05.558005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 747/1519] 10.222.0.59 () {54 vars in 960 bytes} [Thu Jun 30 10:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:38:05.562973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb1645-f7ff-4744-9d49-e2d38f5a4964 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:38:05.563363 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb1645-f7ff-4744-9d49-e2d38f5a4964 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:38:05.563528 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb1645-f7ff-4744-9d49-e2d38f5a4964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:38:05.581834 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-eaeb1645-f7ff-4744-9d49-e2d38f5a4964 None None] MFA Rules not processed for user `48709a771ab64ed38018873313f37c84`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:38:05.583025 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-eaeb1645-f7ff-4744-9d49-e2d38f5a4964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:38:05.591382 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 773/1520] 10.222.0.59 () {58 vars in 1057 bytes} [Thu Jun 30 10:38:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:38:05.599457 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffaf70-5117-4ee0-abf2-f8b096f35570 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:38:05.612842 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffaf70-5117-4ee0-abf2-f8b096f35570 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:38:05.617638 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5330fa-677e-4840-82f4-52495b3a176e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48709a771ab64ed38018873313f37c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:38:05.618286 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5330fa-677e-4840-82f4-52495b3a176e service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:38:05.618568 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5330fa-677e-4840-82f4-52495b3a176e service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:38:05.618844 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5330fa-677e-4840-82f4-52495b3a176e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:38:05.627447 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5330fa-677e-4840-82f4-52495b3a176e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:38:05.629069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5330fa-677e-4840-82f4-52495b3a176e service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:38:05.638495 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 748/1521] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:38:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:38:11.511745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a1fa1-b510-4871-9fa9-5895a7f402e3 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:38:11.512255 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a1fa1-b510-4871-9fa9-5895a7f402e3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:38:11.512255 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a1fa1-b510-4871-9fa9-5895a7f402e3 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:38:11.513633 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 774/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:38:11.518673 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92a1fb-44d7-4a62-9a46-3e8b933e3a59 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:38:11.519049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92a1fb-44d7-4a62-9a46-3e8b933e3a59 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:38:11.519232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92a1fb-44d7-4a62-9a46-3e8b933e3a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:38:11.537208 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ec92a1fb-44d7-4a62-9a46-3e8b933e3a59 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:38:11.538443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ec92a1fb-44d7-4a62-9a46-3e8b933e3a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:38:11.546267 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 749/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:38:11.700969 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a1fa1-b510-4871-9fa9-5895a7f402e3 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:38:11.715048 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a1fa1-b510-4871-9fa9-5895a7f402e3 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:38:11.720845 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c66bd-e8a3-475b-a239-e990a0beef92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:38:11.721470 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c66bd-e8a3-475b-a239-e990a0beef92 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:38:11.721753 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c66bd-e8a3-475b-a239-e990a0beef92 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:38:11.722037 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c66bd-e8a3-475b-a239-e990a0beef92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:38:11.730221 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c66bd-e8a3-475b-a239-e990a0beef92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:38:11.731799 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c66bd-e8a3-475b-a239-e990a0beef92 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:38:11.741682 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 775/1524] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:38:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:38:12.548376 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f7ce5-2ddd-464f-8f45-bc43834259ec None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:38:12.548945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f7ce5-2ddd-464f-8f45-bc43834259ec None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:38:12.548945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f7ce5-2ddd-464f-8f45-bc43834259ec None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:38:12.550330 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 750/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:38:12.555187 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df357c8a-9df8-47cd-a144-f025c7f64dca None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:38:12.555564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df357c8a-9df8-47cd-a144-f025c7f64dca None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:38:12.555753 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df357c8a-9df8-47cd-a144-f025c7f64dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:38:12.574040 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-df357c8a-9df8-47cd-a144-f025c7f64dca None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:38:12.575227 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-df357c8a-9df8-47cd-a144-f025c7f64dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:38:12.583498 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 776/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:38:12.736807 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f7ce5-2ddd-464f-8f45-bc43834259ec None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:38:12.750929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f7ce5-2ddd-464f-8f45-bc43834259ec None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:38:12.756184 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aac808-b4bf-4fc5-adf1-4cbc7348d54e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:38:12.756851 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aac808-b4bf-4fc5-adf1-4cbc7348d54e service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:38:12.757140 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aac808-b4bf-4fc5-adf1-4cbc7348d54e service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:38:12.757421 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aac808-b4bf-4fc5-adf1-4cbc7348d54e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:38:12.765408 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aac808-b4bf-4fc5-adf1-4cbc7348d54e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:38:12.767518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aac808-b4bf-4fc5-adf1-4cbc7348d54e service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:38:12.776791 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 751/1527] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:38:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:38:16.821529 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53184cb8-5d05-44c0-919f-0123c5094877 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:38:16.822164 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53184cb8-5d05-44c0-919f-0123c5094877 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:38:16.822164 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53184cb8-5d05-44c0-919f-0123c5094877 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:38:16.823456 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 777/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:38:16.828763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf127a5a-123e-4c4a-a1d8-2ac9a67ca7de None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:38:16.829204 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf127a5a-123e-4c4a-a1d8-2ac9a67ca7de None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:38:16.829311 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf127a5a-123e-4c4a-a1d8-2ac9a67ca7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:38:16.847914 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-cf127a5a-123e-4c4a-a1d8-2ac9a67ca7de None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:38:16.849127 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cf127a5a-123e-4c4a-a1d8-2ac9a67ca7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:38:16.857068 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 752/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:38:16.893949 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53184cb8-5d05-44c0-919f-0123c5094877 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:38:16.895581 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-53184cb8-5d05-44c0-919f-0123c5094877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:38:16.951317 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53184cb8-5d05-44c0-919f-0123c5094877 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:38:16.955364 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ce0eb-c074-4751-a52e-02a22cae7652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:38:16.955987 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ce0eb-c074-4751-a52e-02a22cae7652 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:38:16.956264 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ce0eb-c074-4751-a52e-02a22cae7652 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:38:16.956557 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ce0eb-c074-4751-a52e-02a22cae7652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:38:16.965263 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ce0eb-c074-4751-a52e-02a22cae7652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:38:16.966678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ce0eb-c074-4751-a52e-02a22cae7652 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:38:16.971809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:38:16.977111 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 778/1530] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:38:19.003516 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4c55c-9e61-490b-915a-b4c93c5c854f None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:38:19.004116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4c55c-9e61-490b-915a-b4c93c5c854f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:38:19.004116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4c55c-9e61-490b-915a-b4c93c5c854f None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:38:19.005511 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 753/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:38:19.010560 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fe3ab-21ea-4b3c-8516-ede1c870966c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:38:19.011036 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fe3ab-21ea-4b3c-8516-ede1c870966c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:38:19.011140 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fe3ab-21ea-4b3c-8516-ede1c870966c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:38:19.029003 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e08fe3ab-21ea-4b3c-8516-ede1c870966c None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:38:19.030182 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e08fe3ab-21ea-4b3c-8516-ede1c870966c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:38:19.038625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 779/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:38:19.076817 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4c55c-9e61-490b-915a-b4c93c5c854f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:38:19.078537 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-14c4c55c-9e61-490b-915a-b4c93c5c854f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:38:19.091362 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4c55c-9e61-490b-915a-b4c93c5c854f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:38:19.094892 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af7a05-8609-44b5-b8a2-b1fa87a50856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:38:19.096010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af7a05-8609-44b5-b8a2-b1fa87a50856 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:38:19.096291 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af7a05-8609-44b5-b8a2-b1fa87a50856 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:38:19.096599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af7a05-8609-44b5-b8a2-b1fa87a50856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:38:19.105524 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af7a05-8609-44b5-b8a2-b1fa87a50856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:38:19.106950 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af7a05-8609-44b5-b8a2-b1fa87a50856 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:38:19.116681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 754/1533] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:38:22.791344 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e4585-72a4-48ca-8afd-10a42b867530 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:38:22.791927 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e4585-72a4-48ca-8afd-10a42b867530 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:38:22.791927 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e4585-72a4-48ca-8afd-10a42b867530 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:38:22.793326 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 780/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:38:22.798637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc6784-17e9-4ab9-82fa-4ba0cf3cab42 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:38:22.799062 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc6784-17e9-4ab9-82fa-4ba0cf3cab42 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:38:22.799191 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc6784-17e9-4ab9-82fa-4ba0cf3cab42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:38:22.805372 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=62 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:38:22.817797 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-66cc6784-17e9-4ab9-82fa-4ba0cf3cab42 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:38:22.818973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-66cc6784-17e9-4ab9-82fa-4ba0cf3cab42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:38:22.826553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 755/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:38:23.127988 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e4585-72a4-48ca-8afd-10a42b867530 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:38:23.129707 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-281e4585-72a4-48ca-8afd-10a42b867530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:38:23.185272 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e4585-72a4-48ca-8afd-10a42b867530 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:38:23.189285 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc087f39-ba9a-4031-8b0c-45a9c318c914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:38:23.189921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc087f39-ba9a-4031-8b0c-45a9c318c914 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:38:23.190205 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc087f39-ba9a-4031-8b0c-45a9c318c914 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:38:23.190482 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc087f39-ba9a-4031-8b0c-45a9c318c914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:38:23.199228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc087f39-ba9a-4031-8b0c-45a9c318c914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:38:23.200674 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc087f39-ba9a-4031-8b0c-45a9c318c914 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:38:23.210433 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 781/1536] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:38:25.242464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c02729-801b-49b9-a475-3a97491b8f64 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:38:25.243034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c02729-801b-49b9-a475-3a97491b8f64 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:38:25.243034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c02729-801b-49b9-a475-3a97491b8f64 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:38:25.244440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 756/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:38:25.249617 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f7976-fc4b-4d4f-822b-567e5a79cd39 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:38:25.250067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f7976-fc4b-4d4f-822b-567e5a79cd39 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:38:25.250165 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f7976-fc4b-4d4f-822b-567e5a79cd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:38:25.268835 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c43f7976-fc4b-4d4f-822b-567e5a79cd39 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:38:25.270080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c43f7976-fc4b-4d4f-822b-567e5a79cd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:38:25.277965 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 782/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:38:25.577960 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c02729-801b-49b9-a475-3a97491b8f64 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:38:25.580190 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f0c02729-801b-49b9-a475-3a97491b8f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:38:25.593026 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c02729-801b-49b9-a475-3a97491b8f64 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:38:25.597191 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb911219-668c-489a-9837-923c5e2a5af9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:38:25.597819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb911219-668c-489a-9837-923c5e2a5af9 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:38:25.598102 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb911219-668c-489a-9837-923c5e2a5af9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:38:25.598380 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb911219-668c-489a-9837-923c5e2a5af9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:38:25.607409 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb911219-668c-489a-9837-923c5e2a5af9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:38:25.608885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb911219-668c-489a-9837-923c5e2a5af9 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:38:25.618204 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 757/1539] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:38:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:38:35.263356 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=32 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:38:35.614090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=8 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:39:54.070863 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784f045-628b-4ba6-80c1-7e7c378e76f9 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:54.071867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784f045-628b-4ba6-80c1-7e7c378e76f9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:54.072322 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784f045-628b-4ba6-80c1-7e7c378e76f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:54.098318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0784f045-628b-4ba6-80c1-7e7c378e76f9 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:54.100031 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0784f045-628b-4ba6-80c1-7e7c378e76f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:54.109739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 783/1540] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:39:54.118920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173512b-5db1-45a1-b821-18d54fca4807 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:54.119535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173512b-5db1-45a1-b821-18d54fca4807 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:54.119535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173512b-5db1-45a1-b821-18d54fca4807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:54.151953 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b173512b-5db1-45a1-b821-18d54fca4807 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:54.153531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b173512b-5db1-45a1-b821-18d54fca4807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:54.166770 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 758/1541] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:39:54.173021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784f045-628b-4ba6-80c1-7e7c378e76f9 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:54.188576 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784f045-628b-4ba6-80c1-7e7c378e76f9 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:54.195130 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc195442-8ecb-415e-b984-6dc7932cdf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:54.196272 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc195442-8ecb-415e-b984-6dc7932cdf98 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:54.196835 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc195442-8ecb-415e-b984-6dc7932cdf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:54.197345 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc195442-8ecb-415e-b984-6dc7932cdf98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:54.198967 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc195442-8ecb-415e-b984-6dc7932cdf98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:39:54.199649 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc195442-8ecb-415e-b984-6dc7932cdf98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:54.201680 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc195442-8ecb-415e-b984-6dc7932cdf98 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:54.220255 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 784/1542] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:39:54.227988 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173512b-5db1-45a1-b821-18d54fca4807 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:54.242710 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173512b-5db1-45a1-b821-18d54fca4807 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:54.249032 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e9fe3-6fd3-4d36-9d0e-a042365eb87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:54.249710 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e9fe3-6fd3-4d36-9d0e-a042365eb87e admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:54.249986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e9fe3-6fd3-4d36-9d0e-a042365eb87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:54.250269 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e9fe3-6fd3-4d36-9d0e-a042365eb87e admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:54.251702 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e9fe3-6fd3-4d36-9d0e-a042365eb87e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:54.256540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e9fe3-6fd3-4d36-9d0e-a042365eb87e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:54.309010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 759/1543] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:39:54 2022] POST /identity/v3/projects => generated 393 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:39:54.312752 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc195442-8ecb-415e-b984-6dc7932cdf98 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:54.332350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc195442-8ecb-415e-b984-6dc7932cdf98 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:54.411002 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfaeef-4d27-4b26-a070-4b50b66426d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:54.412112 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfaeef-4d27-4b26-a070-4b50b66426d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:54.412765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfaeef-4d27-4b26-a070-4b50b66426d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:54.413252 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfaeef-4d27-4b26-a070-4b50b66426d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:54.414164 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfaeef-4d27-4b26-a070-4b50b66426d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:54.416346 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfaeef-4d27-4b26-a070-4b50b66426d6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:54.444407 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 785/1544] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:39:54 2022] POST /identity/v3/users => generated 297 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:39:54.449192 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e9fe3-6fd3-4d36-9d0e-a042365eb87e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:54.463103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b66f19-d94e-445f-8fda-f738ef9f77f5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:54.463898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b66f19-d94e-445f-8fda-f738ef9f77f5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:54.464417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b66f19-d94e-445f-8fda-f738ef9f77f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:54.467265 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e9fe3-6fd3-4d36-9d0e-a042365eb87e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:54.478089 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c27d52-482b-4d0e-b9c5-d660c6b05c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:54.478763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c27d52-482b-4d0e-b9c5-d660c6b05c1c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:54.479054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c27d52-482b-4d0e-b9c5-d660c6b05c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:54.479765 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c27d52-482b-4d0e-b9c5-d660c6b05c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:54.483939 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c27d52-482b-4d0e-b9c5-d660c6b05c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:54.483939 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c27d52-482b-4d0e-b9c5-d660c6b05c1c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:54.491028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-53b66f19-d94e-445f-8fda-f738ef9f77f5 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:54.492572 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-53b66f19-d94e-445f-8fda-f738ef9f77f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:54.505189 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 760/1545] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:39:54.506647 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbcfaf-599e-4a8d-9f6d-ed633e6b505e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:54.506938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbcfaf-599e-4a8d-9f6d-ed633e6b505e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:54.507221 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbcfaf-599e-4a8d-9f6d-ed633e6b505e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:54.508399 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 786/1546] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:39:54.510077 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69576b3-630a-4325-95da-869e910dfaf7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:54.510606 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69576b3-630a-4325-95da-869e910dfaf7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:54.511132 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69576b3-630a-4325-95da-869e910dfaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:54.537725 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f69576b3-630a-4325-95da-869e910dfaf7 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:54.539343 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f69576b3-630a-4325-95da-869e910dfaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:54.550075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-73bbcfaf-599e-4a8d-9f6d-ed633e6b505e None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:54.551883 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-73bbcfaf-599e-4a8d-9f6d-ed633e6b505e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:54.554273 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 787/1547] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:39:54.556271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69576b3-630a-4325-95da-869e910dfaf7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:54.569692 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 761/1548] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:39:54.574531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7a800-b1eb-40a1-bc50-f11407cd7672 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:54.576026 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7a800-b1eb-40a1-bc50-f11407cd7672 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:54.576588 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7a800-b1eb-40a1-bc50-f11407cd7672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:54.577186 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69576b3-630a-4325-95da-869e910dfaf7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:54.586544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fc061-8f0c-4f16-92ca-354ccdec8f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:54.587513 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fc061-8f0c-4f16-92ca-354ccdec8f18 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:54.589570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fc061-8f0c-4f16-92ca-354ccdec8f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:54.590098 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fc061-8f0c-4f16-92ca-354ccdec8f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:54.591074 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fc061-8f0c-4f16-92ca-354ccdec8f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:54.596466 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fc061-8f0c-4f16-92ca-354ccdec8f18 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:54.615951 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 788/1549] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:39:54.617127 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a1e7a800-b1eb-40a1-bc50-f11407cd7672 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:54.618030 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0e9e7-4ebd-4753-a902-5df0cede9fa7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:54.618332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a1e7a800-b1eb-40a1-bc50-f11407cd7672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:54.618788 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0e9e7-4ebd-4753-a902-5df0cede9fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:54.619294 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0e9e7-4ebd-4753-a902-5df0cede9fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:54.629545 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 762/1550] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:39:54.630885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e137b-2264-42c5-9adb-92302bc352bf None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:54.631176 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e137b-2264-42c5-9adb-92302bc352bf None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:54.631454 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e137b-2264-42c5-9adb-92302bc352bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:54.640297 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e2a0e9e7-4ebd-4753-a902-5df0cede9fa7 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:54.641587 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e2a0e9e7-4ebd-4753-a902-5df0cede9fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:54.649628 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 789/1551] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:39:54.650650 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-494e137b-2264-42c5-9adb-92302bc352bf None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:54.650843 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c039e9-6713-420f-bf8f-24da50773059 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:54.651116 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c039e9-6713-420f-bf8f-24da50773059 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:54.651396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c039e9-6713-420f-bf8f-24da50773059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:54.651811 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-494e137b-2264-42c5-9adb-92302bc352bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:54.664854 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 763/1552] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:39:54.666051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4883ba-8b71-4442-84e1-fc33101c56d3 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:54.666347 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4883ba-8b71-4442-84e1-fc33101c56d3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:54.666630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4883ba-8b71-4442-84e1-fc33101c56d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:54.676873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-42c039e9-6713-420f-bf8f-24da50773059 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:54.678118 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-42c039e9-6713-420f-bf8f-24da50773059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:54.685189 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6d4883ba-8b71-4442-84e1-fc33101c56d3 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:54.686659 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6d4883ba-8b71-4442-84e1-fc33101c56d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:54.690545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 790/1553] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:39:54.691332 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c039e9-6713-420f-bf8f-24da50773059 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:54.695979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 764/1554] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:39:54.696885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4883ba-8b71-4442-84e1-fc33101c56d3 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:54.701246 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c039e9-6713-420f-bf8f-24da50773059 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:54.707212 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4883ba-8b71-4442-84e1-fc33101c56d3 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:54.707424 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55cc936-949a-46a1-9561-a93dccf50c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:54.708300 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cc936-949a-46a1-9561-a93dccf50c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:54.708610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cc936-949a-46a1-9561-a93dccf50c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:54.708888 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cc936-949a-46a1-9561-a93dccf50c8d admin admin] PATH_INFO: `/v3/projects/0e38b1cc4c0d45a8b38ba7b670f83c79/users/6c963986b46d4d148fc843b0a1183d69/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:54.711699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c9249-11b5-4296-851a-44cbaf12dc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:54.712332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c9249-11b5-4296-851a-44cbaf12dc21 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:54.712645 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c9249-11b5-4296-851a-44cbaf12dc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:54.712931 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c9249-11b5-4296-851a-44cbaf12dc21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:54.713647 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c9249-11b5-4296-851a-44cbaf12dc21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:39:54.713953 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c9249-11b5-4296-851a-44cbaf12dc21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:54.714972 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: WARNING py.warnings [None req-ea2c9249-11b5-4296-851a-44cbaf12dc21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:39:54.714972 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: warnings.warn(msg) Jun 30 10:39:54.714972 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: Jun 30 10:39:54.715865 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c9249-11b5-4296-851a-44cbaf12dc21 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:54.724170 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55cc936-949a-46a1-9561-a93dccf50c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e38b1cc4c0d45a8b38ba7b670f83c79, user_id=6c963986b46d4d148fc843b0a1183d69, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:54.725232 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: WARNING py.warnings [None req-b55cc936-949a-46a1-9561-a93dccf50c8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:39:54.725232 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: warnings.warn(msg) Jun 30 10:39:54.725232 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: Jun 30 10:39:54.727140 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55cc936-949a-46a1-9561-a93dccf50c8d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:54.728734 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 765/1555] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:39:54.730209 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b6748-e71b-4f2a-946d-53b01fc546ec None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:54.730504 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b6748-e71b-4f2a-946d-53b01fc546ec None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:54.730790 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b6748-e71b-4f2a-946d-53b01fc546ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:54.741360 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 791/1556] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:39:54 2022] PUT /identity/v3/projects/0e38b1cc4c0d45a8b38ba7b670f83c79/users/6c963986b46d4d148fc843b0a1183d69/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:39:54.746041 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a404d93-b7ca-4b2b-ac75-30acdfc5c542 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:54.746329 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a404d93-b7ca-4b2b-ac75-30acdfc5c542 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:54.746613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a404d93-b7ca-4b2b-ac75-30acdfc5c542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:54.749255 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-bf3b6748-e71b-4f2a-946d-53b01fc546ec None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:54.750522 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-bf3b6748-e71b-4f2a-946d-53b01fc546ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:54.763081 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-6a404d93-b7ca-4b2b-ac75-30acdfc5c542 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:54.764227 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6a404d93-b7ca-4b2b-ac75-30acdfc5c542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:54.811182 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 766/1557] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:39:54.813123 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b6748-e71b-4f2a-946d-53b01fc546ec None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:54.831038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b6748-e71b-4f2a-946d-53b01fc546ec None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:54.834495 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 792/1558] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:39:54.836911 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf646b00-f5e1-4b78-8616-29c8e0a7ad7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:54.837253 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c9ad1-fb31-4cb6-9cde-8a99e4301129 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:54.837853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c9ad1-fb31-4cb6-9cde-8a99e4301129 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:54.838199 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c9ad1-fb31-4cb6-9cde-8a99e4301129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:54.838548 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf646b00-f5e1-4b78-8616-29c8e0a7ad7e admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:54.838841 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf646b00-f5e1-4b78-8616-29c8e0a7ad7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:54.839123 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf646b00-f5e1-4b78-8616-29c8e0a7ad7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:54.839853 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf646b00-f5e1-4b78-8616-29c8e0a7ad7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:39:54.840163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf646b00-f5e1-4b78-8616-29c8e0a7ad7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:54.841856 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf646b00-f5e1-4b78-8616-29c8e0a7ad7e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:54.855536 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 767/1559] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:39:54.856874 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf646b00-f5e1-4b78-8616-29c8e0a7ad7e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:54.860104 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-bf5c9ad1-fb31-4cb6-9cde-8a99e4301129 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:54.861334 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-bf5c9ad1-fb31-4cb6-9cde-8a99e4301129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:54.867380 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf646b00-f5e1-4b78-8616-29c8e0a7ad7e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:54.869652 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 793/1560] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:39:54.871025 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0109a-7a02-4c88-b3bd-e278a55e4baf None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:54.871314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0109a-7a02-4c88-b3bd-e278a55e4baf None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:54.871590 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0109a-7a02-4c88-b3bd-e278a55e4baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:54.872388 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc796e-49be-4b49-83aa-b04f59784e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:54.873073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc796e-49be-4b49-83aa-b04f59784e2c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:54.873455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc796e-49be-4b49-83aa-b04f59784e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:54.873809 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc796e-49be-4b49-83aa-b04f59784e2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:54.874457 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc796e-49be-4b49-83aa-b04f59784e2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:39:54.874769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc796e-49be-4b49-83aa-b04f59784e2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:54.876428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc796e-49be-4b49-83aa-b04f59784e2c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:54.878111 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:39:54.892041 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 768/1561] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:39:54.892708 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-70b0109a-7a02-4c88-b3bd-e278a55e4baf None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:54.893098 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc796e-49be-4b49-83aa-b04f59784e2c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:54.893942 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-70b0109a-7a02-4c88-b3bd-e278a55e4baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:54.901893 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 794/1562] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:39:54.903287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7097c26-fdde-4320-af6f-5af792291ccd None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:54.903577 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7097c26-fdde-4320-af6f-5af792291ccd None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:54.903852 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7097c26-fdde-4320-af6f-5af792291ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:54.904537 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc796e-49be-4b49-83aa-b04f59784e2c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:54.910480 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac0eba-fd59-4ef5-b8cf-a6175aa3ac41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:54.911254 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac0eba-fd59-4ef5-b8cf-a6175aa3ac41 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:54.911550 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac0eba-fd59-4ef5-b8cf-a6175aa3ac41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:54.911885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac0eba-fd59-4ef5-b8cf-a6175aa3ac41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:54.912607 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac0eba-fd59-4ef5-b8cf-a6175aa3ac41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:54.914546 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac0eba-fd59-4ef5-b8cf-a6175aa3ac41 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:54.921427 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c7097c26-fdde-4320-af6f-5af792291ccd None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:54.922643 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c7097c26-fdde-4320-af6f-5af792291ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:54.931153 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 795/1563] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:39:54.932843 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce047b8-cfab-4894-8d55-37090e9dad8b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:54.933097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce047b8-cfab-4894-8d55-37090e9dad8b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:54.933423 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce047b8-cfab-4894-8d55-37090e9dad8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:54.941015 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 769/1564] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:39:54 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:39:54.941849 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac0eba-fd59-4ef5-b8cf-a6175aa3ac41 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:54.955747 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-bce047b8-cfab-4894-8d55-37090e9dad8b None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:54.956966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-bce047b8-cfab-4894-8d55-37090e9dad8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:54.976372 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:39:55.007487 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac0eba-fd59-4ef5-b8cf-a6175aa3ac41 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.012061 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8b46d-540b-4b3a-9cdf-23aa855e79ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.012756 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8b46d-540b-4b3a-9cdf-23aa855e79ad admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.013043 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8b46d-540b-4b3a-9cdf-23aa855e79ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.013321 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8b46d-540b-4b3a-9cdf-23aa855e79ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.014045 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8b46d-540b-4b3a-9cdf-23aa855e79ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:39:55.014355 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8b46d-540b-4b3a-9cdf-23aa855e79ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.016004 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8b46d-540b-4b3a-9cdf-23aa855e79ad admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:55.017025 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 796/1565] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:39:55.020936 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce047b8-cfab-4894-8d55-37090e9dad8b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:55.027297 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce047b8-cfab-4894-8d55-37090e9dad8b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.029187 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 770/1566] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:39:55.030510 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989e72d-30e5-4a6e-a749-7293811eb5d6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.030808 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989e72d-30e5-4a6e-a749-7293811eb5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.031090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989e72d-30e5-4a6e-a749-7293811eb5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.039431 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a88da7-8ecc-4f3c-80b7-4a58c64c1818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.040086 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a88da7-8ecc-4f3c-80b7-4a58c64c1818 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.040371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a88da7-8ecc-4f3c-80b7-4a58c64c1818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.040686 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a88da7-8ecc-4f3c-80b7-4a58c64c1818 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.041384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a88da7-8ecc-4f3c-80b7-4a58c64c1818 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.042406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: WARNING py.warnings [None req-44a88da7-8ecc-4f3c-80b7-4a58c64c1818 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:39:55.042406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: warnings.warn(msg) Jun 30 10:39:55.042406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: Jun 30 10:39:55.043613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a88da7-8ecc-4f3c-80b7-4a58c64c1818 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:55.053528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b989e72d-30e5-4a6e-a749-7293811eb5d6 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:55.054775 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b989e72d-30e5-4a6e-a749-7293811eb5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:55.063732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 771/1567] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:39:55.067438 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989e72d-30e5-4a6e-a749-7293811eb5d6 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:55.070790 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 797/1568] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:39:55 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:39:55.071697 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a88da7-8ecc-4f3c-80b7-4a58c64c1818 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:55.076492 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989e72d-30e5-4a6e-a749-7293811eb5d6 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.135487 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feded8f6-828e-4d7a-9806-48ea09c70f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.136640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feded8f6-828e-4d7a-9806-48ea09c70f55 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.136640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feded8f6-828e-4d7a-9806-48ea09c70f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.136960 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a88da7-8ecc-4f3c-80b7-4a58c64c1818 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.137134 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feded8f6-828e-4d7a-9806-48ea09c70f55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.137667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feded8f6-828e-4d7a-9806-48ea09c70f55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.139665 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feded8f6-828e-4d7a-9806-48ea09c70f55 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:55.142000 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e743b-8b01-44e8-b52d-35c4d15c8e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.142664 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e743b-8b01-44e8-b52d-35c4d15c8e21 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.142950 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e743b-8b01-44e8-b52d-35c4d15c8e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.143229 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e743b-8b01-44e8-b52d-35c4d15c8e21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.143954 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e743b-8b01-44e8-b52d-35c4d15c8e21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:39:55.144263 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e743b-8b01-44e8-b52d-35c4d15c8e21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.145900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e743b-8b01-44e8-b52d-35c4d15c8e21 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:55.165869 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 798/1569] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:39:55.165869 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e743b-8b01-44e8-b52d-35c4d15c8e21 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:55.173964 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 772/1570] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:39:55 2022] POST /identity/v3/projects => generated 403 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:39:55.174671 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feded8f6-828e-4d7a-9806-48ea09c70f55 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:55.214159 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e743b-8b01-44e8-b52d-35c4d15c8e21 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.226363 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:39:55.239022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feded8f6-828e-4d7a-9806-48ea09c70f55 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.243670 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004c046-898d-47e2-b3b8-4cc1484a3c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.244330 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004c046-898d-47e2-b3b8-4cc1484a3c7d admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.244652 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004c046-898d-47e2-b3b8-4cc1484a3c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.245004 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004c046-898d-47e2-b3b8-4cc1484a3c7d admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.245605 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004c046-898d-47e2-b3b8-4cc1484a3c7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.246626 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: WARNING py.warnings [None req-9004c046-898d-47e2-b3b8-4cc1484a3c7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:39:55.246626 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: warnings.warn(msg) Jun 30 10:39:55.246626 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: Jun 30 10:39:55.247848 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004c046-898d-47e2-b3b8-4cc1484a3c7d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:55.268839 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a4c97-2ae6-4bfc-a349-b91d95cf3fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.269492 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a4c97-2ae6-4bfc-a349-b91d95cf3fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.269782 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a4c97-2ae6-4bfc-a349-b91d95cf3fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.270065 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a4c97-2ae6-4bfc-a349-b91d95cf3fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.273567 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 773/1571] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:39:55 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:39:55.274470 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004c046-898d-47e2-b3b8-4cc1484a3c7d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:55.279622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a4c97-2ae6-4bfc-a349-b91d95cf3fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.281118 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a4c97-2ae6-4bfc-a349-b91d95cf3fc6 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:55.283862 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004c046-898d-47e2-b3b8-4cc1484a3c7d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.288394 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122148f-5810-4e0d-b685-8c0f220568be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.289049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122148f-5810-4e0d-b685-8c0f220568be admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.289331 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122148f-5810-4e0d-b685-8c0f220568be admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.289606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122148f-5810-4e0d-b685-8c0f220568be admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.290319 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122148f-5810-4e0d-b685-8c0f220568be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:39:55.290625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122148f-5810-4e0d-b685-8c0f220568be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.290758 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 799/1572] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:39:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:39:55.292372 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122148f-5810-4e0d-b685-8c0f220568be admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:55.297434 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a4c97-2ae6-4bfc-a349-b91d95cf3fc6 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:55.309185 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a4c97-2ae6-4bfc-a349-b91d95cf3fc6 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.311985 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 774/1573] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:39:55.313517 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122148f-5810-4e0d-b685-8c0f220568be admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:55.315258 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4dcd8d-485f-4360-8720-984059e04d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.315987 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4dcd8d-485f-4360-8720-984059e04d9b admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.316342 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4dcd8d-485f-4360-8720-984059e04d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.316745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4dcd8d-485f-4360-8720-984059e04d9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.317608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4dcd8d-485f-4360-8720-984059e04d9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.320180 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4dcd8d-485f-4360-8720-984059e04d9b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:55.323256 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122148f-5810-4e0d-b685-8c0f220568be admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.328023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee29fa-2fcb-4025-b280-b49c82823ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.329371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee29fa-2fcb-4025-b280-b49c82823ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.329645 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee29fa-2fcb-4025-b280-b49c82823ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.329928 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee29fa-2fcb-4025-b280-b49c82823ba1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.330699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee29fa-2fcb-4025-b280-b49c82823ba1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:39:55.331001 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee29fa-2fcb-4025-b280-b49c82823ba1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.332689 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee29fa-2fcb-4025-b280-b49c82823ba1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:55.345448 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 775/1574] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:39:55.346359 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee29fa-2fcb-4025-b280-b49c82823ba1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:55.349877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 800/1575] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:39:55 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:39:55.353668 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4dcd8d-485f-4360-8720-984059e04d9b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:55.357122 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee29fa-2fcb-4025-b280-b49c82823ba1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.363728 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:39:55.426353 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b6463-230a-401d-b4be-7bc1b7fa6847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.427051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b6463-230a-401d-b4be-7bc1b7fa6847 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.427731 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b6463-230a-401d-b4be-7bc1b7fa6847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.428156 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b6463-230a-401d-b4be-7bc1b7fa6847 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.429213 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b6463-230a-401d-b4be-7bc1b7fa6847 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.430159 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4dcd8d-485f-4360-8720-984059e04d9b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.430943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b6463-230a-401d-b4be-7bc1b7fa6847 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:55.435320 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae2421-6bed-440a-a03a-4c2c1f2dc109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.436134 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae2421-6bed-440a-a03a-4c2c1f2dc109 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.436587 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae2421-6bed-440a-a03a-4c2c1f2dc109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.436986 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae2421-6bed-440a-a03a-4c2c1f2dc109 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.438397 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae2421-6bed-440a-a03a-4c2c1f2dc109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.440543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae2421-6bed-440a-a03a-4c2c1f2dc109 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:55.455087 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 776/1576] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:39:55 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:39:55.456201 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b6463-230a-401d-b4be-7bc1b7fa6847 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:55.468188 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b6463-230a-401d-b4be-7bc1b7fa6847 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.473646 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167771b-9585-4b88-b680-e03564b62f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.473818 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 801/1577] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:39:55 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:39:55.474774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167771b-9585-4b88-b680-e03564b62f86 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.475035 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167771b-9585-4b88-b680-e03564b62f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.475392 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167771b-9585-4b88-b680-e03564b62f86 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.476289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167771b-9585-4b88-b680-e03564b62f86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.477846 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae2421-6bed-440a-a03a-4c2c1f2dc109 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:55.479357 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167771b-9585-4b88-b680-e03564b62f86 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:55.510165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 777/1578] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:39:55 2022] POST /identity/v3/users => generated 302 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:39:55.510165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167771b-9585-4b88-b680-e03564b62f86 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:55.522672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167771b-9585-4b88-b680-e03564b62f86 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.558237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae2421-6bed-440a-a03a-4c2c1f2dc109 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.563595 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6f2e9-de1e-4de3-bcb8-cb5905bee26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.564316 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6f2e9-de1e-4de3-bcb8-cb5905bee26d admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.564637 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6f2e9-de1e-4de3-bcb8-cb5905bee26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.564919 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6f2e9-de1e-4de3-bcb8-cb5905bee26d admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.565639 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6f2e9-de1e-4de3-bcb8-cb5905bee26d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.567333 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6f2e9-de1e-4de3-bcb8-cb5905bee26d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:55.581028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 802/1579] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:39:55.582800 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6f2e9-de1e-4de3-bcb8-cb5905bee26d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:55.593545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6f2e9-de1e-4de3-bcb8-cb5905bee26d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.593985 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb2223-6baf-49c8-851c-7db276d88dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.594700 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb2223-6baf-49c8-851c-7db276d88dce admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.594970 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb2223-6baf-49c8-851c-7db276d88dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.595252 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb2223-6baf-49c8-851c-7db276d88dce admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.595930 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb2223-6baf-49c8-851c-7db276d88dce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.597905 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb2223-6baf-49c8-851c-7db276d88dce admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:55.598656 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b037490-1301-4fe3-a6f7-7a5b33b1273d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.599394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b037490-1301-4fe3-a6f7-7a5b33b1273d admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.599771 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b037490-1301-4fe3-a6f7-7a5b33b1273d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.600143 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b037490-1301-4fe3-a6f7-7a5b33b1273d admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.600970 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b037490-1301-4fe3-a6f7-7a5b33b1273d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.603189 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b037490-1301-4fe3-a6f7-7a5b33b1273d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:55.626150 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:39:55.628954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 778/1580] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:39:55 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:39:55.630299 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb2223-6baf-49c8-851c-7db276d88dce admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:55.637216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 803/1581] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:39:55 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:39:55.638213 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b037490-1301-4fe3-a6f7-7a5b33b1273d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:55.705108 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b037490-1301-4fe3-a6f7-7a5b33b1273d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.709984 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b7ee4-8dbe-49ac-94cd-870fd530f355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.710716 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b7ee4-8dbe-49ac-94cd-870fd530f355 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.711072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b7ee4-8dbe-49ac-94cd-870fd530f355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.711427 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b7ee4-8dbe-49ac-94cd-870fd530f355 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.712230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb2223-6baf-49c8-851c-7db276d88dce admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.712846 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b7ee4-8dbe-49ac-94cd-870fd530f355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.717644 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b7ee4-8dbe-49ac-94cd-870fd530f355 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:55.723016 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8271e-781c-4932-9626-310e0324abcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.725149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8271e-781c-4932-9626-310e0324abcd admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.725512 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8271e-781c-4932-9626-310e0324abcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.725897 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8271e-781c-4932-9626-310e0324abcd admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.726859 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8271e-781c-4932-9626-310e0324abcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.728555 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 804/1582] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:39:55.730116 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b7ee4-8dbe-49ac-94cd-870fd530f355 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:55.730259 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8271e-781c-4932-9626-310e0324abcd admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:55.740961 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b7ee4-8dbe-49ac-94cd-870fd530f355 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.743702 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:39:55.747023 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8264e-f360-4772-9529-f841494acb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.747811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8264e-f360-4772-9529-f841494acb49 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.748130 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8264e-f360-4772-9529-f841494acb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.748405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8264e-f360-4772-9529-f841494acb49 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.749477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8264e-f360-4772-9529-f841494acb49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.751915 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8264e-f360-4772-9529-f841494acb49 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:55.773410 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 779/1583] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:39:55 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:39:55.775232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8271e-781c-4932-9626-310e0324abcd admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:55.779753 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 805/1584] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:39:55 2022] POST /identity/v3/users => generated 288 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:39:55.780734 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8264e-f360-4772-9529-f841494acb49 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:55.788132 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8271e-781c-4932-9626-310e0324abcd admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.792863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0cd0f4-72d8-4648-bfcb-5c93bf3efa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.793523 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0cd0f4-72d8-4648-bfcb-5c93bf3efa81 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.793808 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0cd0f4-72d8-4648-bfcb-5c93bf3efa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.794130 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0cd0f4-72d8-4648-bfcb-5c93bf3efa81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.794535 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8264e-f360-4772-9529-f841494acb49 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.794907 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0cd0f4-72d8-4648-bfcb-5c93bf3efa81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.798080 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0cd0f4-72d8-4648-bfcb-5c93bf3efa81 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:55.799986 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a73cd-b562-4d76-b8aa-015763500e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.801103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a73cd-b562-4d76-b8aa-015763500e93 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.801395 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a73cd-b562-4d76-b8aa-015763500e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.801683 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a73cd-b562-4d76-b8aa-015763500e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.802411 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a73cd-b562-4d76-b8aa-015763500e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.804683 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a73cd-b562-4d76-b8aa-015763500e93 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:55.814625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 780/1585] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:39:55.814625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0cd0f4-72d8-4648-bfcb-5c93bf3efa81 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:55.821674 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 806/1586] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:39:55.822694 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a73cd-b562-4d76-b8aa-015763500e93 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:55.830007 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0cd0f4-72d8-4648-bfcb-5c93bf3efa81 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.835577 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a73cd-b562-4d76-b8aa-015763500e93 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.842333 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358aa324-bf7e-47c4-8d5f-6ff0f194804b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.843006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358aa324-bf7e-47c4-8d5f-6ff0f194804b admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.843296 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358aa324-bf7e-47c4-8d5f-6ff0f194804b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.843576 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358aa324-bf7e-47c4-8d5f-6ff0f194804b admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.843973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b4b11-ffb0-4213-b92a-c147faf3b6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.845234 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b4b11-ffb0-4213-b92a-c147faf3b6c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.845506 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b4b11-ffb0-4213-b92a-c147faf3b6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.845778 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b4b11-ffb0-4213-b92a-c147faf3b6c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.846560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358aa324-bf7e-47c4-8d5f-6ff0f194804b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.848704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b4b11-ffb0-4213-b92a-c147faf3b6c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.849790 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358aa324-bf7e-47c4-8d5f-6ff0f194804b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:55.850609 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b4b11-ffb0-4213-b92a-c147faf3b6c6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:55.876061 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 781/1587] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:39:55 2022] POST /identity/v3/users => generated 287 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:39:55.877730 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358aa324-bf7e-47c4-8d5f-6ff0f194804b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:55.879595 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 807/1588] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:39:55 2022] POST /identity/v3/users => generated 287 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:39:55.880412 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b4b11-ffb0-4213-b92a-c147faf3b6c6 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:55.890594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358aa324-bf7e-47c4-8d5f-6ff0f194804b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.893227 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b4b11-ffb0-4213-b92a-c147faf3b6c6 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.897171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159cc54-0707-4af0-8f97-b54aad23bc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.898378 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159cc54-0707-4af0-8f97-b54aad23bc49 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.898670 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159cc54-0707-4af0-8f97-b54aad23bc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.898956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159cc54-0707-4af0-8f97-b54aad23bc49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.899464 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c7ff3-f652-463a-b769-0fa3ac1d6087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.899661 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4159cc54-0707-4af0-8f97-b54aad23bc49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.900377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c7ff3-f652-463a-b769-0fa3ac1d6087 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.900792 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c7ff3-f652-463a-b769-0fa3ac1d6087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.901225 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c7ff3-f652-463a-b769-0fa3ac1d6087 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.901448 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4159cc54-0707-4af0-8f97-b54aad23bc49 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:55.902166 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c7ff3-f652-463a-b769-0fa3ac1d6087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.904641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c7ff3-f652-463a-b769-0fa3ac1d6087 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:55.914981 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 782/1589] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:39:55.916018 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159cc54-0707-4af0-8f97-b54aad23bc49 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:55.921749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 808/1590] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:39:55.923446 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c7ff3-f652-463a-b769-0fa3ac1d6087 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:55.931521 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159cc54-0707-4af0-8f97-b54aad23bc49 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.937196 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c7ff3-f652-463a-b769-0fa3ac1d6087 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.937468 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e8353-77bb-4caf-a281-3535842eab7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.938627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e8353-77bb-4caf-a281-3535842eab7d admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.938914 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e8353-77bb-4caf-a281-3535842eab7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.939556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e8353-77bb-4caf-a281-3535842eab7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.940388 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e8353-77bb-4caf-a281-3535842eab7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.943179 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256a61b-1046-44d8-a1f1-874049455d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.943819 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256a61b-1046-44d8-a1f1-874049455d85 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.944295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256a61b-1046-44d8-a1f1-874049455d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.944638 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e8353-77bb-4caf-a281-3535842eab7d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:55.944838 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256a61b-1046-44d8-a1f1-874049455d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.945609 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256a61b-1046-44d8-a1f1-874049455d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.948083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256a61b-1046-44d8-a1f1-874049455d85 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:55.956231 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 783/1591] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:39:55.957027 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e8353-77bb-4caf-a281-3535842eab7d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:55.960738 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 809/1592] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:39:55.961663 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256a61b-1046-44d8-a1f1-874049455d85 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:55.967466 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e8353-77bb-4caf-a281-3535842eab7d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.972611 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256a61b-1046-44d8-a1f1-874049455d85 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:55.973924 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c677ce5-6d49-4617-aa2d-b636f770782a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.974796 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c677ce5-6d49-4617-aa2d-b636f770782a admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.975077 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c677ce5-6d49-4617-aa2d-b636f770782a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.975365 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c677ce5-6d49-4617-aa2d-b636f770782a admin admin] PATH_INFO: `/v3/projects/2346c16770124c9a86bc6e30880f8bde/users/f5003e984d58440a80d98405d187eab0/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.977601 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d664a4-34ec-4474-8e83-56ab519eea92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:55.978258 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d664a4-34ec-4474-8e83-56ab519eea92 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:55.978542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d664a4-34ec-4474-8e83-56ab519eea92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:55.978824 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d664a4-34ec-4474-8e83-56ab519eea92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:55.979828 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d664a4-34ec-4474-8e83-56ab519eea92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.981467 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d664a4-34ec-4474-8e83-56ab519eea92 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:55.993887 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c677ce5-6d49-4617-aa2d-b636f770782a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2346c16770124c9a86bc6e30880f8bde, user_id=f5003e984d58440a80d98405d187eab0, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:55.994225 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 810/1593] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:39:55.995066 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d664a4-34ec-4474-8e83-56ab519eea92 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:56.000031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c677ce5-6d49-4617-aa2d-b636f770782a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:56.005385 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d664a4-34ec-4474-8e83-56ab519eea92 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:56.010383 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c79ad-6cc6-4528-941e-2078f5d09f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:56.011039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c79ad-6cc6-4528-941e-2078f5d09f6f admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:56.011317 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c79ad-6cc6-4528-941e-2078f5d09f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:56.011598 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c79ad-6cc6-4528-941e-2078f5d09f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:56.012318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c79ad-6cc6-4528-941e-2078f5d09f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:56.013954 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c79ad-6cc6-4528-941e-2078f5d09f6f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:56.018559 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 784/1594] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:39:55 2022] PUT /identity/v3/projects/2346c16770124c9a86bc6e30880f8bde/users/f5003e984d58440a80d98405d187eab0/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:39:56.018559 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c677ce5-6d49-4617-aa2d-b636f770782a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:56.024780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 811/1595] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:39:56.025676 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c79ad-6cc6-4528-941e-2078f5d09f6f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:56.046668 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c79ad-6cc6-4528-941e-2078f5d09f6f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:56.091039 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c677ce5-6d49-4617-aa2d-b636f770782a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:56.098447 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfb2c4-8c71-4981-83e7-8f6399a38e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:56.101991 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfb2c4-8c71-4981-83e7-8f6399a38e8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:56.102397 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfb2c4-8c71-4981-83e7-8f6399a38e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:56.102954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfb2c4-8c71-4981-83e7-8f6399a38e8d admin admin] PATH_INFO: `/v3/projects/ff16d27fbbe7475782fe2202e34aec7f/users/9ad75a8b887a4a40accb49603f03c8ee/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:56.119970 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db15a2-a2ae-44ae-8428-d4c9d6210412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:56.120720 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db15a2-a2ae-44ae-8428-d4c9d6210412 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:56.121063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db15a2-a2ae-44ae-8428-d4c9d6210412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:56.121353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db15a2-a2ae-44ae-8428-d4c9d6210412 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:56.122085 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db15a2-a2ae-44ae-8428-d4c9d6210412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:56.123818 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db15a2-a2ae-44ae-8428-d4c9d6210412 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:56.129656 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:39:56.131250 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfb2c4-8c71-4981-83e7-8f6399a38e8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff16d27fbbe7475782fe2202e34aec7f, user_id=9ad75a8b887a4a40accb49603f03c8ee, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:56.134900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfb2c4-8c71-4981-83e7-8f6399a38e8d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:56.136145 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 812/1596] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:39:56.137175 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db15a2-a2ae-44ae-8428-d4c9d6210412 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:56.151332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 785/1597] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:39:56 2022] PUT /identity/v3/projects/ff16d27fbbe7475782fe2202e34aec7f/users/9ad75a8b887a4a40accb49603f03c8ee/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:39:56.151814 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db15a2-a2ae-44ae-8428-d4c9d6210412 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:56.152283 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfb2c4-8c71-4981-83e7-8f6399a38e8d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:56.223436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcc524-28b4-4cff-8770-5f05a2d677ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:56.224293 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcc524-28b4-4cff-8770-5f05a2d677ce admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:56.224995 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcc524-28b4-4cff-8770-5f05a2d677ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:56.225496 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcc524-28b4-4cff-8770-5f05a2d677ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:56.226514 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcc524-28b4-4cff-8770-5f05a2d677ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:56.228807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcc524-28b4-4cff-8770-5f05a2d677ce admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:56.242875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 813/1598] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:39:56.243909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcc524-28b4-4cff-8770-5f05a2d677ce admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:56.256420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcc524-28b4-4cff-8770-5f05a2d677ce admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:56.261855 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a61937-9376-4513-94e0-d6c2a02cf8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:56.262654 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a61937-9376-4513-94e0-d6c2a02cf8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:56.263215 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a61937-9376-4513-94e0-d6c2a02cf8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:56.263591 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a61937-9376-4513-94e0-d6c2a02cf8e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:56.264530 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a61937-9376-4513-94e0-d6c2a02cf8e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:56.265685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfb2c4-8c71-4981-83e7-8f6399a38e8d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:56.267651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a61937-9376-4513-94e0-d6c2a02cf8e2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:56.279821 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead730c-5abf-4684-8dc6-332bfc08e3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:56.281009 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead730c-5abf-4684-8dc6-332bfc08e3ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:56.281305 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead730c-5abf-4684-8dc6-332bfc08e3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:56.281610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead730c-5abf-4684-8dc6-332bfc08e3ac admin admin] PATH_INFO: `/v3/projects/40d2e022de474768ae630b66e17350e4/users/3770af8431324c7d8e9118cacfc756e5/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:56.286020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 814/1599] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:39:56.286020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93801f8c-12d5-4239-85ee-f0fce67ec14c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:56.286020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93801f8c-12d5-4239-85ee-f0fce67ec14c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:56.286020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93801f8c-12d5-4239-85ee-f0fce67ec14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:56.303383 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:39:56.308571 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-93801f8c-12d5-4239-85ee-f0fce67ec14c None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:56.310240 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-93801f8c-12d5-4239-85ee-f0fce67ec14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:56.314013 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead730c-5abf-4684-8dc6-332bfc08e3ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=40d2e022de474768ae630b66e17350e4, user_id=3770af8431324c7d8e9118cacfc756e5, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:56.320903 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 815/1600] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:39:56.322062 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93801f8c-12d5-4239-85ee-f0fce67ec14c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:56.324078 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead730c-5abf-4684-8dc6-332bfc08e3ac admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:56.339196 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93801f8c-12d5-4239-85ee-f0fce67ec14c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:56.358946 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb9262-12fa-47a9-b0ba-cb597b406e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:56.361500 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb9262-12fa-47a9-b0ba-cb597b406e73 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:56.363016 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb9262-12fa-47a9-b0ba-cb597b406e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:56.364405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb9262-12fa-47a9-b0ba-cb597b406e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:56.365745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb9262-12fa-47a9-b0ba-cb597b406e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:56.370494 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 786/1601] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:39:56 2022] PUT /identity/v3/projects/40d2e022de474768ae630b66e17350e4/users/3770af8431324c7d8e9118cacfc756e5/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:39:56.371476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead730c-5abf-4684-8dc6-332bfc08e3ac admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:56.373354 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb9262-12fa-47a9-b0ba-cb597b406e73 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:56.402476 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 816/1602] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:39:56.407682 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5384e2e-7925-45e2-bc6c-103a5dcdb116 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:56.412887 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5384e2e-7925-45e2-bc6c-103a5dcdb116 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:56.413367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5384e2e-7925-45e2-bc6c-103a5dcdb116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:56.455927 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f5384e2e-7925-45e2-bc6c-103a5dcdb116 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:56.460656 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f5384e2e-7925-45e2-bc6c-103a5dcdb116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:56.487075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead730c-5abf-4684-8dc6-332bfc08e3ac admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:56.490010 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 817/1603] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:39:56.499459 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70df14-afae-4648-9712-cc5013abe67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:56.499968 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5384e2e-7925-45e2-bc6c-103a5dcdb116 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:56.500684 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70df14-afae-4648-9712-cc5013abe67e admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:56.501394 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70df14-afae-4648-9712-cc5013abe67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:56.501770 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70df14-afae-4648-9712-cc5013abe67e admin admin] PATH_INFO: `/v3/projects/848d69e5041341488aafc3e6d26d491c/users/d6a194d68415422fbc6ca75a8dbccf22/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:56.511091 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5384e2e-7925-45e2-bc6c-103a5dcdb116 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:56.517923 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9a34f-c8f1-41e7-bcf8-9619a9459e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:56.519208 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9a34f-c8f1-41e7-bcf8-9619a9459e5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:56.519788 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9a34f-c8f1-41e7-bcf8-9619a9459e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:56.520233 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9a34f-c8f1-41e7-bcf8-9619a9459e5c admin admin] PATH_INFO: `/v3/projects/a531892a5f9e4964aa9b35519ad72b68/users/131fb3808ea341618e17256b43862937/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:56.522978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70df14-afae-4648-9712-cc5013abe67e admin admin] RBAC: Authorizing `identity:create_grant(project_id=848d69e5041341488aafc3e6d26d491c, user_id=d6a194d68415422fbc6ca75a8dbccf22, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:56.526810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70df14-afae-4648-9712-cc5013abe67e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:56.552730 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9a34f-c8f1-41e7-bcf8-9619a9459e5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a531892a5f9e4964aa9b35519ad72b68, user_id=131fb3808ea341618e17256b43862937, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:56.555945 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9a34f-c8f1-41e7-bcf8-9619a9459e5c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:56.559606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 787/1604] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:39:56 2022] PUT /identity/v3/projects/848d69e5041341488aafc3e6d26d491c/users/d6a194d68415422fbc6ca75a8dbccf22/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:39:56.560465 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70df14-afae-4648-9712-cc5013abe67e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:56.581308 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 818/1605] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:39:56 2022] PUT /identity/v3/projects/a531892a5f9e4964aa9b35519ad72b68/users/131fb3808ea341618e17256b43862937/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:39:56.584570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9a34f-c8f1-41e7-bcf8-9619a9459e5c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:56.662313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70df14-afae-4648-9712-cc5013abe67e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:56.663803 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9a34f-c8f1-41e7-bcf8-9619a9459e5c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:56.670386 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f92e0-45ed-426a-bf7d-4a50a58d39e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:56.671675 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f92e0-45ed-426a-bf7d-4a50a58d39e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:56.673211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f92e0-45ed-426a-bf7d-4a50a58d39e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:56.674648 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f92e0-45ed-426a-bf7d-4a50a58d39e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:56.734173 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:39:56.741319 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a76cb-da47-4ebe-b093-7ea4cebd4909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:56.742598 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a76cb-da47-4ebe-b093-7ea4cebd4909 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:56.743161 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a76cb-da47-4ebe-b093-7ea4cebd4909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:56.743724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a76cb-da47-4ebe-b093-7ea4cebd4909 admin admin] PATH_INFO: `/v3/projects/90bb504b32574e25b8575703fefb7c54/users/6d0df309b3b147da9ec50dac3935f5f7/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:56.751017 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f92e0-45ed-426a-bf7d-4a50a58d39e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:56.752717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f92e0-45ed-426a-bf7d-4a50a58d39e3 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:56.764947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 819/1606] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:39:56.766286 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378712f-b01a-43a7-b846-0ad5439efeb3 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:56.766624 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378712f-b01a-43a7-b846-0ad5439efeb3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:56.766997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378712f-b01a-43a7-b846-0ad5439efeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:56.769764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a76cb-da47-4ebe-b093-7ea4cebd4909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90bb504b32574e25b8575703fefb7c54, user_id=6d0df309b3b147da9ec50dac3935f5f7, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:56.773032 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a76cb-da47-4ebe-b093-7ea4cebd4909 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:56.788986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:39:56.803712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c378712f-b01a-43a7-b846-0ad5439efeb3 None None] MFA Rules not processed for user `3770af8431324c7d8e9118cacfc756e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:56.805288 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c378712f-b01a-43a7-b846-0ad5439efeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:56.808631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 788/1607] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:39:56 2022] PUT /identity/v3/projects/90bb504b32574e25b8575703fefb7c54/users/6d0df309b3b147da9ec50dac3935f5f7/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:39:56.809713 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a76cb-da47-4ebe-b093-7ea4cebd4909 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:56.897205 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 820/1608] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:39:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:39:56.898649 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378712f-b01a-43a7-b846-0ad5439efeb3 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:56.936558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a76cb-da47-4ebe-b093-7ea4cebd4909 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:56.949134 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac672b74-0663-464d-8b19-e6344153ec08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:56.950035 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac672b74-0663-464d-8b19-e6344153ec08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:56.950444 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac672b74-0663-464d-8b19-e6344153ec08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:56.950723 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac672b74-0663-464d-8b19-e6344153ec08 admin admin] PATH_INFO: `/v3/projects/a3eeea32558849058212b9e4b7978856/users/b09fbc020c6d43ea8e24da41d2eeadb6/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:56.967327 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac672b74-0663-464d-8b19-e6344153ec08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3eeea32558849058212b9e4b7978856, user_id=b09fbc020c6d43ea8e24da41d2eeadb6, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:56.971213 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac672b74-0663-464d-8b19-e6344153ec08 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:56.981816 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378712f-b01a-43a7-b846-0ad5439efeb3 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:56.991025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 789/1609] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:39:56 2022] PUT /identity/v3/projects/a3eeea32558849058212b9e4b7978856/users/b09fbc020c6d43ea8e24da41d2eeadb6/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:39:56.992593 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648456a-8075-40c1-9868-9f22708aebb3 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:56.992890 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648456a-8075-40c1-9868-9f22708aebb3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:56.993167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648456a-8075-40c1-9868-9f22708aebb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:57.021588 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6648456a-8075-40c1-9868-9f22708aebb3 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:57.022812 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6648456a-8075-40c1-9868-9f22708aebb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:57.045611 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98277bb5-8de6-44f1-bc32-4775ed7ea884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:57.046683 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98277bb5-8de6-44f1-bc32-4775ed7ea884 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:57.047250 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98277bb5-8de6-44f1-bc32-4775ed7ea884 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:57.047762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98277bb5-8de6-44f1-bc32-4775ed7ea884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:57.116031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 790/1610] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:39:57.118631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3dc0a-438b-47ac-92a9-f2fe9fa5acbc None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:57.119710 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3dc0a-438b-47ac-92a9-f2fe9fa5acbc None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:57.119710 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3dc0a-438b-47ac-92a9-f2fe9fa5acbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:57.134852 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:39:57.150644 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-2ea3dc0a-438b-47ac-92a9-f2fe9fa5acbc None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:57.152885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2ea3dc0a-438b-47ac-92a9-f2fe9fa5acbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:57.162879 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98277bb5-8de6-44f1-bc32-4775ed7ea884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:57.164592 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98277bb5-8de6-44f1-bc32-4775ed7ea884 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:57.168441 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 791/1611] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:39:57.170150 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404131c-4c81-4472-9769-9de99ae22944 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:57.170538 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404131c-4c81-4472-9769-9de99ae22944 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:57.170834 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404131c-4c81-4472-9769-9de99ae22944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:57.178676 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 821/1612] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:39:57.179998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98277bb5-8de6-44f1-bc32-4775ed7ea884 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:57.193694 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98277bb5-8de6-44f1-bc32-4775ed7ea884 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:57.200800 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed9962-416c-4d2e-866e-ea1b67c2d2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:57.201648 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed9962-416c-4d2e-866e-ea1b67c2d2d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:57.202154 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed9962-416c-4d2e-866e-ea1b67c2d2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:57.202928 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed9962-416c-4d2e-866e-ea1b67c2d2d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:57.203374 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed9962-416c-4d2e-866e-ea1b67c2d2d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:57.207070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed9962-416c-4d2e-866e-ea1b67c2d2d9 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:57.224587 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4404131c-4c81-4472-9769-9de99ae22944 None None] MFA Rules not processed for user `6d0df309b3b147da9ec50dac3935f5f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:57.227703 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4404131c-4c81-4472-9769-9de99ae22944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:57.249899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 822/1613] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:39:57 2022] POST /identity/v3/projects => generated 403 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:39:57.253868 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978d2d8-d168-4ee0-95be-8b2452796046 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:57.254307 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978d2d8-d168-4ee0-95be-8b2452796046 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:57.254809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978d2d8-d168-4ee0-95be-8b2452796046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:57.303583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a978d2d8-d168-4ee0-95be-8b2452796046 None None] MFA Rules not processed for user `b09fbc020c6d43ea8e24da41d2eeadb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:57.304718 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a978d2d8-d168-4ee0-95be-8b2452796046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:57.363432 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 792/1614] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:39:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:39:57.364329 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404131c-4c81-4472-9769-9de99ae22944 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:57.384238 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404131c-4c81-4472-9769-9de99ae22944 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:57.389592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:39:57.404004 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 823/1615] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:39:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:39:57.405009 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978d2d8-d168-4ee0-95be-8b2452796046 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:57.486508 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978d2d8-d168-4ee0-95be-8b2452796046 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:57.491246 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1370a90-e6ab-4da1-bb76-86e65bc9e29f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:57.491960 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1370a90-e6ab-4da1-bb76-86e65bc9e29f service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:57.492251 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1370a90-e6ab-4da1-bb76-86e65bc9e29f service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:57.492759 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1370a90-e6ab-4da1-bb76-86e65bc9e29f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:57.563907 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c46fc-eec8-4bbc-bbee-9f871c721083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:57.563907 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c46fc-eec8-4bbc-bbee-9f871c721083 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:57.563907 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c46fc-eec8-4bbc-bbee-9f871c721083 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:57.563907 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c46fc-eec8-4bbc-bbee-9f871c721083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:57.617460 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1370a90-e6ab-4da1-bb76-86e65bc9e29f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:57.620591 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1370a90-e6ab-4da1-bb76-86e65bc9e29f service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:57.628150 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:39:57.638477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 824/1616] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:39:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:39:57.640288 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1370a90-e6ab-4da1-bb76-86e65bc9e29f service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:57.655241 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1370a90-e6ab-4da1-bb76-86e65bc9e29f service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:57.661950 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5844e1-9734-4b55-9e6a-5a9f34efe326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:57.662723 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5844e1-9734-4b55-9e6a-5a9f34efe326 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:57.663121 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5844e1-9734-4b55-9e6a-5a9f34efe326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:57.663460 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5844e1-9734-4b55-9e6a-5a9f34efe326 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:57.664554 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5844e1-9734-4b55-9e6a-5a9f34efe326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:57.666435 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5844e1-9734-4b55-9e6a-5a9f34efe326 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:57.690974 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c46fc-eec8-4bbc-bbee-9f871c721083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:57.692582 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c46fc-eec8-4bbc-bbee-9f871c721083 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:57.693737 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 825/1617] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:39:57 2022] POST /identity/v3/users => generated 308 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:39:57.694616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5844e1-9734-4b55-9e6a-5a9f34efe326 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:57.710376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5844e1-9734-4b55-9e6a-5a9f34efe326 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:57.714713 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 793/1618] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:39:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:39:57.716018 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320bb35-da51-4e3e-95fe-5b77f03200cc None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:57.716326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320bb35-da51-4e3e-95fe-5b77f03200cc None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:57.716785 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320bb35-da51-4e3e-95fe-5b77f03200cc None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:57.718725 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 794/1619] 10.222.0.59 () {54 vars in 961 bytes} [Thu Jun 30 10:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:39:57.719477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99193617-9094-4162-bd4e-d633ed22ed86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:57.719624 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320bb35-da51-4e3e-95fe-5b77f03200cc None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:57.720847 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99193617-9094-4162-bd4e-d633ed22ed86 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:57.721287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99193617-9094-4162-bd4e-d633ed22ed86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:57.721634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99193617-9094-4162-bd4e-d633ed22ed86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:57.722456 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99193617-9094-4162-bd4e-d633ed22ed86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:57.725059 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99193617-9094-4162-bd4e-d633ed22ed86 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:57.743080 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320bb35-da51-4e3e-95fe-5b77f03200cc None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:57.753059 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcd442-91a2-498a-aa12-b036af9705e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:57.753892 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcd442-91a2-498a-aa12-b036af9705e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:57.754246 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcd442-91a2-498a-aa12-b036af9705e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:57.754643 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcd442-91a2-498a-aa12-b036af9705e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:57.755962 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fcd442-91a2-498a-aa12-b036af9705e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:57.758122 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fcd442-91a2-498a-aa12-b036af9705e0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:57.769009 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 826/1620] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:39:57 2022] POST /identity/v3/projects => generated 371 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:39:57.769009 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82d2cc-871a-4b8f-8ac3-b2aa09b09319 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:57.769009 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82d2cc-871a-4b8f-8ac3-b2aa09b09319 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:57.769009 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82d2cc-871a-4b8f-8ac3-b2aa09b09319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:57.781774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 795/1621] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:39:57.783043 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcd442-91a2-498a-aa12-b036af9705e0 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:57.795381 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcd442-91a2-498a-aa12-b036af9705e0 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:57.802259 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-fe82d2cc-871a-4b8f-8ac3-b2aa09b09319 None None] MFA Rules not processed for user `1bfd036d747241d9bc314b60bf8648b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:57.804954 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-fe82d2cc-871a-4b8f-8ac3-b2aa09b09319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:57.875250 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233425b4-1478-418d-bc3a-223e20818c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:57.876735 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233425b4-1478-418d-bc3a-223e20818c90 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:57.877094 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233425b4-1478-418d-bc3a-223e20818c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:57.877448 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233425b4-1478-418d-bc3a-223e20818c90 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:57.878221 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233425b4-1478-418d-bc3a-223e20818c90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:57.880488 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233425b4-1478-418d-bc3a-223e20818c90 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:57.894699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 827/1622] 10.222.0.59 () {58 vars in 1058 bytes} [Thu Jun 30 10:39:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:39:57.895764 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82d2cc-871a-4b8f-8ac3-b2aa09b09319 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:57.910419 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82d2cc-871a-4b8f-8ac3-b2aa09b09319 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:57.914184 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 796/1623] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:39:57 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:39:57.916141 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343fe4f-617e-45ae-89bc-c8a7a6818b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:57.918021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343fe4f-617e-45ae-89bc-c8a7a6818b5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:57.918501 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343fe4f-617e-45ae-89bc-c8a7a6818b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:57.918989 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343fe4f-617e-45ae-89bc-c8a7a6818b5d admin admin] PATH_INFO: `/v3/projects/31cb0455850f48a5acabbc7566da6b7e/users/d82f28b1889741b09b0766aa5e67411c/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:57.920696 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233425b4-1478-418d-bc3a-223e20818c90 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:57.945182 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233425b4-1478-418d-bc3a-223e20818c90 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:57.947690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343fe4f-617e-45ae-89bc-c8a7a6818b5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=31cb0455850f48a5acabbc7566da6b7e, user_id=d82f28b1889741b09b0766aa5e67411c, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:57.960037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a080d-5afa-46f3-a55f-f1aad96c5527 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:57.960037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a080d-5afa-46f3-a55f-f1aad96c5527 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:57.960037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a080d-5afa-46f3-a55f-f1aad96c5527 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:57.960037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a080d-5afa-46f3-a55f-f1aad96c5527 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:57.960664 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343fe4f-617e-45ae-89bc-c8a7a6818b5d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:57.983838 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 828/1624] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:39:57 2022] PUT /identity/v3/projects/31cb0455850f48a5acabbc7566da6b7e/users/d82f28b1889741b09b0766aa5e67411c/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:39:57.990535 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343fe4f-617e-45ae-89bc-c8a7a6818b5d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:58.013014 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:39:58.044406 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a080d-5afa-46f3-a55f-f1aad96c5527 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:58.046405 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a080d-5afa-46f3-a55f-f1aad96c5527 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:58.059167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 797/1625] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:39:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:39:58.060393 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a080d-5afa-46f3-a55f-f1aad96c5527 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:58.072927 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a080d-5afa-46f3-a55f-f1aad96c5527 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:58.089529 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343fe4f-617e-45ae-89bc-c8a7a6818b5d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:58.099536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816bace-97b8-4b50-abe9-b7b2a482fa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:58.100617 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816bace-97b8-4b50-abe9-b7b2a482fa23 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:58.100817 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816bace-97b8-4b50-abe9-b7b2a482fa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:58.101096 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816bace-97b8-4b50-abe9-b7b2a482fa23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:58.102011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816bace-97b8-4b50-abe9-b7b2a482fa23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:58.104043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816bace-97b8-4b50-abe9-b7b2a482fa23 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:58.120327 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 829/1626] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:39:58.123605 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816bace-97b8-4b50-abe9-b7b2a482fa23 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:58.135923 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816bace-97b8-4b50-abe9-b7b2a482fa23 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:58.145250 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41e976-8d1a-43ed-be40-82d164461963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:58.146423 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41e976-8d1a-43ed-be40-82d164461963 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:58.146764 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41e976-8d1a-43ed-be40-82d164461963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:58.147172 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41e976-8d1a-43ed-be40-82d164461963 admin admin] PATH_INFO: `/v3/projects/28a5b471f39e430bb141f2b8c0cebafb/users/2a1f0eeb7ccf4e52a9ff0057eb21757b/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:58.150421 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196728ea-acd5-4cd2-8aa2-b494ca424dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:58.151292 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196728ea-acd5-4cd2-8aa2-b494ca424dfc admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:58.151653 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196728ea-acd5-4cd2-8aa2-b494ca424dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:58.152004 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196728ea-acd5-4cd2-8aa2-b494ca424dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:58.152852 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196728ea-acd5-4cd2-8aa2-b494ca424dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:58.154655 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196728ea-acd5-4cd2-8aa2-b494ca424dfc admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:58.167117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 798/1627] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:39:58.175358 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41e976-8d1a-43ed-be40-82d164461963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a5b471f39e430bb141f2b8c0cebafb, user_id=2a1f0eeb7ccf4e52a9ff0057eb21757b, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:58.176883 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196728ea-acd5-4cd2-8aa2-b494ca424dfc admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:58.181674 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41e976-8d1a-43ed-be40-82d164461963 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:58.187839 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196728ea-acd5-4cd2-8aa2-b494ca424dfc admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:58.194919 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:39:58.210430 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 830/1628] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:39:58 2022] PUT /identity/v3/projects/28a5b471f39e430bb141f2b8c0cebafb/users/2a1f0eeb7ccf4e52a9ff0057eb21757b/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:39:58.212218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41e976-8d1a-43ed-be40-82d164461963 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:58.328236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e49a4-a94d-4afe-bd00-1894d3e24cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:58.331171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e49a4-a94d-4afe-bd00-1894d3e24cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:58.331512 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e49a4-a94d-4afe-bd00-1894d3e24cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:58.333269 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e49a4-a94d-4afe-bd00-1894d3e24cd4 admin admin] PATH_INFO: `/v3/projects/31cb0455850f48a5acabbc7566da6b7e/users/d82f28b1889741b09b0766aa5e67411c/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:58.338659 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e49a4-a94d-4afe-bd00-1894d3e24cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31cb0455850f48a5acabbc7566da6b7e, user_id=d82f28b1889741b09b0766aa5e67411c, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:58.347925 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e49a4-a94d-4afe-bd00-1894d3e24cd4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:58.387280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 799/1629] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:39:58 2022] PUT /identity/v3/projects/31cb0455850f48a5acabbc7566da6b7e/users/d82f28b1889741b09b0766aa5e67411c/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:39:58.390092 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca3363-a4be-436e-8696-3d8e812b2d52 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:58.390420 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca3363-a4be-436e-8696-3d8e812b2d52 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:58.392074 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca3363-a4be-436e-8696-3d8e812b2d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:58.409146 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41e976-8d1a-43ed-be40-82d164461963 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:58.460355 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3eca3363-a4be-436e-8696-3d8e812b2d52 None None] MFA Rules not processed for user `d82f28b1889741b09b0766aa5e67411c`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:58.461673 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3eca3363-a4be-436e-8696-3d8e812b2d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:58.572943 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03b5f6-ce2b-4034-ba9d-ae95ca928d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:58.574871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03b5f6-ce2b-4034-ba9d-ae95ca928d55 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:58.576607 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03b5f6-ce2b-4034-ba9d-ae95ca928d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:58.579507 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03b5f6-ce2b-4034-ba9d-ae95ca928d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:58.581379 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03b5f6-ce2b-4034-ba9d-ae95ca928d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:58.584481 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:39:58.587982 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03b5f6-ce2b-4034-ba9d-ae95ca928d55 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:58.621896 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 831/1630] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:39:58.625651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03b5f6-ce2b-4034-ba9d-ae95ca928d55 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:58.631183 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 800/1631] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:39:58 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:39:58.643410 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca3363-a4be-436e-8696-3d8e812b2d52 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:58.652982 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03b5f6-ce2b-4034-ba9d-ae95ca928d55 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:58.668673 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fa231-3344-41f6-89b6-928e60e09d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:58.669975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fa231-3344-41f6-89b6-928e60e09d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:58.670507 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fa231-3344-41f6-89b6-928e60e09d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:58.671020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fa231-3344-41f6-89b6-928e60e09d09 admin admin] PATH_INFO: `/v3/projects/28a5b471f39e430bb141f2b8c0cebafb/users/2a1f0eeb7ccf4e52a9ff0057eb21757b/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:58.673545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fa231-3344-41f6-89b6-928e60e09d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a5b471f39e430bb141f2b8c0cebafb, user_id=2a1f0eeb7ccf4e52a9ff0057eb21757b, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:58.676753 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fa231-3344-41f6-89b6-928e60e09d09 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:58.707262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 832/1632] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:39:58 2022] PUT /identity/v3/projects/28a5b471f39e430bb141f2b8c0cebafb/users/2a1f0eeb7ccf4e52a9ff0057eb21757b/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:39:58.717904 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cad84-05dc-428f-aa18-4ecf3c870f8d None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:58.721540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cad84-05dc-428f-aa18-4ecf3c870f8d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:58.721755 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cad84-05dc-428f-aa18-4ecf3c870f8d None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:58.723734 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 833/1633] 10.222.0.59 () {54 vars in 912 bytes} [Thu Jun 30 10:39:58 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:39:58.725648 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97810c-336c-4c76-b95a-12ccec6ffa30 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:58.727210 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97810c-336c-4c76-b95a-12ccec6ffa30 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:58.728861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97810c-336c-4c76-b95a-12ccec6ffa30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:58.753343 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca3363-a4be-436e-8696-3d8e812b2d52 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:58.788572 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-4e97810c-336c-4c76-b95a-12ccec6ffa30 None None] MFA Rules not processed for user `2a1f0eeb7ccf4e52a9ff0057eb21757b`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:58.790251 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4e97810c-336c-4c76-b95a-12ccec6ffa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:58.853915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f05850-2f4f-4315-adef-a5cb7549afa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:58.855007 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f05850-2f4f-4315-adef-a5cb7549afa4 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:58.855277 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f05850-2f4f-4315-adef-a5cb7549afa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:58.856093 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f05850-2f4f-4315-adef-a5cb7549afa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:58.954065 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f05850-2f4f-4315-adef-a5cb7549afa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:58.956453 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f05850-2f4f-4315-adef-a5cb7549afa4 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:58.957817 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 834/1634] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:39:58 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:39:58.959291 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b4ce5-f0e8-4203-8e22-706661b6eb7e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:58.959584 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b4ce5-f0e8-4203-8e22-706661b6eb7e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:58.959864 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b4ce5-f0e8-4203-8e22-706661b6eb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:58.972429 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 801/1635] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:39:58 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:39:58.973565 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f05850-2f4f-4315-adef-a5cb7549afa4 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:58.991828 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f05850-2f4f-4315-adef-a5cb7549afa4 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:58.997192 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eaf3ba-5a75-4de1-812d-95ef25e38b59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:58.998052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eaf3ba-5a75-4de1-812d-95ef25e38b59 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:58.998540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eaf3ba-5a75-4de1-812d-95ef25e38b59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:58.998837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eaf3ba-5a75-4de1-812d-95ef25e38b59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:59.004097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-301b4ce5-f0e8-4203-8e22-706661b6eb7e None None] MFA Rules not processed for user `1bfd036d747241d9bc314b60bf8648b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:59.008610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-301b4ce5-f0e8-4203-8e22-706661b6eb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:59.013442 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eaf3ba-5a75-4de1-812d-95ef25e38b59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:59.014847 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eaf3ba-5a75-4de1-812d-95ef25e38b59 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:59.027215 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 802/1636] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:39:58 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:39:59.036696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:39:59.202574 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 835/1637] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 30 10:39:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:39:59.218829 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eaf3ba-5a75-4de1-812d-95ef25e38b59 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:59.234000 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eaf3ba-5a75-4de1-812d-95ef25e38b59 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:59.239768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adca8e-6caa-4ec4-ab9b-858abdc067b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:59.241277 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adca8e-6caa-4ec4-ab9b-858abdc067b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:59.241878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adca8e-6caa-4ec4-ab9b-858abdc067b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:59.242345 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adca8e-6caa-4ec4-ab9b-858abdc067b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:59.259346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adca8e-6caa-4ec4-ab9b-858abdc067b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:59.261322 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adca8e-6caa-4ec4-ab9b-858abdc067b8 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:59.288105 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 803/1638] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:39:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:39:59.398008 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b4ce5-f0e8-4203-8e22-706661b6eb7e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:39:59.539344 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b4ce5-f0e8-4203-8e22-706661b6eb7e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:39:59.556645 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d6cb8-797e-4158-a89f-89e088d1247a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:39:59.557714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d6cb8-797e-4158-a89f-89e088d1247a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:59.557993 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d6cb8-797e-4158-a89f-89e088d1247a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:59.558264 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d6cb8-797e-4158-a89f-89e088d1247a admin admin] PATH_INFO: `/v3/users/3770af8431324c7d8e9118cacfc756e5` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:59.561122 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d6cb8-797e-4158-a89f-89e088d1247a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3770af8431324c7d8e9118cacfc756e5)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:39:59.562144 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: WARNING py.warnings [None req-e57d6cb8-797e-4158-a89f-89e088d1247a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:39:59.562144 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: warnings.warn(msg) Jun 30 10:39:59.562144 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: Jun 30 10:39:59.563900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d6cb8-797e-4158-a89f-89e088d1247a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:39:59.723145 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e57d6cb8-797e-4158-a89f-89e088d1247a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3770af8431324c7d8e9118cacfc756e5'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:39:59.765169 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e57d6cb8-797e-4158-a89f-89e088d1247a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3770af8431324c7d8e9118cacfc756e5'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:39:59.767124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e57d6cb8-797e-4158-a89f-89e088d1247a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3770af8431324c7d8e9118cacfc756e5'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:39:59.786299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e57d6cb8-797e-4158-a89f-89e088d1247a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3770af8431324c7d8e9118cacfc756e5'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:39:59.787305 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e57d6cb8-797e-4158-a89f-89e088d1247a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3770af8431324c7d8e9118cacfc756e5'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:39:59.815801 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 836/1639] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:39:59 2022] DELETE /identity/v3/users/3770af8431324c7d8e9118cacfc756e5 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:39:59.820005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7d819-e99a-49db-ad76-825cb521d01c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:39:59.820430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7d819-e99a-49db-ad76-825cb521d01c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:39:59.820942 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7d819-e99a-49db-ad76-825cb521d01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:39:59.851211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d9a7d819-e99a-49db-ad76-825cb521d01c None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:39:59.852382 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d9a7d819-e99a-49db-ad76-825cb521d01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:39:59.906720 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:39:59.981774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 804/1640] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:39:59.997230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d6cb8-797e-4158-a89f-89e088d1247a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:00.003602 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e57d6cb8-797e-4158-a89f-89e088d1247a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:00.027159 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7d819-e99a-49db-ad76-825cb521d01c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:00.029482 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d9a7d819-e99a-49db-ad76-825cb521d01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:00.053288 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7d819-e99a-49db-ad76-825cb521d01c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:00.068864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d92bc-6514-4de2-97be-e2bea65f5361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:00.070751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d92bc-6514-4de2-97be-e2bea65f5361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:00.072488 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d92bc-6514-4de2-97be-e2bea65f5361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:00.072806 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d92bc-6514-4de2-97be-e2bea65f5361 admin admin] PATH_INFO: `/v3/users/6d0df309b3b147da9ec50dac3935f5f7` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:00.076544 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d92bc-6514-4de2-97be-e2bea65f5361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d0df309b3b147da9ec50dac3935f5f7)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:00.080709 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d92bc-6514-4de2-97be-e2bea65f5361 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:00.089886 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:00.158105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d6cb8-797e-4158-a89f-89e088d1247a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:00.162123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf9e2a-7c1a-46d0-ba7f-a91fefa702f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:00.163317 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf9e2a-7c1a-46d0-ba7f-a91fefa702f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:00.163317 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf9e2a-7c1a-46d0-ba7f-a91fefa702f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:00.163547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf9e2a-7c1a-46d0-ba7f-a91fefa702f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:00.196142 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf9e2a-7c1a-46d0-ba7f-a91fefa702f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:00.197634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf9e2a-7c1a-46d0-ba7f-a91fefa702f8 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:00.206984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2e4d92bc-6514-4de2-97be-e2bea65f5361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d0df309b3b147da9ec50dac3935f5f7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:00.208005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2e4d92bc-6514-4de2-97be-e2bea65f5361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d0df309b3b147da9ec50dac3935f5f7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:00.221618 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2e4d92bc-6514-4de2-97be-e2bea65f5361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d0df309b3b147da9ec50dac3935f5f7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:00.223381 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2e4d92bc-6514-4de2-97be-e2bea65f5361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d0df309b3b147da9ec50dac3935f5f7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:00.230829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 837/1641] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:39:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:00.242861 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2e4d92bc-6514-4de2-97be-e2bea65f5361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d0df309b3b147da9ec50dac3935f5f7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:00.288677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 805/1642] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:40:00 2022] DELETE /identity/v3/users/6d0df309b3b147da9ec50dac3935f5f7 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:00.289420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe7c41-68a2-4353-94d0-4fb15f2af2c8 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:00.289710 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe7c41-68a2-4353-94d0-4fb15f2af2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:00.290012 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe7c41-68a2-4353-94d0-4fb15f2af2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:00.325924 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9ffe7c41-68a2-4353-94d0-4fb15f2af2c8 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:00.327154 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9ffe7c41-68a2-4353-94d0-4fb15f2af2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:00.499374 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 838/1643] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:00.565742 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d92bc-6514-4de2-97be-e2bea65f5361 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:00.567649 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2e4d92bc-6514-4de2-97be-e2bea65f5361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:00.714048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d92bc-6514-4de2-97be-e2bea65f5361 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:00.729677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690657d-1fd2-45c7-82d1-1528fb349295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:00.730238 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690657d-1fd2-45c7-82d1-1528fb349295 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:00.730526 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690657d-1fd2-45c7-82d1-1528fb349295 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:00.730813 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690657d-1fd2-45c7-82d1-1528fb349295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:00.751045 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690657d-1fd2-45c7-82d1-1528fb349295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:00.752562 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690657d-1fd2-45c7-82d1-1528fb349295 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:00.772487 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 806/1644] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:00.875165 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1a30e-a295-442d-b2bb-0da1c07fc3e7 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:00.875805 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1a30e-a295-442d-b2bb-0da1c07fc3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:00.876141 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1a30e-a295-442d-b2bb-0da1c07fc3e7 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:00.880089 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 839/1645] 10.222.0.59 () {54 vars in 961 bytes} [Thu Jun 30 10:40:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:40:00.893625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecc953-e01d-42bb-a0ba-1e9f83a8eacd None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:00.893918 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecc953-e01d-42bb-a0ba-1e9f83a8eacd None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:00.894198 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecc953-e01d-42bb-a0ba-1e9f83a8eacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:00.929065 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-afecc953-e01d-42bb-a0ba-1e9f83a8eacd None None] MFA Rules not processed for user `1bfd036d747241d9bc314b60bf8648b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:00.930320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-afecc953-e01d-42bb-a0ba-1e9f83a8eacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:00.984103 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:01.036363 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 807/1646] 10.222.0.59 () {58 vars in 1058 bytes} [Thu Jun 30 10:40:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:01.046296 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e2592-399f-403f-9c50-126bc3b3d1b6 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:01.047067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e2592-399f-403f-9c50-126bc3b3d1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:01.048118 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e2592-399f-403f-9c50-126bc3b3d1b6 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:01.050057 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 840/1647] 10.222.0.59 () {54 vars in 912 bytes} [Thu Jun 30 10:40:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:40:01.062051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41d5f4-ee15-404a-bf35-60033bc54c55 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:01.062706 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41d5f4-ee15-404a-bf35-60033bc54c55 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:01.064969 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41d5f4-ee15-404a-bf35-60033bc54c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:01.093010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-5b41d5f4-ee15-404a-bf35-60033bc54c55 None None] MFA Rules not processed for user `1bfd036d747241d9bc314b60bf8648b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:01.095691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5b41d5f4-ee15-404a-bf35-60033bc54c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:01.117926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 808/1648] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 30 10:40:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:01.126538 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e2592-399f-403f-9c50-126bc3b3d1b6 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:01.128900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-515e2592-399f-403f-9c50-126bc3b3d1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:01.311624 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e2592-399f-403f-9c50-126bc3b3d1b6 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:01.322176 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f450f-2317-44cd-8491-6e2be5fa39ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:01.322865 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f450f-2317-44cd-8491-6e2be5fa39ff service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:01.323148 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f450f-2317-44cd-8491-6e2be5fa39ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:01.323425 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f450f-2317-44cd-8491-6e2be5fa39ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:01.352912 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f450f-2317-44cd-8491-6e2be5fa39ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:01.359016 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f450f-2317-44cd-8491-6e2be5fa39ff service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:01.412951 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 841/1649] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:01.661270 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41d5f4-ee15-404a-bf35-60033bc54c55 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:01.663113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5b41d5f4-ee15-404a-bf35-60033bc54c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:01.693182 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41d5f4-ee15-404a-bf35-60033bc54c55 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:01.711852 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cc181-c4e7-410d-8689-b868c887d7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:01.712765 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cc181-c4e7-410d-8689-b868c887d7f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:01.713047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cc181-c4e7-410d-8689-b868c887d7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:01.713326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cc181-c4e7-410d-8689-b868c887d7f1 admin admin] PATH_INFO: `/v3/projects/40d2e022de474768ae630b66e17350e4` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:01.714542 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058cc181-c4e7-410d-8689-b868c887d7f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40d2e022de474768ae630b66e17350e4)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:01.715573 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: WARNING py.warnings [None req-058cc181-c4e7-410d-8689-b868c887d7f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:40:01.715573 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: warnings.warn(msg) Jun 30 10:40:01.715573 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: Jun 30 10:40:01.716835 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058cc181-c4e7-410d-8689-b868c887d7f1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:01.844411 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-058cc181-c4e7-410d-8689-b868c887d7f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40d2e022de474768ae630b66e17350e4', 'request_id': 'req-058cc181-c4e7-410d-8689-b868c887d7f1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:01.855315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-058cc181-c4e7-410d-8689-b868c887d7f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40d2e022de474768ae630b66e17350e4', 'request_id': 'req-058cc181-c4e7-410d-8689-b868c887d7f1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:01.872339 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-058cc181-c4e7-410d-8689-b868c887d7f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40d2e022de474768ae630b66e17350e4', 'request_id': 'req-058cc181-c4e7-410d-8689-b868c887d7f1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:01.907362 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-058cc181-c4e7-410d-8689-b868c887d7f1 admin admin] The token cache is being invalidate because project 40d2e022de474768ae630b66e17350e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:40:01.907954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-058cc181-c4e7-410d-8689-b868c887d7f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:01.908797 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-058cc181-c4e7-410d-8689-b868c887d7f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:01.911060 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 809/1650] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:40:01 2022] DELETE /identity/v3/projects/40d2e022de474768ae630b66e17350e4 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:01.914893 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f450f-2317-44cd-8491-6e2be5fa39ff service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:01.927164 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f450f-2317-44cd-8491-6e2be5fa39ff service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:02.012651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f209c6d-2f3a-4db8-99da-52a759c3a91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:02.013663 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f209c6d-2f3a-4db8-99da-52a759c3a91c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:02.014219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f209c6d-2f3a-4db8-99da-52a759c3a91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:02.014575 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f209c6d-2f3a-4db8-99da-52a759c3a91c admin admin] PATH_INFO: `/v3/users/d82f28b1889741b09b0766aa5e67411c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:02.017343 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f209c6d-2f3a-4db8-99da-52a759c3a91c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d82f28b1889741b09b0766aa5e67411c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:02.019374 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f209c6d-2f3a-4db8-99da-52a759c3a91c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:02.041788 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:02.114350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0f209c6d-2f3a-4db8-99da-52a759c3a91c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd82f28b1889741b09b0766aa5e67411c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:02.166167 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0f209c6d-2f3a-4db8-99da-52a759c3a91c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd82f28b1889741b09b0766aa5e67411c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:02.170902 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0f209c6d-2f3a-4db8-99da-52a759c3a91c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd82f28b1889741b09b0766aa5e67411c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:02.199347 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0f209c6d-2f3a-4db8-99da-52a759c3a91c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd82f28b1889741b09b0766aa5e67411c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:02.200801 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0f209c6d-2f3a-4db8-99da-52a759c3a91c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd82f28b1889741b09b0766aa5e67411c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:02.230958 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 842/1651] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:40:01 2022] DELETE /identity/v3/users/d82f28b1889741b09b0766aa5e67411c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:40:02.566276 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cc181-c4e7-410d-8689-b868c887d7f1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:02.568193 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-058cc181-c4e7-410d-8689-b868c887d7f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:02.589791 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cc181-c4e7-410d-8689-b868c887d7f1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:02.762493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be701028-756a-4fbd-9553-a1b7fe4d6fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:02.763397 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be701028-756a-4fbd-9553-a1b7fe4d6fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:02.763686 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be701028-756a-4fbd-9553-a1b7fe4d6fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:02.763961 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be701028-756a-4fbd-9553-a1b7fe4d6fb9 admin admin] PATH_INFO: `/v3/projects/90bb504b32574e25b8575703fefb7c54` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:02.768057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be701028-756a-4fbd-9553-a1b7fe4d6fb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90bb504b32574e25b8575703fefb7c54)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:02.770371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be701028-756a-4fbd-9553-a1b7fe4d6fb9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:02.884371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-be701028-756a-4fbd-9553-a1b7fe4d6fb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90bb504b32574e25b8575703fefb7c54', 'request_id': 'req-be701028-756a-4fbd-9553-a1b7fe4d6fb9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:02.889955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:02.905600 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-be701028-756a-4fbd-9553-a1b7fe4d6fb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90bb504b32574e25b8575703fefb7c54', 'request_id': 'req-be701028-756a-4fbd-9553-a1b7fe4d6fb9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:02.915153 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-be701028-756a-4fbd-9553-a1b7fe4d6fb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90bb504b32574e25b8575703fefb7c54', 'request_id': 'req-be701028-756a-4fbd-9553-a1b7fe4d6fb9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:02.949938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-be701028-756a-4fbd-9553-a1b7fe4d6fb9 admin admin] The token cache is being invalidate because project 90bb504b32574e25b8575703fefb7c54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:40:02.950230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-be701028-756a-4fbd-9553-a1b7fe4d6fb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:02.950915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-be701028-756a-4fbd-9553-a1b7fe4d6fb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:02.952995 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 810/1652] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:40:02 2022] DELETE /identity/v3/projects/90bb504b32574e25b8575703fefb7c54 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:02.957633 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f209c6d-2f3a-4db8-99da-52a759c3a91c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:02.959335 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0f209c6d-2f3a-4db8-99da-52a759c3a91c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:02.982471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f209c6d-2f3a-4db8-99da-52a759c3a91c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:03.151041 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23129b-bd30-4edf-8be8-494881bed29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:03.152826 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23129b-bd30-4edf-8be8-494881bed29e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:03.153397 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23129b-bd30-4edf-8be8-494881bed29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:03.154462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23129b-bd30-4edf-8be8-494881bed29e admin admin] PATH_INFO: `/v3/users/2a1f0eeb7ccf4e52a9ff0057eb21757b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:03.157796 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23129b-bd30-4edf-8be8-494881bed29e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1f0eeb7ccf4e52a9ff0057eb21757b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:03.160893 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23129b-bd30-4edf-8be8-494881bed29e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:03.301651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-da23129b-bd30-4edf-8be8-494881bed29e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1f0eeb7ccf4e52a9ff0057eb21757b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:03.337406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-da23129b-bd30-4edf-8be8-494881bed29e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1f0eeb7ccf4e52a9ff0057eb21757b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:03.338398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-da23129b-bd30-4edf-8be8-494881bed29e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1f0eeb7ccf4e52a9ff0057eb21757b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:03.353342 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-da23129b-bd30-4edf-8be8-494881bed29e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1f0eeb7ccf4e52a9ff0057eb21757b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:03.354322 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-da23129b-bd30-4edf-8be8-494881bed29e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1f0eeb7ccf4e52a9ff0057eb21757b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:03.382957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 843/1653] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:40:02 2022] DELETE /identity/v3/users/2a1f0eeb7ccf4e52a9ff0057eb21757b => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:04.037592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be701028-756a-4fbd-9553-a1b7fe4d6fb9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:04.040580 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-be701028-756a-4fbd-9553-a1b7fe4d6fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:04.058667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be701028-756a-4fbd-9553-a1b7fe4d6fb9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:04.163021 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033edda0-dbbb-4e60-9e0b-1bc7e29870b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:04.163975 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033edda0-dbbb-4e60-9e0b-1bc7e29870b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:04.165204 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033edda0-dbbb-4e60-9e0b-1bc7e29870b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:04.165548 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033edda0-dbbb-4e60-9e0b-1bc7e29870b9 admin admin] PATH_INFO: `/v3/users/b09fbc020c6d43ea8e24da41d2eeadb6` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:04.169456 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033edda0-dbbb-4e60-9e0b-1bc7e29870b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b09fbc020c6d43ea8e24da41d2eeadb6)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:04.178378 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033edda0-dbbb-4e60-9e0b-1bc7e29870b9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:04.299648 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23129b-bd30-4edf-8be8-494881bed29e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:04.301534 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-da23129b-bd30-4edf-8be8-494881bed29e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:04.319677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-033edda0-dbbb-4e60-9e0b-1bc7e29870b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b09fbc020c6d43ea8e24da41d2eeadb6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:04.321602 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-033edda0-dbbb-4e60-9e0b-1bc7e29870b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b09fbc020c6d43ea8e24da41d2eeadb6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:04.330776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23129b-bd30-4edf-8be8-494881bed29e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:04.339576 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-033edda0-dbbb-4e60-9e0b-1bc7e29870b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b09fbc020c6d43ea8e24da41d2eeadb6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:04.343539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-033edda0-dbbb-4e60-9e0b-1bc7e29870b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b09fbc020c6d43ea8e24da41d2eeadb6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:04.346725 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318097e-3c8b-4ded-8fe4-b4b28349b62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:04.350629 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318097e-3c8b-4ded-8fe4-b4b28349b62b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:04.350914 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318097e-3c8b-4ded-8fe4-b4b28349b62b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:04.353441 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318097e-3c8b-4ded-8fe4-b4b28349b62b admin admin] PATH_INFO: `/v3/projects/31cb0455850f48a5acabbc7566da6b7e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:04.357922 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318097e-3c8b-4ded-8fe4-b4b28349b62b admin admin] RBAC: Authorizing `identity:delete_project(project_id=31cb0455850f48a5acabbc7566da6b7e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:04.367501 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318097e-3c8b-4ded-8fe4-b4b28349b62b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:04.373569 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-033edda0-dbbb-4e60-9e0b-1bc7e29870b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b09fbc020c6d43ea8e24da41d2eeadb6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:04.393169 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:04.424191 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 811/1654] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:40:04 2022] DELETE /identity/v3/users/b09fbc020c6d43ea8e24da41d2eeadb6 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:04.431201 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171f93a-6b56-4246-98fb-c28f9d6e4282 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:04.431881 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171f93a-6b56-4246-98fb-c28f9d6e4282 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:04.432367 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171f93a-6b56-4246-98fb-c28f9d6e4282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:04.493475 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4171f93a-6b56-4246-98fb-c28f9d6e4282 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:04.496991 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4171f93a-6b56-4246-98fb-c28f9d6e4282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:04.549985 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0318097e-3c8b-4ded-8fe4-b4b28349b62b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31cb0455850f48a5acabbc7566da6b7e', 'request_id': 'req-0318097e-3c8b-4ded-8fe4-b4b28349b62b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:04.581879 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0318097e-3c8b-4ded-8fe4-b4b28349b62b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31cb0455850f48a5acabbc7566da6b7e', 'request_id': 'req-0318097e-3c8b-4ded-8fe4-b4b28349b62b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:04.591329 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0318097e-3c8b-4ded-8fe4-b4b28349b62b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31cb0455850f48a5acabbc7566da6b7e', 'request_id': 'req-0318097e-3c8b-4ded-8fe4-b4b28349b62b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:04.621233 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0318097e-3c8b-4ded-8fe4-b4b28349b62b admin admin] The token cache is being invalidate because project 31cb0455850f48a5acabbc7566da6b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:40:04.623005 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0318097e-3c8b-4ded-8fe4-b4b28349b62b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:04.629681 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0318097e-3c8b-4ded-8fe4-b4b28349b62b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:04.637406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 844/1655] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:40:04 2022] DELETE /identity/v3/projects/31cb0455850f48a5acabbc7566da6b7e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:40:04.639260 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dabe3-22cf-4558-8b2e-7352ad8840ae None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:04.639485 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dabe3-22cf-4558-8b2e-7352ad8840ae None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:04.639768 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dabe3-22cf-4558-8b2e-7352ad8840ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:04.702855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 812/1656] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:04.720993 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-dd2dabe3-22cf-4558-8b2e-7352ad8840ae None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:04.722194 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-dd2dabe3-22cf-4558-8b2e-7352ad8840ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:04.770098 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 845/1657] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:04.788790 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c17e5-65e4-4cdb-a898-0ac791976e01 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:04.789807 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c17e5-65e4-4cdb-a898-0ac791976e01 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:04.793499 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c17e5-65e4-4cdb-a898-0ac791976e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:04.810634 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:04.874955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-dc9c17e5-65e4-4cdb-a898-0ac791976e01 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:04.876573 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dc9c17e5-65e4-4cdb-a898-0ac791976e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:04.894542 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 813/1658] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:04.898718 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2dabe3-22cf-4558-8b2e-7352ad8840ae None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:04.913893 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2dabe3-22cf-4558-8b2e-7352ad8840ae None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:04.930417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a0a96-da39-4c0d-b9be-1b7c6435aaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:04.930692 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a0a96-da39-4c0d-b9be-1b7c6435aaac admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:04.930864 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a0a96-da39-4c0d-b9be-1b7c6435aaac admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:04.931097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a0a96-da39-4c0d-b9be-1b7c6435aaac admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:04.935845 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a0a96-da39-4c0d-b9be-1b7c6435aaac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:40:04.936232 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a0a96-da39-4c0d-b9be-1b7c6435aaac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:04.938142 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a0a96-da39-4c0d-b9be-1b7c6435aaac admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:05.014377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 846/1659] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:40:05.018890 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c17e5-65e4-4cdb-a898-0ac791976e01 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:05.037057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c17e5-65e4-4cdb-a898-0ac791976e01 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:05.074842 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a0a96-da39-4c0d-b9be-1b7c6435aaac admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:05.076849 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-5b5a0a96-da39-4c0d-b9be-1b7c6435aaac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:05.085476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203512d-a688-4a12-8d27-cd40ad5909d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:05.086245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203512d-a688-4a12-8d27-cd40ad5909d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:05.086603 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203512d-a688-4a12-8d27-cd40ad5909d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:05.086971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203512d-a688-4a12-8d27-cd40ad5909d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:05.087762 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203512d-a688-4a12-8d27-cd40ad5909d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:05.089962 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203512d-a688-4a12-8d27-cd40ad5909d7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:05.164857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 814/1660] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:40:05 2022] POST /identity/v3/projects => generated 375 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:05.176196 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203512d-a688-4a12-8d27-cd40ad5909d7 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:05.249672 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a0a96-da39-4c0d-b9be-1b7c6435aaac admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:05.435407 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e71bd3-b2fe-4ef3-a75a-f0881bfca974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:05.436086 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e71bd3-b2fe-4ef3-a75a-f0881bfca974 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:05.436366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e71bd3-b2fe-4ef3-a75a-f0881bfca974 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:05.437794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e71bd3-b2fe-4ef3-a75a-f0881bfca974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:05.444326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203512d-a688-4a12-8d27-cd40ad5909d7 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:05.464452 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e71bd3-b2fe-4ef3-a75a-f0881bfca974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:05.465964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e71bd3-b2fe-4ef3-a75a-f0881bfca974 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:05.473909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2c2cf-8f11-4d23-9709-6f4dce7c96e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:05.474957 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2c2cf-8f11-4d23-9709-6f4dce7c96e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:05.475561 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2c2cf-8f11-4d23-9709-6f4dce7c96e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:05.479394 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2c2cf-8f11-4d23-9709-6f4dce7c96e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:05.484076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2c2cf-8f11-4d23-9709-6f4dce7c96e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:05.487471 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2c2cf-8f11-4d23-9709-6f4dce7c96e8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:05.503730 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 847/1661] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:40:05.575779 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 815/1662] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:40:05 2022] POST /identity/v3/users => generated 288 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:05.579909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e71bd3-b2fe-4ef3-a75a-f0881bfca974 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:05.591623 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e71bd3-b2fe-4ef3-a75a-f0881bfca974 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:05.613565 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8fba3-62c4-4c9a-8c27-400c37fce380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:05.614504 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8fba3-62c4-4c9a-8c27-400c37fce380 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:05.614859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8fba3-62c4-4c9a-8c27-400c37fce380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:05.615454 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8fba3-62c4-4c9a-8c27-400c37fce380 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:05.616318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8fba3-62c4-4c9a-8c27-400c37fce380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:05.618029 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8fba3-62c4-4c9a-8c27-400c37fce380 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:05.655162 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 848/1663] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:40:05.658940 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2c2cf-8f11-4d23-9709-6f4dce7c96e8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:05.675920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2c2cf-8f11-4d23-9709-6f4dce7c96e8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:05.681563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a63ba-f83d-4dfe-99a8-14d86582f6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:05.682656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a63ba-f83d-4dfe-99a8-14d86582f6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:05.682763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a63ba-f83d-4dfe-99a8-14d86582f6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:05.683052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a63ba-f83d-4dfe-99a8-14d86582f6c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:05.683796 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a63ba-f83d-4dfe-99a8-14d86582f6c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:05.687406 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a63ba-f83d-4dfe-99a8-14d86582f6c1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:05.713336 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 816/1664] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:40:05.717239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8fba3-62c4-4c9a-8c27-400c37fce380 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:05.750579 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8fba3-62c4-4c9a-8c27-400c37fce380 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:05.761723 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566d8fe-4c44-454c-bb91-8754332c45a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:05.763056 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566d8fe-4c44-454c-bb91-8754332c45a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:05.763491 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566d8fe-4c44-454c-bb91-8754332c45a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:05.763970 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566d8fe-4c44-454c-bb91-8754332c45a1 admin admin] PATH_INFO: `/v3/projects/84e4d3f7035e4103bdc86a6e43919428/users/3ebc319b6fbd44ceb397b6c65054d0cd/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:05.798850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566d8fe-4c44-454c-bb91-8754332c45a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e4d3f7035e4103bdc86a6e43919428, user_id=3ebc319b6fbd44ceb397b6c65054d0cd, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:05.801938 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566d8fe-4c44-454c-bb91-8754332c45a1 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:05.825823 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:05.840585 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 849/1665] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:40:05 2022] PUT /identity/v3/projects/84e4d3f7035e4103bdc86a6e43919428/users/3ebc319b6fbd44ceb397b6c65054d0cd/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:05.848796 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917ad75-cdea-48d2-b13f-3a5d2c9317dd None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:05.849127 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917ad75-cdea-48d2-b13f-3a5d2c9317dd None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:05.849417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917ad75-cdea-48d2-b13f-3a5d2c9317dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:06.290975 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-5917ad75-cdea-48d2-b13f-3a5d2c9317dd None None] MFA Rules not processed for user `3ebc319b6fbd44ceb397b6c65054d0cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:06.292558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5917ad75-cdea-48d2-b13f-3a5d2c9317dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:06.460846 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566d8fe-4c44-454c-bb91-8754332c45a1 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:06.463337 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d566d8fe-4c44-454c-bb91-8754332c45a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:06.464133 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 817/1666] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 621 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:06.465419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917ad75-cdea-48d2-b13f-3a5d2c9317dd None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:06.542813 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:06.585392 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917ad75-cdea-48d2-b13f-3a5d2c9317dd None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:06.595791 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cde48e-e716-4267-9db7-0b44e7ab34dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:06.597171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cde48e-e716-4267-9db7-0b44e7ab34dc admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:06.597607 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cde48e-e716-4267-9db7-0b44e7ab34dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:06.597890 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cde48e-e716-4267-9db7-0b44e7ab34dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:06.599344 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cde48e-e716-4267-9db7-0b44e7ab34dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:06.601562 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cde48e-e716-4267-9db7-0b44e7ab34dc admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:06.643827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 818/1667] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:40:06 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:06.648418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cde48e-e716-4267-9db7-0b44e7ab34dc admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:06.662636 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566d8fe-4c44-454c-bb91-8754332c45a1 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:06.796214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157d35a-299c-40f5-bf24-451ca854180a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:06.797341 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157d35a-299c-40f5-bf24-451ca854180a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:06.797632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157d35a-299c-40f5-bf24-451ca854180a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:06.798993 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157d35a-299c-40f5-bf24-451ca854180a admin admin] PATH_INFO: `/v3/projects/28a5b471f39e430bb141f2b8c0cebafb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:06.810019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157d35a-299c-40f5-bf24-451ca854180a admin admin] RBAC: Authorizing `identity:delete_project(project_id=28a5b471f39e430bb141f2b8c0cebafb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:06.813049 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157d35a-299c-40f5-bf24-451ca854180a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:06.845858 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cde48e-e716-4267-9db7-0b44e7ab34dc admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:06.851597 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6382d-46c0-4ab6-9721-b24ab9e859f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:06.852293 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6382d-46c0-4ab6-9721-b24ab9e859f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:06.852607 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6382d-46c0-4ab6-9721-b24ab9e859f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:06.852887 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6382d-46c0-4ab6-9721-b24ab9e859f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:06.853595 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6382d-46c0-4ab6-9721-b24ab9e859f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:06.856100 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6382d-46c0-4ab6-9721-b24ab9e859f6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:06.916463 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2157d35a-299c-40f5-bf24-451ca854180a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28a5b471f39e430bb141f2b8c0cebafb', 'request_id': 'req-2157d35a-299c-40f5-bf24-451ca854180a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:06.931693 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 819/1668] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:40:06 2022] POST /identity/v3/users => generated 295 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:06.933643 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2157d35a-299c-40f5-bf24-451ca854180a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28a5b471f39e430bb141f2b8c0cebafb', 'request_id': 'req-2157d35a-299c-40f5-bf24-451ca854180a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:06.939986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6382d-46c0-4ab6-9721-b24ab9e859f6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:06.957487 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6382d-46c0-4ab6-9721-b24ab9e859f6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:06.960942 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2157d35a-299c-40f5-bf24-451ca854180a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28a5b471f39e430bb141f2b8c0cebafb', 'request_id': 'req-2157d35a-299c-40f5-bf24-451ca854180a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:07.003559 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2157d35a-299c-40f5-bf24-451ca854180a admin admin] The token cache is being invalidate because project 28a5b471f39e430bb141f2b8c0cebafb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:40:07.003739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2157d35a-299c-40f5-bf24-451ca854180a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:07.004338 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2157d35a-299c-40f5-bf24-451ca854180a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:07.009203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 850/1669] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:40:06 2022] DELETE /identity/v3/projects/28a5b471f39e430bb141f2b8c0cebafb => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:07.018552 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fdba8-decd-4d9c-948b-9addb32a856e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:07.018995 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fdba8-decd-4d9c-948b-9addb32a856e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:07.019471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fdba8-decd-4d9c-948b-9addb32a856e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:07.064931 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-706fdba8-decd-4d9c-948b-9addb32a856e None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:07.066721 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-706fdba8-decd-4d9c-948b-9addb32a856e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:07.117095 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a46f3-ffb0-429f-b9ec-a5a8f6d2491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:07.121213 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a46f3-ffb0-429f-b9ec-a5a8f6d2491c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:07.121371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:07.121501 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a46f3-ffb0-429f-b9ec-a5a8f6d2491c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:07.124052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a46f3-ffb0-429f-b9ec-a5a8f6d2491c admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:07.125895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a46f3-ffb0-429f-b9ec-a5a8f6d2491c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:07.127740 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a46f3-ffb0-429f-b9ec-a5a8f6d2491c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:07.155457 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 820/1670] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:40:07.162604 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a46f3-ffb0-429f-b9ec-a5a8f6d2491c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:07.173425 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-956a46f3-ffb0-429f-b9ec-a5a8f6d2491c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:07.189066 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 851/1671] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:07.204262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c179756-c986-4b30-b3d4-9fd4fd243908 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:07.204945 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c179756-c986-4b30-b3d4-9fd4fd243908 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:07.205508 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c179756-c986-4b30-b3d4-9fd4fd243908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:07.206252 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a46f3-ffb0-429f-b9ec-a5a8f6d2491c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:07.214180 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edcf581-7190-4c15-809b-4326906ff334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:07.215734 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcf581-7190-4c15-809b-4326906ff334 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:07.216188 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcf581-7190-4c15-809b-4326906ff334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:07.216741 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcf581-7190-4c15-809b-4326906ff334 admin admin] PATH_INFO: `/v3/projects/097806665bf24f07b1dca1d9673ff2d5/users/5202b32bb85d4f5a92e9b4d4ea6e006b/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:07.251023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edcf581-7190-4c15-809b-4326906ff334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=097806665bf24f07b1dca1d9673ff2d5, user_id=5202b32bb85d4f5a92e9b4d4ea6e006b, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:07.253885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edcf581-7190-4c15-809b-4326906ff334 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:07.262893 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-1c179756-c986-4b30-b3d4-9fd4fd243908 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:07.264859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1c179756-c986-4b30-b3d4-9fd4fd243908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:07.276462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 852/1672] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:07.280899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c179756-c986-4b30-b3d4-9fd4fd243908 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:07.283899 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 821/1673] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:40:07 2022] PUT /identity/v3/projects/097806665bf24f07b1dca1d9673ff2d5/users/5202b32bb85d4f5a92e9b4d4ea6e006b/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:07.287702 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edcf581-7190-4c15-809b-4326906ff334 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:07.295705 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c179756-c986-4b30-b3d4-9fd4fd243908 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:07.375661 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:07.456930 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b817bcf-59e1-406f-83d4-87b25cc8e557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:07.457622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b817bcf-59e1-406f-83d4-87b25cc8e557 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:07.457906 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b817bcf-59e1-406f-83d4-87b25cc8e557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:07.458184 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b817bcf-59e1-406f-83d4-87b25cc8e557 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:07.462723 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edcf581-7190-4c15-809b-4326906ff334 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:07.464328 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b817bcf-59e1-406f-83d4-87b25cc8e557 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:40:07.464794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b817bcf-59e1-406f-83d4-87b25cc8e557 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:07.466334 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b817bcf-59e1-406f-83d4-87b25cc8e557 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:07.489014 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af66e16-ea6e-4ff1-8405-65f72f082d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:07.492274 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af66e16-ea6e-4ff1-8405-65f72f082d73 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:07.492633 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af66e16-ea6e-4ff1-8405-65f72f082d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:07.492922 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af66e16-ea6e-4ff1-8405-65f72f082d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:07.493680 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af66e16-ea6e-4ff1-8405-65f72f082d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:07.503737 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af66e16-ea6e-4ff1-8405-65f72f082d73 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:07.539680 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 853/1674] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:40:07.543801 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b817bcf-59e1-406f-83d4-87b25cc8e557 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:07.550090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 822/1675] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:40:07.554539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af66e16-ea6e-4ff1-8405-65f72f082d73 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:07.566613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b817bcf-59e1-406f-83d4-87b25cc8e557 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:07.576145 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af66e16-ea6e-4ff1-8405-65f72f082d73 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:07.580708 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83217705-0a86-4b82-91ae-defb6d0bb7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:07.581400 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83217705-0a86-4b82-91ae-defb6d0bb7ba admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:07.583287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83217705-0a86-4b82-91ae-defb6d0bb7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:07.583615 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83217705-0a86-4b82-91ae-defb6d0bb7ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:07.585329 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83217705-0a86-4b82-91ae-defb6d0bb7ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:07.587518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40356736-83d7-4c7c-8389-8bae3dff6cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:07.590143 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40356736-83d7-4c7c-8389-8bae3dff6cf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:07.590433 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40356736-83d7-4c7c-8389-8bae3dff6cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:07.590714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40356736-83d7-4c7c-8389-8bae3dff6cf8 admin admin] PATH_INFO: `/v3/projects/097806665bf24f07b1dca1d9673ff2d5/users/5202b32bb85d4f5a92e9b4d4ea6e006b/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:07.591734 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83217705-0a86-4b82-91ae-defb6d0bb7ba admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:07.595618 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40356736-83d7-4c7c-8389-8bae3dff6cf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=097806665bf24f07b1dca1d9673ff2d5, user_id=5202b32bb85d4f5a92e9b4d4ea6e006b, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:07.605148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40356736-83d7-4c7c-8389-8bae3dff6cf8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:07.632993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 823/1676] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:40:07 2022] PUT /identity/v3/projects/097806665bf24f07b1dca1d9673ff2d5/users/5202b32bb85d4f5a92e9b4d4ea6e006b/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:07.650204 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5da4b-a0fa-46d4-a905-a7f9a4a209d0 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:07.650973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5da4b-a0fa-46d4-a905-a7f9a4a209d0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:07.651274 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5da4b-a0fa-46d4-a905-a7f9a4a209d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:07.682203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 854/1677] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:40:07 2022] POST /identity/v3/projects => generated 369 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:07.686373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83217705-0a86-4b82-91ae-defb6d0bb7ba admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:07.716158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b6e5da4b-a0fa-46d4-a905-a7f9a4a209d0 None None] MFA Rules not processed for user `5202b32bb85d4f5a92e9b4d4ea6e006b`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:07.717926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b6e5da4b-a0fa-46d4-a905-a7f9a4a209d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:07.841776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83217705-0a86-4b82-91ae-defb6d0bb7ba admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:07.858812 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d0f0a-f38a-4c9d-b432-cf75f757493b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:07.861305 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d0f0a-f38a-4c9d-b432-cf75f757493b admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:07.862705 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d0f0a-f38a-4c9d-b432-cf75f757493b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:07.863101 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d0f0a-f38a-4c9d-b432-cf75f757493b admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:07.866650 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d0f0a-f38a-4c9d-b432-cf75f757493b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:07.869522 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d0f0a-f38a-4c9d-b432-cf75f757493b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:07.903149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 824/1678] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:07 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:07.915749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 855/1679] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:40:07 2022] POST /identity/v3/users => generated 285 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:07.920046 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5da4b-a0fa-46d4-a905-a7f9a4a209d0 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:07.927287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d0f0a-f38a-4c9d-b432-cf75f757493b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:07.938647 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e27d0f0a-f38a-4c9d-b432-cf75f757493b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:07.965029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5da4b-a0fa-46d4-a905-a7f9a4a209d0 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:07.972887 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5ab53-70df-4077-85fe-f277777bf423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:07.973785 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5ab53-70df-4077-85fe-f277777bf423 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:07.974088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5ab53-70df-4077-85fe-f277777bf423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:07.975290 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5ab53-70df-4077-85fe-f277777bf423 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:07.976688 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5ab53-70df-4077-85fe-f277777bf423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:07.978510 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5ab53-70df-4077-85fe-f277777bf423 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:08.041282 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 825/1680] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:40:08.041282 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3afd98-d719-4f3e-ae24-e24a5357bef4 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:08.041282 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3afd98-d719-4f3e-ae24-e24a5357bef4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:08.041567 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3afd98-d719-4f3e-ae24-e24a5357bef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:08.089705 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:08.165521 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d0f0a-f38a-4c9d-b432-cf75f757493b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:08.176576 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270e5e7-72fa-4642-89b7-ff2233b08132 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:08.177322 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270e5e7-72fa-4642-89b7-ff2233b08132 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:08.177632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270e5e7-72fa-4642-89b7-ff2233b08132 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:08.177890 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270e5e7-72fa-4642-89b7-ff2233b08132 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:08.181302 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3e3afd98-d719-4f3e-ae24-e24a5357bef4 None None] MFA Rules not processed for user `6c963986b46d4d148fc843b0a1183d69`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:08.186248 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3e3afd98-d719-4f3e-ae24-e24a5357bef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:08.186530 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2270e5e7-72fa-4642-89b7-ff2233b08132 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:08.350541 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270e5e7-72fa-4642-89b7-ff2233b08132 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:08.355567 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270e5e7-72fa-4642-89b7-ff2233b08132 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:08.363695 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 826/1681] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:08.364713 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3afd98-d719-4f3e-ae24-e24a5357bef4 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:08.385685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3afd98-d719-4f3e-ae24-e24a5357bef4 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:08.401499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 856/1682] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:08.401723 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416a849-b3ca-4c96-bc1b-6f8a55a7d975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:08.402558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416a849-b3ca-4c96-bc1b-6f8a55a7d975 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:08.402842 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416a849-b3ca-4c96-bc1b-6f8a55a7d975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:08.403115 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416a849-b3ca-4c96-bc1b-6f8a55a7d975 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:08.403843 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416a849-b3ca-4c96-bc1b-6f8a55a7d975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:08.405517 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416a849-b3ca-4c96-bc1b-6f8a55a7d975 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:08.409982 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9288f4-8bd0-4921-bb72-7f249c003c24 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:08.410368 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9288f4-8bd0-4921-bb72-7f249c003c24 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:08.410666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9288f4-8bd0-4921-bb72-7f249c003c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:08.432652 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 827/1683] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:40:08.433879 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416a849-b3ca-4c96-bc1b-6f8a55a7d975 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:08.440025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9416a849-b3ca-4c96-bc1b-6f8a55a7d975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:08.461977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:08.467260 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416a849-b3ca-4c96-bc1b-6f8a55a7d975 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:08.481982 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1a404-c273-4d90-8ae8-90e4c1225775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:08.483169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1a404-c273-4d90-8ae8-90e4c1225775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:08.483647 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1a404-c273-4d90-8ae8-90e4c1225775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:08.484981 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1a404-c273-4d90-8ae8-90e4c1225775 admin admin] PATH_INFO: `/v3/projects/a3eeea32558849058212b9e4b7978856` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:08.490021 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1a404-c273-4d90-8ae8-90e4c1225775 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3eeea32558849058212b9e4b7978856)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:08.493851 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1a404-c273-4d90-8ae8-90e4c1225775 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:08.515898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0c9288f4-8bd0-4921-bb72-7f249c003c24 None None] MFA Rules not processed for user `6c963986b46d4d148fc843b0a1183d69`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:08.517273 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0c9288f4-8bd0-4921-bb72-7f249c003c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:08.537395 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 857/1684] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:08.541494 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9288f4-8bd0-4921-bb72-7f249c003c24 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:08.570620 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9288f4-8bd0-4921-bb72-7f249c003c24 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:08.578142 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fd608-e711-48cc-9b20-2188d5867486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:08.579236 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fd608-e711-48cc-9b20-2188d5867486 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:08.579525 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fd608-e711-48cc-9b20-2188d5867486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:08.579805 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fd608-e711-48cc-9b20-2188d5867486 admin admin] PATH_INFO: `/v3/projects/b805593960cf479890c4c84b3f578108/users/84cde8f68e8e404d91daf9e72bf47f33/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:08.600769 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fd608-e711-48cc-9b20-2188d5867486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b805593960cf479890c4c84b3f578108, user_id=84cde8f68e8e404d91daf9e72bf47f33, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:08.603808 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fd608-e711-48cc-9b20-2188d5867486 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:08.624176 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 858/1685] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:40:08 2022] PUT /identity/v3/projects/b805593960cf479890c4c84b3f578108/users/84cde8f68e8e404d91daf9e72bf47f33/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:08.637508 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fd608-e711-48cc-9b20-2188d5867486 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:08.639296 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4e0fd608-e711-48cc-9b20-2188d5867486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:08.639518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-47c1a404-c273-4d90-8ae8-90e4c1225775 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3eeea32558849058212b9e4b7978856', 'request_id': 'req-47c1a404-c273-4d90-8ae8-90e4c1225775'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:08.674028 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-47c1a404-c273-4d90-8ae8-90e4c1225775 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3eeea32558849058212b9e4b7978856', 'request_id': 'req-47c1a404-c273-4d90-8ae8-90e4c1225775'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:08.692228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-47c1a404-c273-4d90-8ae8-90e4c1225775 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3eeea32558849058212b9e4b7978856', 'request_id': 'req-47c1a404-c273-4d90-8ae8-90e4c1225775'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:08.742682 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-47c1a404-c273-4d90-8ae8-90e4c1225775 admin admin] The token cache is being invalidate because project a3eeea32558849058212b9e4b7978856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:40:08.744599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-47c1a404-c273-4d90-8ae8-90e4c1225775 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:08.750737 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-47c1a404-c273-4d90-8ae8-90e4c1225775 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:08.754898 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 828/1686] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:40:08 2022] DELETE /identity/v3/projects/a3eeea32558849058212b9e4b7978856 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:08.757284 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171cd731-83f1-4d00-b5f4-07d266754325 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:08.757676 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171cd731-83f1-4d00-b5f4-07d266754325 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:08.758128 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171cd731-83f1-4d00-b5f4-07d266754325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:08.853899 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-171cd731-83f1-4d00-b5f4-07d266754325 None None] MFA Rules not processed for user `84cde8f68e8e404d91daf9e72bf47f33`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:08.862106 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-171cd731-83f1-4d00-b5f4-07d266754325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:08.865839 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fd608-e711-48cc-9b20-2188d5867486 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:08.878834 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fda32-3122-455b-ab33-f31616f39ab2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:08.880749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fda32-3122-455b-ab33-f31616f39ab2 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:08.881121 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fda32-3122-455b-ab33-f31616f39ab2 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:08.881491 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fda32-3122-455b-ab33-f31616f39ab2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:08.888335 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-af6fda32-3122-455b-ab33-f31616f39ab2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:09.020050 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:09.057285 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 829/1687] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:08 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:09.063327 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7890c-f534-4c8a-b4bb-cc27ffb51d28 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:09.064897 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fda32-3122-455b-ab33-f31616f39ab2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:09.065324 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7890c-f534-4c8a-b4bb-cc27ffb51d28 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:09.067748 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fda32-3122-455b-ab33-f31616f39ab2 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:09.068172 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7890c-f534-4c8a-b4bb-cc27ffb51d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:09.111043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 859/1688] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:09.111959 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fda32-3122-455b-ab33-f31616f39ab2 service nova] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:09.121492 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-af6fda32-3122-455b-ab33-f31616f39ab2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:09.133913 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d2f7890c-f534-4c8a-b4bb-cc27ffb51d28 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:09.135147 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d2f7890c-f534-4c8a-b4bb-cc27ffb51d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:09.316761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fda32-3122-455b-ab33-f31616f39ab2 service nova] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:09.341214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d308814-8dc8-4874-9360-5eea8496b9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:09.342246 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d308814-8dc8-4874-9360-5eea8496b9a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:09.342923 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d308814-8dc8-4874-9360-5eea8496b9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:09.343472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d308814-8dc8-4874-9360-5eea8496b9a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:09.344484 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d308814-8dc8-4874-9360-5eea8496b9a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:09.346409 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 830/1689] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:09.347402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d308814-8dc8-4874-9360-5eea8496b9a2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:09.353794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf937d-01a8-4d84-94fa-f0313ea83850 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:09.354091 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf937d-01a8-4d84-94fa-f0313ea83850 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:09.354379 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf937d-01a8-4d84-94fa-f0313ea83850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:09.387586 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-55cf937d-01a8-4d84-94fa-f0313ea83850 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:09.388867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-55cf937d-01a8-4d84-94fa-f0313ea83850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:09.389953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 860/1690] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:40:09 2022] POST /identity/v3/projects => generated 369 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:09.394190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d308814-8dc8-4874-9360-5eea8496b9a2 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:09.417490 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:09.486612 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d308814-8dc8-4874-9360-5eea8496b9a2 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:09.493613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742eeab2-f60c-4b78-a3d0-691b11868323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:09.494645 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742eeab2-f60c-4b78-a3d0-691b11868323 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:09.495263 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742eeab2-f60c-4b78-a3d0-691b11868323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:09.495741 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742eeab2-f60c-4b78-a3d0-691b11868323 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:09.497093 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742eeab2-f60c-4b78-a3d0-691b11868323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:09.499812 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742eeab2-f60c-4b78-a3d0-691b11868323 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:09.511059 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 831/1691] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:09.515028 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf937d-01a8-4d84-94fa-f0313ea83850 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:09.525753 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf937d-01a8-4d84-94fa-f0313ea83850 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:09.533514 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 861/1692] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:40:09 2022] POST /identity/v3/users => generated 291 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:40:09.535001 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b30e0-278b-4080-b7a4-eaab52e126d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:09.535756 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b30e0-278b-4080-b7a4-eaab52e126d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:09.537333 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742eeab2-f60c-4b78-a3d0-691b11868323 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:09.537635 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b30e0-278b-4080-b7a4-eaab52e126d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:09.538267 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b30e0-278b-4080-b7a4-eaab52e126d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:09.539645 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b30e0-278b-4080-b7a4-eaab52e126d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:40:09.542239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b30e0-278b-4080-b7a4-eaab52e126d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:09.544031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b30e0-278b-4080-b7a4-eaab52e126d8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:09.559724 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742eeab2-f60c-4b78-a3d0-691b11868323 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:09.569811 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 832/1693] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:40:09.571265 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3cf52-7e99-4cb9-83a7-fbaf99a979e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:09.572300 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3cf52-7e99-4cb9-83a7-fbaf99a979e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:09.573433 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b30e0-278b-4080-b7a4-eaab52e126d8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:09.573797 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3cf52-7e99-4cb9-83a7-fbaf99a979e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:09.574144 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3cf52-7e99-4cb9-83a7-fbaf99a979e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:09.574895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3cf52-7e99-4cb9-83a7-fbaf99a979e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:09.576547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3cf52-7e99-4cb9-83a7-fbaf99a979e7 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:09.593098 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b30e0-278b-4080-b7a4-eaab52e126d8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:09.601118 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 862/1694] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:40:09.603590 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3cf52-7e99-4cb9-83a7-fbaf99a979e7 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:09.605031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458ad44-c7e3-4e74-842d-32a8dd8776a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:09.606144 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458ad44-c7e3-4e74-842d-32a8dd8776a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:09.606500 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458ad44-c7e3-4e74-842d-32a8dd8776a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:09.606782 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458ad44-c7e3-4e74-842d-32a8dd8776a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:09.607485 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458ad44-c7e3-4e74-842d-32a8dd8776a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:09.613976 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458ad44-c7e3-4e74-842d-32a8dd8776a8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:09.629489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3cf52-7e99-4cb9-83a7-fbaf99a979e7 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:09.646544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ce836-cfc1-4994-8b76-326e4c264296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:09.647454 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ce836-cfc1-4994-8b76-326e4c264296 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:09.647740 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ce836-cfc1-4994-8b76-326e4c264296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:09.648020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ce836-cfc1-4994-8b76-326e4c264296 admin admin] PATH_INFO: `/v3/projects/89220d89d24546038d4a40361c7120d6/users/7e88d949d22e405ea528cc04eef8f876/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:09.666208 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 833/1695] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:40:09 2022] POST /identity/v3/projects => generated 363 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:09.668995 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458ad44-c7e3-4e74-842d-32a8dd8776a8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:09.685567 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ce836-cfc1-4994-8b76-326e4c264296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89220d89d24546038d4a40361c7120d6, user_id=7e88d949d22e405ea528cc04eef8f876, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:09.690924 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ce836-cfc1-4994-8b76-326e4c264296 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:09.722869 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 863/1696] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:40:09 2022] PUT /identity/v3/projects/89220d89d24546038d4a40361c7120d6/users/7e88d949d22e405ea528cc04eef8f876/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:09.726316 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ce836-cfc1-4994-8b76-326e4c264296 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:09.815903 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:09.823937 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458ad44-c7e3-4e74-842d-32a8dd8776a8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:09.895002 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ce836-cfc1-4994-8b76-326e4c264296 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:09.906582 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7077ff-07cb-4af0-abfd-34b75c6c5f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:09.907271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7077ff-07cb-4af0-abfd-34b75c6c5f84 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:09.907559 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7077ff-07cb-4af0-abfd-34b75c6c5f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:09.907836 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7077ff-07cb-4af0-abfd-34b75c6c5f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:09.908679 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7077ff-07cb-4af0-abfd-34b75c6c5f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:09.913815 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7077ff-07cb-4af0-abfd-34b75c6c5f84 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:09.936878 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 864/1697] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:40:09.941509 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7077ff-07cb-4af0-abfd-34b75c6c5f84 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:09.962744 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d8712-5e0a-41cc-ab41-3eb136e7e451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:09.963179 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7077ff-07cb-4af0-abfd-34b75c6c5f84 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:09.963432 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d8712-5e0a-41cc-ab41-3eb136e7e451 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:09.963722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d8712-5e0a-41cc-ab41-3eb136e7e451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:09.964003 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d8712-5e0a-41cc-ab41-3eb136e7e451 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:09.964749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d8712-5e0a-41cc-ab41-3eb136e7e451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:09.968991 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d8712-5e0a-41cc-ab41-3eb136e7e451 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:09.984033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196e388-dd32-4439-9a29-00bdd8eb0b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:09.985979 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196e388-dd32-4439-9a29-00bdd8eb0b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:09.986206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196e388-dd32-4439-9a29-00bdd8eb0b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:09.986498 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196e388-dd32-4439-9a29-00bdd8eb0b6a admin admin] PATH_INFO: `/v3/projects/89220d89d24546038d4a40361c7120d6/users/7e88d949d22e405ea528cc04eef8f876/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:09.996025 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196e388-dd32-4439-9a29-00bdd8eb0b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=89220d89d24546038d4a40361c7120d6, user_id=7e88d949d22e405ea528cc04eef8f876, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:09.998982 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196e388-dd32-4439-9a29-00bdd8eb0b6a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:10.016228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 834/1698] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:40:09 2022] POST /identity/v3/users => generated 282 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:10.020443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d8712-5e0a-41cc-ab41-3eb136e7e451 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:10.035450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 865/1699] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:40:09 2022] PUT /identity/v3/projects/89220d89d24546038d4a40361c7120d6/users/7e88d949d22e405ea528cc04eef8f876/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:10.038678 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d8712-5e0a-41cc-ab41-3eb136e7e451 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:10.045660 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57c5ff-11b6-4753-94d8-19fc7bdacdef None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:10.045965 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57c5ff-11b6-4753-94d8-19fc7bdacdef None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:10.046348 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57c5ff-11b6-4753-94d8-19fc7bdacdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:10.104257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:10.113821 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-4e57c5ff-11b6-4753-94d8-19fc7bdacdef None None] MFA Rules not processed for user `7e88d949d22e405ea528cc04eef8f876`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:10.115286 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4e57c5ff-11b6-4753-94d8-19fc7bdacdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:10.245996 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2664e-4e10-4409-8282-268d36cbeb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:10.251667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2664e-4e10-4409-8282-268d36cbeb4c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:10.251939 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2664e-4e10-4409-8282-268d36cbeb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:10.252363 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2664e-4e10-4409-8282-268d36cbeb4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:10.257056 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2664e-4e10-4409-8282-268d36cbeb4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:10.263901 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2664e-4e10-4409-8282-268d36cbeb4c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:10.295086 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 866/1700] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:10 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:40:10.298169 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29c453-17a4-4b3d-9a63-5018d5fa5f0f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:10.298498 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29c453-17a4-4b3d-9a63-5018d5fa5f0f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:10.298769 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29c453-17a4-4b3d-9a63-5018d5fa5f0f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:10.308350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 867/1701] 10.222.0.59 () {54 vars in 912 bytes} [Thu Jun 30 10:40:10 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:40:10.309225 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29c453-17a4-4b3d-9a63-5018d5fa5f0f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:10.319778 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ab29c453-17a4-4b3d-9a63-5018d5fa5f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:10.321314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 835/1702] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:40:10.322809 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc58e2-4b98-4465-90f4-259fc317996b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:10.323105 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc58e2-4b98-4465-90f4-259fc317996b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:10.323385 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc58e2-4b98-4465-90f4-259fc317996b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:10.477788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-74cc58e2-4b98-4465-90f4-259fc317996b None None] MFA Rules not processed for user `fa8cb52425ba42d9ae3576e6fb18dc88`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:10.483836 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-74cc58e2-4b98-4465-90f4-259fc317996b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:10.548217 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29c453-17a4-4b3d-9a63-5018d5fa5f0f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:10.560416 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba44466-2fb0-4c55-992c-5e166e79259a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:10.561648 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba44466-2fb0-4c55-992c-5e166e79259a service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:10.561938 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba44466-2fb0-4c55-992c-5e166e79259a service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:10.563306 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba44466-2fb0-4c55-992c-5e166e79259a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:10.592220 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba44466-2fb0-4c55-992c-5e166e79259a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:10.597793 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba44466-2fb0-4c55-992c-5e166e79259a service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:10.633484 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 868/1703] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:10 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:10.651060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba44466-2fb0-4c55-992c-5e166e79259a service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:10.682400 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 836/1704] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 30 10:40:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:10.695196 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba44466-2fb0-4c55-992c-5e166e79259a service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:10.710392 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d898a23-4d9b-488d-891a-e96216e3b6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:10.711082 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d898a23-4d9b-488d-891a-e96216e3b6fd admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:10.711669 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d898a23-4d9b-488d-891a-e96216e3b6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:10.711993 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d898a23-4d9b-488d-891a-e96216e3b6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:10.715016 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d898a23-4d9b-488d-891a-e96216e3b6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:10.717252 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d898a23-4d9b-488d-891a-e96216e3b6fd admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:10.751226 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 869/1705] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:40:10.755533 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc58e2-4b98-4465-90f4-259fc317996b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:10.755958 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d898a23-4d9b-488d-891a-e96216e3b6fd admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:10.780560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc58e2-4b98-4465-90f4-259fc317996b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:10.796472 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a7769-a192-4df3-b596-5f4beaa9a39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:10.797775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d898a23-4d9b-488d-891a-e96216e3b6fd admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:10.801075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a7769-a192-4df3-b596-5f4beaa9a39a admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:10.801550 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a7769-a192-4df3-b596-5f4beaa9a39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:10.802360 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a7769-a192-4df3-b596-5f4beaa9a39a admin admin] PATH_INFO: `/v3/projects/2e03217c06e348f39b40654321568c04/users/92675635861446b2b47c70fc5bf7cc91/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:10.810098 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826cf5f2-382d-402e-87ec-a8286679f724 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:10.812214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cf5f2-382d-402e-87ec-a8286679f724 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:10.813751 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cf5f2-382d-402e-87ec-a8286679f724 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:10.816790 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cf5f2-382d-402e-87ec-a8286679f724 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:10.849621 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a7769-a192-4df3-b596-5f4beaa9a39a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e03217c06e348f39b40654321568c04, user_id=92675635861446b2b47c70fc5bf7cc91, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:10.858775 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a7769-a192-4df3-b596-5f4beaa9a39a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:10.893342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 837/1706] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:40:10 2022] PUT /identity/v3/projects/2e03217c06e348f39b40654321568c04/users/92675635861446b2b47c70fc5bf7cc91/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:10.896823 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a7769-a192-4df3-b596-5f4beaa9a39a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:10.900164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7b0a7769-a192-4df3-b596-5f4beaa9a39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:10.907824 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:10.957777 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cf5f2-382d-402e-87ec-a8286679f724 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:10.959781 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cf5f2-382d-402e-87ec-a8286679f724 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:10.972300 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 870/1707] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:10 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:10.988412 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f1f5c-1848-474f-93e7-507eb705daa8 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:10.989803 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f1f5c-1848-474f-93e7-507eb705daa8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:10.993281 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f1f5c-1848-474f-93e7-507eb705daa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:11.046289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a7769-a192-4df3-b596-5f4beaa9a39a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:11.058471 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc19da-9307-4d9d-915c-f53a9ff85196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:11.059233 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc19da-9307-4d9d-915c-f53a9ff85196 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:11.059612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc19da-9307-4d9d-915c-f53a9ff85196 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:11.059978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc19da-9307-4d9d-915c-f53a9ff85196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:11.076997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b26f1f5c-1848-474f-93e7-507eb705daa8 None None] MFA Rules not processed for user `92675635861446b2b47c70fc5bf7cc91`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:11.080273 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b26f1f5c-1848-474f-93e7-507eb705daa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:11.080761 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc19da-9307-4d9d-915c-f53a9ff85196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:11.083606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc19da-9307-4d9d-915c-f53a9ff85196 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:11.105828 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 838/1708] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:11.308685 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 871/1709] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:10 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:11.309288 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc19da-9307-4d9d-915c-f53a9ff85196 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:11.423337 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:11.542841 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc19da-9307-4d9d-915c-f53a9ff85196 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:11.551693 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170243e-a97e-4b77-b982-6c1ae253a299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:11.552778 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170243e-a97e-4b77-b982-6c1ae253a299 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:11.553223 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170243e-a97e-4b77-b982-6c1ae253a299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:11.553752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170243e-a97e-4b77-b982-6c1ae253a299 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:11.554804 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170243e-a97e-4b77-b982-6c1ae253a299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:11.557406 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170243e-a97e-4b77-b982-6c1ae253a299 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:11.611861 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 839/1710] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:40:11 2022] POST /identity/v3/projects => generated 365 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:40:11.615711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f1f5c-1848-474f-93e7-507eb705daa8 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:11.635943 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f1f5c-1848-474f-93e7-507eb705daa8 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:11.767063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde4aa5-61a4-4c07-8281-e74fc972dcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:11.767780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde4aa5-61a4-4c07-8281-e74fc972dcb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:11.768069 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde4aa5-61a4-4c07-8281-e74fc972dcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:11.768418 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde4aa5-61a4-4c07-8281-e74fc972dcb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:11.769178 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde4aa5-61a4-4c07-8281-e74fc972dcb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:11.771153 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde4aa5-61a4-4c07-8281-e74fc972dcb0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:11.829782 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 872/1711] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:40:11 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:11.831079 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170243e-a97e-4b77-b982-6c1ae253a299 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:11.861574 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170243e-a97e-4b77-b982-6c1ae253a299 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:11.881953 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d72de-5dd3-41a0-9f41-b2608986ec98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:11.882791 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d72de-5dd3-41a0-9f41-b2608986ec98 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:11.883087 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d72de-5dd3-41a0-9f41-b2608986ec98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:11.886735 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d72de-5dd3-41a0-9f41-b2608986ec98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:11.887494 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d72de-5dd3-41a0-9f41-b2608986ec98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:11.897312 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d72de-5dd3-41a0-9f41-b2608986ec98 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:11.929787 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 840/1712] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:40:11.934104 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde4aa5-61a4-4c07-8281-e74fc972dcb0 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:11.951903 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde4aa5-61a4-4c07-8281-e74fc972dcb0 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:11.966892 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b417e-c23c-4639-8bb4-7e23bce5cfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:11.974218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b417e-c23c-4639-8bb4-7e23bce5cfb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:11.975064 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b417e-c23c-4639-8bb4-7e23bce5cfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:11.975365 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b417e-c23c-4639-8bb4-7e23bce5cfb0 admin admin] PATH_INFO: `/v3/projects/32fbe6641fe943cf8c073faecf35672a/users/21e449c3e1c54c97a291416ea39ba896/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:12.019671 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b417e-c23c-4639-8bb4-7e23bce5cfb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32fbe6641fe943cf8c073faecf35672a, user_id=21e449c3e1c54c97a291416ea39ba896, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:12.023479 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b417e-c23c-4639-8bb4-7e23bce5cfb0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:12.059725 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 873/1713] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:40:11 2022] PUT /identity/v3/projects/32fbe6641fe943cf8c073faecf35672a/users/21e449c3e1c54c97a291416ea39ba896/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:12.061607 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d72de-5dd3-41a0-9f41-b2608986ec98 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:12.074019 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d72de-5dd3-41a0-9f41-b2608986ec98 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:12.244419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10fb8b-9237-4afe-b32c-f1ad0c713d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:12.245394 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10fb8b-9237-4afe-b32c-f1ad0c713d8c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:12.245843 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10fb8b-9237-4afe-b32c-f1ad0c713d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:12.246274 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10fb8b-9237-4afe-b32c-f1ad0c713d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:12.247171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10fb8b-9237-4afe-b32c-f1ad0c713d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:12.249010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10fb8b-9237-4afe-b32c-f1ad0c713d8c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:12.280268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b417e-c23c-4639-8bb4-7e23bce5cfb0 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:12.287026 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 841/1714] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:40:12.295101 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b417e-c23c-4639-8bb4-7e23bce5cfb0 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:12.321907 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584c17f-e2f6-45ae-b2d7-430cc28c7edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:12.322949 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584c17f-e2f6-45ae-b2d7-430cc28c7edd admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:12.323331 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584c17f-e2f6-45ae-b2d7-430cc28c7edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:12.323707 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584c17f-e2f6-45ae-b2d7-430cc28c7edd admin admin] PATH_INFO: `/v3/projects/32fbe6641fe943cf8c073faecf35672a/users/21e449c3e1c54c97a291416ea39ba896/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:12.327133 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584c17f-e2f6-45ae-b2d7-430cc28c7edd admin admin] RBAC: Authorizing `identity:create_grant(project_id=32fbe6641fe943cf8c073faecf35672a, user_id=21e449c3e1c54c97a291416ea39ba896, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:12.330088 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584c17f-e2f6-45ae-b2d7-430cc28c7edd admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:12.383476 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 874/1715] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:40:12 2022] PUT /identity/v3/projects/32fbe6641fe943cf8c073faecf35672a/users/21e449c3e1c54c97a291416ea39ba896/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:40:12.386602 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71f0c0-e0f3-43e5-9e94-76721f727d77 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:12.387162 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71f0c0-e0f3-43e5-9e94-76721f727d77 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:12.387610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71f0c0-e0f3-43e5-9e94-76721f727d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:12.453057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9c71f0c0-e0f3-43e5-9e94-76721f727d77 None None] MFA Rules not processed for user `21e449c3e1c54c97a291416ea39ba896`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:12.459788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9c71f0c0-e0f3-43e5-9e94-76721f727d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:12.637927 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 842/1716] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:12 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:12.652673 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584c17f-e2f6-45ae-b2d7-430cc28c7edd admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:12.671398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:12.781319 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584c17f-e2f6-45ae-b2d7-430cc28c7edd admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:12.798216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8402c76-8a1e-450a-961c-da1194e5b44a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:12.798488 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8402c76-8a1e-450a-961c-da1194e5b44a service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:12.798784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8402c76-8a1e-450a-961c-da1194e5b44a service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:12.799066 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8402c76-8a1e-450a-961c-da1194e5b44a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:12.814476 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8402c76-8a1e-450a-961c-da1194e5b44a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:12.816664 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8402c76-8a1e-450a-961c-da1194e5b44a service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:12.842543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 875/1717] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:12 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:12.970381 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0b18e-3fd5-4162-913c-e33ccc443f86 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:12.970826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0b18e-3fd5-4162-913c-e33ccc443f86 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:12.971214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0b18e-3fd5-4162-913c-e33ccc443f86 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:12.973314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 843/1718] 10.222.0.59 () {54 vars in 960 bytes} [Thu Jun 30 10:40:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:40:12.979407 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015850c6-3574-4bf1-a2dc-5aff2b3f1eb1 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:12.979943 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015850c6-3574-4bf1-a2dc-5aff2b3f1eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:12.980222 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015850c6-3574-4bf1-a2dc-5aff2b3f1eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:13.031306 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0b18e-3fd5-4162-913c-e33ccc443f86 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:13.051979 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-015850c6-3574-4bf1-a2dc-5aff2b3f1eb1 None None] MFA Rules not processed for user `48709a771ab64ed38018873313f37c84`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:13.053264 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-015850c6-3574-4bf1-a2dc-5aff2b3f1eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:13.054344 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0b18e-3fd5-4162-913c-e33ccc443f86 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:13.061265 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3d6fe-603f-4505-ab5c-1569bbd8a32c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:13.063648 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3d6fe-603f-4505-ab5c-1569bbd8a32c service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:13.063943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3d6fe-603f-4505-ab5c-1569bbd8a32c service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:13.064223 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3d6fe-603f-4505-ab5c-1569bbd8a32c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:13.116892 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:13.197358 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3d6fe-603f-4505-ab5c-1569bbd8a32c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:13.199392 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3d6fe-603f-4505-ab5c-1569bbd8a32c service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:13.206542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 876/1719] 10.222.0.59 () {58 vars in 1057 bytes} [Thu Jun 30 10:40:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:13.215053 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c791a7-0673-4982-ac0b-574fa82927f4 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:13.215347 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c791a7-0673-4982-ac0b-574fa82927f4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:13.215637 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c791a7-0673-4982-ac0b-574fa82927f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:13.228200 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 844/1720] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:13 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:13.246987 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3d6fe-603f-4505-ab5c-1569bbd8a32c service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:13.253967 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-60c791a7-0673-4982-ac0b-574fa82927f4 None None] MFA Rules not processed for user `6c963986b46d4d148fc843b0a1183d69`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:13.255238 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-60c791a7-0673-4982-ac0b-574fa82927f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:13.290349 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3d6fe-603f-4505-ab5c-1569bbd8a32c service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:13.310473 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9df81-8e75-4fe1-8409-cc28977041f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48709a771ab64ed38018873313f37c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:13.311431 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9df81-8e75-4fe1-8409-cc28977041f1 service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:13.315189 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9df81-8e75-4fe1-8409-cc28977041f1 service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:13.315666 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9df81-8e75-4fe1-8409-cc28977041f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:13.317976 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0bf9df81-8e75-4fe1-8409-cc28977041f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:13.360958 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9df81-8e75-4fe1-8409-cc28977041f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:13.363682 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9df81-8e75-4fe1-8409-cc28977041f1 service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:13.381354 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 877/1721] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:13.382645 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35897e1b-398d-4392-83e0-5f4c645bf5ff None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:13.382967 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35897e1b-398d-4392-83e0-5f4c645bf5ff None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:13.383248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35897e1b-398d-4392-83e0-5f4c645bf5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:13.400711 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 845/1722] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:13.530624 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f18b81-04fd-4e7e-97dd-daf0c32139de None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:13.530919 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f18b81-04fd-4e7e-97dd-daf0c32139de None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:13.531232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f18b81-04fd-4e7e-97dd-daf0c32139de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:13.537858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-35897e1b-398d-4392-83e0-5f4c645bf5ff None None] MFA Rules not processed for user `9ad75a8b887a4a40accb49603f03c8ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:13.540647 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-35897e1b-398d-4392-83e0-5f4c645bf5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:13.602295 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c6f18b81-04fd-4e7e-97dd-daf0c32139de None None] MFA Rules not processed for user `131fb3808ea341618e17256b43862937`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:13.603716 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c6f18b81-04fd-4e7e-97dd-daf0c32139de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:13.746375 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:13.869323 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 878/1723] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:13.870811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2985e8-9a03-4168-999e-c4b4ac48f03c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:13.871133 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2985e8-9a03-4168-999e-c4b4ac48f03c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:13.871422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2985e8-9a03-4168-999e-c4b4ac48f03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:13.924680 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 846/1724] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:40:13.932763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f18b81-04fd-4e7e-97dd-daf0c32139de None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:13.934322 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c6f18b81-04fd-4e7e-97dd-daf0c32139de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:13.962037 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-cd2985e8-9a03-4168-999e-c4b4ac48f03c None None] MFA Rules not processed for user `9ad75a8b887a4a40accb49603f03c8ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:13.976328 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-cd2985e8-9a03-4168-999e-c4b4ac48f03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:14.020344 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 879/1725] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:14.181103 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f18b81-04fd-4e7e-97dd-daf0c32139de None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:14.189215 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445c83c-dcb0-413a-bd24-de7daf8a86c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:14.202119 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445c83c-dcb0-413a-bd24-de7daf8a86c9 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:14.202528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445c83c-dcb0-413a-bd24-de7daf8a86c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:14.206724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445c83c-dcb0-413a-bd24-de7daf8a86c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:14.246868 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445c83c-dcb0-413a-bd24-de7daf8a86c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:14.249286 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445c83c-dcb0-413a-bd24-de7daf8a86c9 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:14.308893 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 847/1726] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:40:14.440106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72cbef-a171-40ff-9e34-3f7ac1e959be None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:14.440425 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72cbef-a171-40ff-9e34-3f7ac1e959be None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:14.440731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72cbef-a171-40ff-9e34-3f7ac1e959be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:14.521134 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8f72cbef-a171-40ff-9e34-3f7ac1e959be None None] MFA Rules not processed for user `f5003e984d58440a80d98405d187eab0`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:14.534594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8f72cbef-a171-40ff-9e34-3f7ac1e959be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:14.596737 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445c83c-dcb0-413a-bd24-de7daf8a86c9 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:14.615344 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445c83c-dcb0-413a-bd24-de7daf8a86c9 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:14.653655 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b9f0a-0404-4614-be03-7667459cd109 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:14.654341 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b9f0a-0404-4614-be03-7667459cd109 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:14.654627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b9f0a-0404-4614-be03-7667459cd109 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:14.654925 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b9f0a-0404-4614-be03-7667459cd109 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:14.692026 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b9f0a-0404-4614-be03-7667459cd109 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:14.693699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b9f0a-0404-4614-be03-7667459cd109 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:14.738836 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 848/1727] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:14.823746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 880/1728] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:16.290063 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda8657-38ac-4f4f-a30a-fa75fa3a6412 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:16.290563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda8657-38ac-4f4f-a30a-fa75fa3a6412 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:16.290655 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda8657-38ac-4f4f-a30a-fa75fa3a6412 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:16.292075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 849/1729] 10.222.0.59 () {54 vars in 912 bytes} [Thu Jun 30 10:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:40:16.305106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0db70-7080-4a58-8dda-1a0cd9c3b122 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:16.305106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0db70-7080-4a58-8dda-1a0cd9c3b122 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:16.305572 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0db70-7080-4a58-8dda-1a0cd9c3b122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:16.342006 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-afe0db70-7080-4a58-8dda-1a0cd9c3b122 None None] MFA Rules not processed for user `fa8cb52425ba42d9ae3576e6fb18dc88`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:16.343141 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-afe0db70-7080-4a58-8dda-1a0cd9c3b122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:16.475780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 881/1730] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 30 10:40:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:40:16.551633 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda8657-38ac-4f4f-a30a-fa75fa3a6412 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:16.583685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda8657-38ac-4f4f-a30a-fa75fa3a6412 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:16.597331 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad7e54-0802-4814-95d6-4365c9be59b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:16.599195 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad7e54-0802-4814-95d6-4365c9be59b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:16.605272 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad7e54-0802-4814-95d6-4365c9be59b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:16.607853 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad7e54-0802-4814-95d6-4365c9be59b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:16.628748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad7e54-0802-4814-95d6-4365c9be59b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:16.630411 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad7e54-0802-4814-95d6-4365c9be59b3 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:16.641891 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:16.652458 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 850/1731] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:16.782937 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0db70-7080-4a58-8dda-1a0cd9c3b122 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:16.784370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-afe0db70-7080-4a58-8dda-1a0cd9c3b122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:16.820130 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0db70-7080-4a58-8dda-1a0cd9c3b122 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:16.835003 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67994f72-71dc-45f4-9a72-03458a487ab6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:16.835664 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67994f72-71dc-45f4-9a72-03458a487ab6 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:16.836114 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67994f72-71dc-45f4-9a72-03458a487ab6 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:16.836563 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67994f72-71dc-45f4-9a72-03458a487ab6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:16.862088 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67994f72-71dc-45f4-9a72-03458a487ab6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:16.863958 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67994f72-71dc-45f4-9a72-03458a487ab6 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:16.897084 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 882/1732] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:17.082873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad7e54-0802-4814-95d6-4365c9be59b3 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:17.273555 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad7e54-0802-4814-95d6-4365c9be59b3 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:17.286910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11daa0e8-2584-4a1a-84ff-bf6ff822c842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:17.292535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11daa0e8-2584-4a1a-84ff-bf6ff822c842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:17.293182 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11daa0e8-2584-4a1a-84ff-bf6ff822c842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:17.294633 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11daa0e8-2584-4a1a-84ff-bf6ff822c842 admin admin] PATH_INFO: `/v3/users/84cde8f68e8e404d91daf9e72bf47f33` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:17.297317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11daa0e8-2584-4a1a-84ff-bf6ff822c842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84cde8f68e8e404d91daf9e72bf47f33)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:17.302797 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11daa0e8-2584-4a1a-84ff-bf6ff822c842 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:17.473235 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-11daa0e8-2584-4a1a-84ff-bf6ff822c842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84cde8f68e8e404d91daf9e72bf47f33'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:17.474854 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-11daa0e8-2584-4a1a-84ff-bf6ff822c842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84cde8f68e8e404d91daf9e72bf47f33'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:17.506070 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-11daa0e8-2584-4a1a-84ff-bf6ff822c842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84cde8f68e8e404d91daf9e72bf47f33'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:17.507039 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-11daa0e8-2584-4a1a-84ff-bf6ff822c842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84cde8f68e8e404d91daf9e72bf47f33'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:17.554262 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-11daa0e8-2584-4a1a-84ff-bf6ff822c842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84cde8f68e8e404d91daf9e72bf47f33'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:17.606765 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 851/1733] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:40:17 2022] DELETE /identity/v3/users/84cde8f68e8e404d91daf9e72bf47f33 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:17.612406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693af0d8-0d8b-4671-9df6-e05e5ea1c9fe None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:17.613430 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693af0d8-0d8b-4671-9df6-e05e5ea1c9fe None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:17.614014 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693af0d8-0d8b-4671-9df6-e05e5ea1c9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:17.620888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11daa0e8-2584-4a1a-84ff-bf6ff822c842 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:17.622265 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-11daa0e8-2584-4a1a-84ff-bf6ff822c842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:17.670356 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-693af0d8-0d8b-4671-9df6-e05e5ea1c9fe None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:17.676811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-693af0d8-0d8b-4671-9df6-e05e5ea1c9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:17.856314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11daa0e8-2584-4a1a-84ff-bf6ff822c842 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:17.868960 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 883/1734] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:17.894934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf8546-5d86-428d-835d-9228805ad430 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:17.895626 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf8546-5d86-428d-835d-9228805ad430 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:17.895909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf8546-5d86-428d-835d-9228805ad430 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:17.896183 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf8546-5d86-428d-835d-9228805ad430 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:17.900549 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693af0d8-0d8b-4671-9df6-e05e5ea1c9fe None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:17.902114 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-693af0d8-0d8b-4671-9df6-e05e5ea1c9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:17.909398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:17.912165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8dbf8546-5d86-428d-835d-9228805ad430 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:18.101920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:18.164824 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693af0d8-0d8b-4671-9df6-e05e5ea1c9fe None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:18.181956 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fe549-5ccf-4fc5-a255-3311e1aae794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:18.188085 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fe549-5ccf-4fc5-a255-3311e1aae794 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:18.188566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fe549-5ccf-4fc5-a255-3311e1aae794 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:18.191766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fe549-5ccf-4fc5-a255-3311e1aae794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:18.205128 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf8546-5d86-428d-835d-9228805ad430 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:18.206651 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf8546-5d86-428d-835d-9228805ad430 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:18.229890 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fe549-5ccf-4fc5-a255-3311e1aae794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:18.231324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fe549-5ccf-4fc5-a255-3311e1aae794 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:18.290363 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 852/1735] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:18.296080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 884/1736] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:40:18.617319 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2690e-9658-4266-9a7f-5a1b2755204e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:18.617935 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2690e-9658-4266-9a7f-5a1b2755204e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:18.618330 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2690e-9658-4266-9a7f-5a1b2755204e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:18.714682 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-10d2690e-9658-4266-9a7f-5a1b2755204e None None] MFA Rules not processed for user `d6a194d68415422fbc6ca75a8dbccf22`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:18.717961 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-10d2690e-9658-4266-9a7f-5a1b2755204e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:18.800529 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4e432-0c35-4c09-8e3c-0a33de11bd8a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:18.801456 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4e432-0c35-4c09-8e3c-0a33de11bd8a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:18.801920 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4e432-0c35-4c09-8e3c-0a33de11bd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:18.863005 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-58c4e432-0c35-4c09-8e3c-0a33de11bd8a None None] MFA Rules not processed for user `a2bd48e6390241448fe2cf098ab64df3`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:18.866911 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-58c4e432-0c35-4c09-8e3c-0a33de11bd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:19.009028 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 853/1737] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:19.025329 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2690e-9658-4266-9a7f-5a1b2755204e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:19.027349 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-10d2690e-9658-4266-9a7f-5a1b2755204e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:19.127293 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 885/1738] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 30 10:40:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:19.385024 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2690e-9658-4266-9a7f-5a1b2755204e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:19.416287 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1deda0c-414c-4a26-a2ee-735888ccedb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:19.417516 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1deda0c-414c-4a26-a2ee-735888ccedb8 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:19.418308 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1deda0c-414c-4a26-a2ee-735888ccedb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:19.420252 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1deda0c-414c-4a26-a2ee-735888ccedb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:19.429644 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4e432-0c35-4c09-8e3c-0a33de11bd8a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:19.438731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-58c4e432-0c35-4c09-8e3c-0a33de11bd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:19.449961 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1deda0c-414c-4a26-a2ee-735888ccedb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:19.460156 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1deda0c-414c-4a26-a2ee-735888ccedb8 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:19.499312 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 854/1739] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:40:19.719997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4e432-0c35-4c09-8e3c-0a33de11bd8a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:19.741980 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2293f-677e-4418-a22c-6e932662fe53 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c15327c36c8c49ac87a3b3e9ab49eea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:19.742661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2293f-677e-4418-a22c-6e932662fe53 service swift] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:19.742946 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2293f-677e-4418-a22c-6e932662fe53 service swift] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:19.743223 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2293f-677e-4418-a22c-6e932662fe53 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:19.773976 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2293f-677e-4418-a22c-6e932662fe53 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:19.780872 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2293f-677e-4418-a22c-6e932662fe53 service swift] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:19.807528 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 886/1740] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 30 10:40:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:40:21.368067 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1deda0c-414c-4a26-a2ee-735888ccedb8 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:21.376633 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a1deda0c-414c-4a26-a2ee-735888ccedb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:21.415754 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1deda0c-414c-4a26-a2ee-735888ccedb8 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:21.446035 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417b4b8-df88-4691-98a1-419deda64196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:21.447441 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417b4b8-df88-4691-98a1-419deda64196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:21.447841 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417b4b8-df88-4691-98a1-419deda64196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:21.448219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417b4b8-df88-4691-98a1-419deda64196 admin admin] PATH_INFO: `/v3/projects/b805593960cf479890c4c84b3f578108` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:21.449829 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417b4b8-df88-4691-98a1-419deda64196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b805593960cf479890c4c84b3f578108)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:21.452609 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417b4b8-df88-4691-98a1-419deda64196 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:21.573612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:21.592442 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c417b4b8-df88-4691-98a1-419deda64196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b805593960cf479890c4c84b3f578108', 'request_id': 'req-c417b4b8-df88-4691-98a1-419deda64196'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:21.615529 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c417b4b8-df88-4691-98a1-419deda64196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b805593960cf479890c4c84b3f578108', 'request_id': 'req-c417b4b8-df88-4691-98a1-419deda64196'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:21.627365 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c417b4b8-df88-4691-98a1-419deda64196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b805593960cf479890c4c84b3f578108', 'request_id': 'req-c417b4b8-df88-4691-98a1-419deda64196'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:21.655608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097826d-6f0a-4d92-87b7-7b0cd2a7e6ad None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:21.656184 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097826d-6f0a-4d92-87b7-7b0cd2a7e6ad None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:21.656471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097826d-6f0a-4d92-87b7-7b0cd2a7e6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:21.665295 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c417b4b8-df88-4691-98a1-419deda64196 admin admin] The token cache is being invalidate because project b805593960cf479890c4c84b3f578108 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:40:21.665886 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c417b4b8-df88-4691-98a1-419deda64196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:21.666716 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c417b4b8-df88-4691-98a1-419deda64196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:21.671565 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 855/1741] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:40:21 2022] DELETE /identity/v3/projects/b805593960cf479890c4c84b3f578108 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:21.673235 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417b4b8-df88-4691-98a1-419deda64196 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:21.675328 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c417b4b8-df88-4691-98a1-419deda64196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:21.705410 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9097826d-6f0a-4d92-87b7-7b0cd2a7e6ad None None] MFA Rules not processed for user `131fb3808ea341618e17256b43862937`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:21.705410 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9097826d-6f0a-4d92-87b7-7b0cd2a7e6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:21.798078 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417b4b8-df88-4691-98a1-419deda64196 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:21.803696 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fc9a8-f1cf-43b2-9287-09c02b5849cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:21.804856 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fc9a8-f1cf-43b2-9287-09c02b5849cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:21.805175 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fc9a8-f1cf-43b2-9287-09c02b5849cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:21.806813 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fc9a8-f1cf-43b2-9287-09c02b5849cf admin admin] PATH_INFO: `/v3/users/7e88d949d22e405ea528cc04eef8f876` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:21.811831 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:21.821088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fc9a8-f1cf-43b2-9287-09c02b5849cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e88d949d22e405ea528cc04eef8f876)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:21.823435 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fc9a8-f1cf-43b2-9287-09c02b5849cf admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:21.868549 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 887/1742] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:21.973442 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9b7fc9a8-f1cf-43b2-9287-09c02b5849cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e88d949d22e405ea528cc04eef8f876'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:21.976942 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9b7fc9a8-f1cf-43b2-9287-09c02b5849cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e88d949d22e405ea528cc04eef8f876'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:21.990003 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9b7fc9a8-f1cf-43b2-9287-09c02b5849cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e88d949d22e405ea528cc04eef8f876'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:21.991477 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9b7fc9a8-f1cf-43b2-9287-09c02b5849cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e88d949d22e405ea528cc04eef8f876'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:22.021413 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9b7fc9a8-f1cf-43b2-9287-09c02b5849cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e88d949d22e405ea528cc04eef8f876'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:22.053198 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 856/1743] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:40:21 2022] DELETE /identity/v3/users/7e88d949d22e405ea528cc04eef8f876 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:23.340458 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82197363-06c6-4b05-b4ae-6ad89fc03210 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:23.341313 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82197363-06c6-4b05-b4ae-6ad89fc03210 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:23.341809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82197363-06c6-4b05-b4ae-6ad89fc03210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:23.367488 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-82197363-06c6-4b05-b4ae-6ad89fc03210 None None] MFA Rules not processed for user `f5003e984d58440a80d98405d187eab0`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:23.369166 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-82197363-06c6-4b05-b4ae-6ad89fc03210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:23.458316 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 888/1744] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:23.705667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647380a-443b-44cf-b922-13938b70f430 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:23.706170 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647380a-443b-44cf-b922-13938b70f430 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:23.706364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647380a-443b-44cf-b922-13938b70f430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:23.773031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8647380a-443b-44cf-b922-13938b70f430 None None] MFA Rules not processed for user `d6a194d68415422fbc6ca75a8dbccf22`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:23.782395 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8647380a-443b-44cf-b922-13938b70f430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:23.787606 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622a0b5-e240-4fc0-a9d1-23c8035598c2 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:23.788192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622a0b5-e240-4fc0-a9d1-23c8035598c2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:23.788651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622a0b5-e240-4fc0-a9d1-23c8035598c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:23.844092 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a622a0b5-e240-4fc0-a9d1-23c8035598c2 None None] MFA Rules not processed for user `fa8cb52425ba42d9ae3576e6fb18dc88`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:23.858149 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a622a0b5-e240-4fc0-a9d1-23c8035598c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:23.969727 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:24.002924 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 857/1745] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:24.025028 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647380a-443b-44cf-b922-13938b70f430 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:24.033663 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8647380a-443b-44cf-b922-13938b70f430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:24.057453 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 889/1746] 10.222.0.61 () {58 vars in 1015 bytes} [Thu Jun 30 10:40:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:24.240469 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647380a-443b-44cf-b922-13938b70f430 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:24.249977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6db62-42e1-475c-9e6a-41d0ea631147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:24.251059 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6db62-42e1-475c-9e6a-41d0ea631147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:24.251376 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6db62-42e1-475c-9e6a-41d0ea631147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:24.251746 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6db62-42e1-475c-9e6a-41d0ea631147 admin admin] PATH_INFO: `/v3/projects/89220d89d24546038d4a40361c7120d6` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:24.274065 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6db62-42e1-475c-9e6a-41d0ea631147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89220d89d24546038d4a40361c7120d6)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:24.276474 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6db62-42e1-475c-9e6a-41d0ea631147 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:24.372360 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f7b6db62-42e1-475c-9e6a-41d0ea631147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89220d89d24546038d4a40361c7120d6', 'request_id': 'req-f7b6db62-42e1-475c-9e6a-41d0ea631147'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:24.384365 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f7b6db62-42e1-475c-9e6a-41d0ea631147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89220d89d24546038d4a40361c7120d6', 'request_id': 'req-f7b6db62-42e1-475c-9e6a-41d0ea631147'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:24.393863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f7b6db62-42e1-475c-9e6a-41d0ea631147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89220d89d24546038d4a40361c7120d6', 'request_id': 'req-f7b6db62-42e1-475c-9e6a-41d0ea631147'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:24.451929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f7b6db62-42e1-475c-9e6a-41d0ea631147 admin admin] The token cache is being invalidate because project 89220d89d24546038d4a40361c7120d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:40:24.451929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f7b6db62-42e1-475c-9e6a-41d0ea631147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:24.451929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f7b6db62-42e1-475c-9e6a-41d0ea631147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:24.456829 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 858/1747] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:40:24 2022] DELETE /identity/v3/projects/89220d89d24546038d4a40361c7120d6 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:24.461265 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a32c1-0e3a-4b0e-95ef-f3d05be5f1a8 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:24.462104 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a32c1-0e3a-4b0e-95ef-f3d05be5f1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:24.462524 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a32c1-0e3a-4b0e-95ef-f3d05be5f1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:24.497393 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9e9a32c1-0e3a-4b0e-95ef-f3d05be5f1a8 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:24.501895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9e9a32c1-0e3a-4b0e-95ef-f3d05be5f1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:24.694043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 890/1748] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:24.702706 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b6b99-1a14-4ced-9220-07c42cc93eaf None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:24.703598 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b6b99-1a14-4ced-9220-07c42cc93eaf None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:24.704032 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b6b99-1a14-4ced-9220-07c42cc93eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:24.809118 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-979b6b99-1a14-4ced-9220-07c42cc93eaf None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:24.815904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-979b6b99-1a14-4ced-9220-07c42cc93eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:24.856241 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 859/1749] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:24.858241 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a32c1-0e3a-4b0e-95ef-f3d05be5f1a8 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:24.874391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a32c1-0e3a-4b0e-95ef-f3d05be5f1a8 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:24.898903 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f09ec0-3964-43a5-92ac-48090b888f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:24.900030 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f09ec0-3964-43a5-92ac-48090b888f1a admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:24.900631 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f09ec0-3964-43a5-92ac-48090b888f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:24.902104 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f09ec0-3964-43a5-92ac-48090b888f1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:24.903161 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f09ec0-3964-43a5-92ac-48090b888f1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:40:24.908359 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f09ec0-3964-43a5-92ac-48090b888f1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:24.910445 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f09ec0-3964-43a5-92ac-48090b888f1a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:24.967086 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 891/1750] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:40:24.967468 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b6b99-1a14-4ced-9220-07c42cc93eaf None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:24.997750 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b6b99-1a14-4ced-9220-07c42cc93eaf None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:25.033490 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd8f59-675c-40b4-acab-ebe29a876a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:25.034185 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd8f59-675c-40b4-acab-ebe29a876a91 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:25.034471 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd8f59-675c-40b4-acab-ebe29a876a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:25.034750 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd8f59-675c-40b4-acab-ebe29a876a91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:25.035518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd8f59-675c-40b4-acab-ebe29a876a91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:25.047610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd8f59-675c-40b4-acab-ebe29a876a91 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:25.193721 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 860/1751] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:40:24 2022] POST /identity/v3/projects => generated 379 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:25.194483 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f09ec0-3964-43a5-92ac-48090b888f1a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:25.210622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f09ec0-3964-43a5-92ac-48090b888f1a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:25.282789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:25.380192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15f2eb-9b16-4e7d-8e5a-425a4408aa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:25.381365 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15f2eb-9b16-4e7d-8e5a-425a4408aa1f admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:25.382047 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15f2eb-9b16-4e7d-8e5a-425a4408aa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:25.382664 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15f2eb-9b16-4e7d-8e5a-425a4408aa1f admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:25.383857 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15f2eb-9b16-4e7d-8e5a-425a4408aa1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:25.386776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15f2eb-9b16-4e7d-8e5a-425a4408aa1f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:25.425064 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 892/1752] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:40:25 2022] POST /identity/v3/users => generated 290 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:25.429039 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd8f59-675c-40b4-acab-ebe29a876a91 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:25.445386 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd8f59-675c-40b4-acab-ebe29a876a91 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:25.460175 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e99753-9409-4da7-835b-7439517e2917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:25.461362 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e99753-9409-4da7-835b-7439517e2917 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:25.463571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e99753-9409-4da7-835b-7439517e2917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:25.463866 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e99753-9409-4da7-835b-7439517e2917 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:25.465803 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e99753-9409-4da7-835b-7439517e2917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:25.469997 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e99753-9409-4da7-835b-7439517e2917 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:25.501398 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 861/1753] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:40:25.505727 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15f2eb-9b16-4e7d-8e5a-425a4408aa1f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:25.525687 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15f2eb-9b16-4e7d-8e5a-425a4408aa1f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:25.540201 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abf76d-fee9-4352-b140-50742fe633e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:25.541831 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abf76d-fee9-4352-b140-50742fe633e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:25.542125 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abf76d-fee9-4352-b140-50742fe633e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:25.544550 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abf76d-fee9-4352-b140-50742fe633e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:25.545460 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abf76d-fee9-4352-b140-50742fe633e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:25.549245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abf76d-fee9-4352-b140-50742fe633e6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:25.581692 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 893/1754] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:40:25.582564 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e99753-9409-4da7-835b-7439517e2917 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:25.606101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e99753-9409-4da7-835b-7439517e2917 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:25.631303 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884b0f7-8a3b-44d0-ac20-ca7e92f6a59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:25.632219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884b0f7-8a3b-44d0-ac20-ca7e92f6a59d admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:25.632555 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884b0f7-8a3b-44d0-ac20-ca7e92f6a59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:25.633848 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884b0f7-8a3b-44d0-ac20-ca7e92f6a59d admin admin] PATH_INFO: `/v3/projects/6903d84e0ae140ef804ff010ebd1634d/users/2882b768196e4575a21f61bc3a12b0c5/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:25.681308 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9884b0f7-8a3b-44d0-ac20-ca7e92f6a59d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6903d84e0ae140ef804ff010ebd1634d, user_id=2882b768196e4575a21f61bc3a12b0c5, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:25.685708 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9884b0f7-8a3b-44d0-ac20-ca7e92f6a59d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:25.723069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 862/1755] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:40:25 2022] PUT /identity/v3/projects/6903d84e0ae140ef804ff010ebd1634d/users/2882b768196e4575a21f61bc3a12b0c5/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:25.733867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5ea4b-6753-428c-bcfa-2b8c15491f65 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:25.734212 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5ea4b-6753-428c-bcfa-2b8c15491f65 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:25.734509 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5ea4b-6753-428c-bcfa-2b8c15491f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:25.807531 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b7d5ea4b-6753-428c-bcfa-2b8c15491f65 None None] MFA Rules not processed for user `2882b768196e4575a21f61bc3a12b0c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:25.813429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b7d5ea4b-6753-428c-bcfa-2b8c15491f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:25.950240 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 894/1756] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:25.956001 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884b0f7-8a3b-44d0-ac20-ca7e92f6a59d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:26.003269 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:26.130854 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884b0f7-8a3b-44d0-ac20-ca7e92f6a59d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:26.154033 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5300bd-a0fd-4421-8a6f-17cf06486e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:26.154727 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5300bd-a0fd-4421-8a6f-17cf06486e6b admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:26.157411 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5300bd-a0fd-4421-8a6f-17cf06486e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:26.157731 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5300bd-a0fd-4421-8a6f-17cf06486e6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:26.158453 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5300bd-a0fd-4421-8a6f-17cf06486e6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:26.181081 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5300bd-a0fd-4421-8a6f-17cf06486e6b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:26.257319 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 863/1757] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:40:25 2022] POST /identity/v3/projects => generated 377 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:26.262400 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5ea4b-6753-428c-bcfa-2b8c15491f65 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:26.306660 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5ea4b-6753-428c-bcfa-2b8c15491f65 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:26.612315 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2377b9-cbc8-45b6-a76b-63c36b8dd808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:26.614914 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2377b9-cbc8-45b6-a76b-63c36b8dd808 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:26.615354 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2377b9-cbc8-45b6-a76b-63c36b8dd808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:26.615934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2377b9-cbc8-45b6-a76b-63c36b8dd808 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:26.617183 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2377b9-cbc8-45b6-a76b-63c36b8dd808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:26.620084 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2377b9-cbc8-45b6-a76b-63c36b8dd808 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:26.668282 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 895/1758] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:40:26 2022] POST /identity/v3/users => generated 289 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:26.670371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5300bd-a0fd-4421-8a6f-17cf06486e6b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:26.687007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2377b9-cbc8-45b6-a76b-63c36b8dd808 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:26.689749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4b2377b9-cbc8-45b6-a76b-63c36b8dd808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:26.737120 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5300bd-a0fd-4421-8a6f-17cf06486e6b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:26.798040 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e5b85-35f4-4ab0-98fe-29310f51d15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:26.798780 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e5b85-35f4-4ab0-98fe-29310f51d15d admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:26.799862 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e5b85-35f4-4ab0-98fe-29310f51d15d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:26.802126 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e5b85-35f4-4ab0-98fe-29310f51d15d admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:26.802126 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e5b85-35f4-4ab0-98fe-29310f51d15d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:26.831191 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e5b85-35f4-4ab0-98fe-29310f51d15d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:26.922873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 864/1759] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:40:26.924004 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e5b85-35f4-4ab0-98fe-29310f51d15d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:26.980876 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e5b85-35f4-4ab0-98fe-29310f51d15d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:27.021066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419670e-1975-4155-a2ff-43fbe4990804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:27.021066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419670e-1975-4155-a2ff-43fbe4990804 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:27.021066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419670e-1975-4155-a2ff-43fbe4990804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:27.021066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419670e-1975-4155-a2ff-43fbe4990804 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:27.021520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419670e-1975-4155-a2ff-43fbe4990804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:27.025728 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419670e-1975-4155-a2ff-43fbe4990804 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:27.073573 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 865/1760] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:40:27.077532 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419670e-1975-4155-a2ff-43fbe4990804 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:27.113084 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:27.128851 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419670e-1975-4155-a2ff-43fbe4990804 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:27.142661 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f01b02-5754-41d3-8355-5ec5ae8fbdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:27.143554 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f01b02-5754-41d3-8355-5ec5ae8fbdd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:27.143837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f01b02-5754-41d3-8355-5ec5ae8fbdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:27.144115 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f01b02-5754-41d3-8355-5ec5ae8fbdd2 admin admin] PATH_INFO: `/v3/projects/497ad5b1e23b4fd48f7d214eafb3ffb4/users/87b16ec3e492408f8e9b2658e96de13a/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:27.188009 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2377b9-cbc8-45b6-a76b-63c36b8dd808 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:27.201522 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292ebae-d25a-4ec6-86b2-9bdc6fa8162a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:27.202507 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292ebae-d25a-4ec6-86b2-9bdc6fa8162a service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:27.204014 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292ebae-d25a-4ec6-86b2-9bdc6fa8162a service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:27.204459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292ebae-d25a-4ec6-86b2-9bdc6fa8162a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:27.207465 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6292ebae-d25a-4ec6-86b2-9bdc6fa8162a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:27.237544 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f01b02-5754-41d3-8355-5ec5ae8fbdd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=497ad5b1e23b4fd48f7d214eafb3ffb4, user_id=87b16ec3e492408f8e9b2658e96de13a, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:27.238072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292ebae-d25a-4ec6-86b2-9bdc6fa8162a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:27.239683 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292ebae-d25a-4ec6-86b2-9bdc6fa8162a service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:27.240239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f01b02-5754-41d3-8355-5ec5ae8fbdd2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:27.252456 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 896/1761] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:40:27.270567 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 866/1762] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:40:27 2022] PUT /identity/v3/projects/497ad5b1e23b4fd48f7d214eafb3ffb4/users/87b16ec3e492408f8e9b2658e96de13a/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:27.282237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bc154-3296-4d7f-a331-02eb0c22b41d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:27.283817 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bc154-3296-4d7f-a331-02eb0c22b41d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:27.284019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bc154-3296-4d7f-a331-02eb0c22b41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:27.330945 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-322bc154-3296-4d7f-a331-02eb0c22b41d None None] MFA Rules not processed for user `87b16ec3e492408f8e9b2658e96de13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:27.332407 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-322bc154-3296-4d7f-a331-02eb0c22b41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:27.499529 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 897/1763] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:27.505344 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f01b02-5754-41d3-8355-5ec5ae8fbdd2 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:27.664732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f01b02-5754-41d3-8355-5ec5ae8fbdd2 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:27.683411 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e8159-b65e-452a-8144-971efd1d8d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:27.684374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e8159-b65e-452a-8144-971efd1d8d2d admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:27.684732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e8159-b65e-452a-8144-971efd1d8d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:27.684985 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e8159-b65e-452a-8144-971efd1d8d2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:27.685948 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e8159-b65e-452a-8144-971efd1d8d2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:27.688769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e8159-b65e-452a-8144-971efd1d8d2d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:27.750727 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 867/1764] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:40:27 2022] POST /identity/v3/projects => generated 377 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:27.752318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bc154-3296-4d7f-a331-02eb0c22b41d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:27.774835 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bc154-3296-4d7f-a331-02eb0c22b41d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:27.885500 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c1bd3-a580-4912-9f12-83d7b1f89f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:27.886979 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c1bd3-a580-4912-9f12-83d7b1f89f86 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:27.887446 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c1bd3-a580-4912-9f12-83d7b1f89f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:27.888194 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c1bd3-a580-4912-9f12-83d7b1f89f86 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:27.889493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c1bd3-a580-4912-9f12-83d7b1f89f86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:27.892215 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c1bd3-a580-4912-9f12-83d7b1f89f86 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:27.961582 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 898/1765] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:40:27 2022] POST /identity/v3/users => generated 295 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:27.961841 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e8159-b65e-452a-8144-971efd1d8d2d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:27.978704 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e8159-b65e-452a-8144-971efd1d8d2d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:28.025767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc2446-4e20-4749-8196-19fcdf36c8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:28.027653 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc2446-4e20-4749-8196-19fcdf36c8dc admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:28.036876 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc2446-4e20-4749-8196-19fcdf36c8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:28.038137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc2446-4e20-4749-8196-19fcdf36c8dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:28.039807 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc2446-4e20-4749-8196-19fcdf36c8dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:28.053091 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc2446-4e20-4749-8196-19fcdf36c8dc admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:28.100446 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 868/1766] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:40:28.105916 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c1bd3-a580-4912-9f12-83d7b1f89f86 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:28.142209 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c1bd3-a580-4912-9f12-83d7b1f89f86 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:28.181735 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96f4c9-1a0e-4c64-8173-d861bfcc221f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:28.182716 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96f4c9-1a0e-4c64-8173-d861bfcc221f admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:28.183010 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96f4c9-1a0e-4c64-8173-d861bfcc221f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:28.183291 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96f4c9-1a0e-4c64-8173-d861bfcc221f admin admin] PATH_INFO: `/v3/projects/13ab63a3995147e0bdb25335ebdb594f/users/7d63eeedb7b345f4880c91e5407d4b6b/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:28.247581 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96f4c9-1a0e-4c64-8173-d861bfcc221f admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ab63a3995147e0bdb25335ebdb594f, user_id=7d63eeedb7b345f4880c91e5407d4b6b, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:28.257203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96f4c9-1a0e-4c64-8173-d861bfcc221f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:28.304362 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 899/1767] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:40:28 2022] PUT /identity/v3/projects/13ab63a3995147e0bdb25335ebdb594f/users/7d63eeedb7b345f4880c91e5407d4b6b/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:28.307768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc2446-4e20-4749-8196-19fcdf36c8dc admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:28.333372 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc2446-4e20-4749-8196-19fcdf36c8dc admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:28.374852 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:28.427592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e2c20-d1d2-40ab-8639-ce031555a919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:28.429582 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e2c20-d1d2-40ab-8639-ce031555a919 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:28.429920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e2c20-d1d2-40ab-8639-ce031555a919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:28.430388 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e2c20-d1d2-40ab-8639-ce031555a919 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:28.431355 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e2c20-d1d2-40ab-8639-ce031555a919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:28.433290 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e2c20-d1d2-40ab-8639-ce031555a919 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:28.463292 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 869/1768] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:40:28.467391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96f4c9-1a0e-4c64-8173-d861bfcc221f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:28.480880 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96f4c9-1a0e-4c64-8173-d861bfcc221f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:28.487002 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017abe45-7700-4802-addb-cc8e59b6b411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:28.487915 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017abe45-7700-4802-addb-cc8e59b6b411 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:28.488198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017abe45-7700-4802-addb-cc8e59b6b411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:28.488482 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017abe45-7700-4802-addb-cc8e59b6b411 admin admin] PATH_INFO: `/v3/projects/13ab63a3995147e0bdb25335ebdb594f/users/7d63eeedb7b345f4880c91e5407d4b6b/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:28.499457 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017abe45-7700-4802-addb-cc8e59b6b411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ab63a3995147e0bdb25335ebdb594f, user_id=7d63eeedb7b345f4880c91e5407d4b6b, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:28.535514 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017abe45-7700-4802-addb-cc8e59b6b411 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:28.600170 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 900/1769] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:40:28 2022] PUT /identity/v3/projects/13ab63a3995147e0bdb25335ebdb594f/users/7d63eeedb7b345f4880c91e5407d4b6b/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:28.611980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26568ba3-12d3-4840-b8d3-109a76059cc8 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:28.612298 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26568ba3-12d3-4840-b8d3-109a76059cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:28.624374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26568ba3-12d3-4840-b8d3-109a76059cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:28.679430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-26568ba3-12d3-4840-b8d3-109a76059cc8 None None] MFA Rules not processed for user `7d63eeedb7b345f4880c91e5407d4b6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:28.683932 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-26568ba3-12d3-4840-b8d3-109a76059cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:28.907868 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 870/1770] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:40:28.919018 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017abe45-7700-4802-addb-cc8e59b6b411 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:28.920938 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-017abe45-7700-4802-addb-cc8e59b6b411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:28.948822 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:29.015100 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017abe45-7700-4802-addb-cc8e59b6b411 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:29.019479 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa015bd-79f7-41e0-bc57-362b6f477447 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:29.020342 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa015bd-79f7-41e0-bc57-362b6f477447 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:29.020675 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa015bd-79f7-41e0-bc57-362b6f477447 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:29.020957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa015bd-79f7-41e0-bc57-362b6f477447 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:29.031890 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa015bd-79f7-41e0-bc57-362b6f477447 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:29.033540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa015bd-79f7-41e0-bc57-362b6f477447 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:29.048619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 901/1771] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:29.115332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26568ba3-12d3-4840-b8d3-109a76059cc8 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:29.116793 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-26568ba3-12d3-4840-b8d3-109a76059cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:29.160795 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26568ba3-12d3-4840-b8d3-109a76059cc8 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:29.171167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ec5de-4419-4772-a90d-d2cd082bf3cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:29.172066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ec5de-4419-4772-a90d-d2cd082bf3cd service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:29.172357 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ec5de-4419-4772-a90d-d2cd082bf3cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:29.172963 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ec5de-4419-4772-a90d-d2cd082bf3cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:29.200325 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90458825-2947-47ae-bd91-82bc5d48f369 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:29.200754 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90458825-2947-47ae-bd91-82bc5d48f369 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:29.201211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90458825-2947-47ae-bd91-82bc5d48f369 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:29.202806 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 902/1772] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 30 10:40:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:40:29.222389 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7be701-4ac9-4ea5-8e18-c3e2e4ce40fb None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:29.222776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7be701-4ac9-4ea5-8e18-c3e2e4ce40fb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:29.222954 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7be701-4ac9-4ea5-8e18-c3e2e4ce40fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:29.276473 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-6e7be701-4ac9-4ea5-8e18-c3e2e4ce40fb None None] MFA Rules not processed for user `1bfd036d747241d9bc314b60bf8648b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:29.277659 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6e7be701-4ac9-4ea5-8e18-c3e2e4ce40fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:29.306628 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ec5de-4419-4772-a90d-d2cd082bf3cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:29.308329 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ec5de-4419-4772-a90d-d2cd082bf3cd service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:29.333594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 871/1773] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:29.467968 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 903/1774] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 30 10:40:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:40:29.475456 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ec5de-4419-4772-a90d-d2cd082bf3cd service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:29.477038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f31ec5de-4419-4772-a90d-d2cd082bf3cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:29.495070 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ec5de-4419-4772-a90d-d2cd082bf3cd service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:29.502366 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c883cc0-a770-41b9-a5da-83538b24ef04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:29.503024 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c883cc0-a770-41b9-a5da-83538b24ef04 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:29.503685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c883cc0-a770-41b9-a5da-83538b24ef04 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:29.503977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c883cc0-a770-41b9-a5da-83538b24ef04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:29.514684 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c883cc0-a770-41b9-a5da-83538b24ef04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:29.516548 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c883cc0-a770-41b9-a5da-83538b24ef04 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:29.529125 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 872/1775] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:39.447990 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=52 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:39.524045 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=83 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:40.287373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7be701-4ac9-4ea5-8e18-c3e2e4ce40fb None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:40.412594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7be701-4ac9-4ea5-8e18-c3e2e4ce40fb None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:40.419095 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1020d-f6a0-4528-b675-58de956db8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:40.420641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1020d-f6a0-4528-b675-58de956db8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:40.421283 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1020d-f6a0-4528-b675-58de956db8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:40.422420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1020d-f6a0-4528-b675-58de956db8e7 admin admin] PATH_INFO: `/v3/users/2882b768196e4575a21f61bc3a12b0c5` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:40.423992 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1020d-f6a0-4528-b675-58de956db8e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2882b768196e4575a21f61bc3a12b0c5)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:40.427068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1020d-f6a0-4528-b675-58de956db8e7 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:40.523033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1fd1020d-f6a0-4528-b675-58de956db8e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2882b768196e4575a21f61bc3a12b0c5'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:40.549288 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1fd1020d-f6a0-4528-b675-58de956db8e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2882b768196e4575a21f61bc3a12b0c5'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:40.550224 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1fd1020d-f6a0-4528-b675-58de956db8e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2882b768196e4575a21f61bc3a12b0c5'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:40.563552 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1fd1020d-f6a0-4528-b675-58de956db8e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2882b768196e4575a21f61bc3a12b0c5'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:40.564417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1fd1020d-f6a0-4528-b675-58de956db8e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2882b768196e4575a21f61bc3a12b0c5'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:40.592396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 904/1776] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:40:40 2022] DELETE /identity/v3/users/2882b768196e4575a21f61bc3a12b0c5 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:40.594965 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65d3e5-68b3-448f-b39f-2a3b62860a9d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:40.595797 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65d3e5-68b3-448f-b39f-2a3b62860a9d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:40.596272 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65d3e5-68b3-448f-b39f-2a3b62860a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:40.616393 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8c65d3e5-68b3-448f-b39f-2a3b62860a9d None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:40.618025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8c65d3e5-68b3-448f-b39f-2a3b62860a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:40.704695 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 873/1777] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:40.750322 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1020d-f6a0-4528-b675-58de956db8e7 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:40.752358 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1fd1020d-f6a0-4528-b675-58de956db8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:40.847700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1020d-f6a0-4528-b675-58de956db8e7 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:40.851359 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716b980-7429-4b0e-9709-b5461bd9c81c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:40.852023 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716b980-7429-4b0e-9709-b5461bd9c81c service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:40.852319 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716b980-7429-4b0e-9709-b5461bd9c81c service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:40.852683 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716b980-7429-4b0e-9709-b5461bd9c81c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:40.865708 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716b980-7429-4b0e-9709-b5461bd9c81c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:40.867176 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716b980-7429-4b0e-9709-b5461bd9c81c service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:40.878915 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 905/1778] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:41.824886 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65d3e5-68b3-448f-b39f-2a3b62860a9d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:41.826374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8c65d3e5-68b3-448f-b39f-2a3b62860a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:41.849263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65d3e5-68b3-448f-b39f-2a3b62860a9d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:41.855908 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183bcc4-11bc-4415-9129-95c7c2c6a6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:41.857118 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183bcc4-11bc-4415-9129-95c7c2c6a6b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:41.857482 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183bcc4-11bc-4415-9129-95c7c2c6a6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:41.857888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183bcc4-11bc-4415-9129-95c7c2c6a6b6 admin admin] PATH_INFO: `/v3/projects/6903d84e0ae140ef804ff010ebd1634d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:41.860066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183bcc4-11bc-4415-9129-95c7c2c6a6b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6903d84e0ae140ef804ff010ebd1634d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:41.862413 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183bcc4-11bc-4415-9129-95c7c2c6a6b6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:41.942233 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a183bcc4-11bc-4415-9129-95c7c2c6a6b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6903d84e0ae140ef804ff010ebd1634d', 'request_id': 'req-a183bcc4-11bc-4415-9129-95c7c2c6a6b6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:41.957010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a183bcc4-11bc-4415-9129-95c7c2c6a6b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6903d84e0ae140ef804ff010ebd1634d', 'request_id': 'req-a183bcc4-11bc-4415-9129-95c7c2c6a6b6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:41.966647 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a183bcc4-11bc-4415-9129-95c7c2c6a6b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6903d84e0ae140ef804ff010ebd1634d', 'request_id': 'req-a183bcc4-11bc-4415-9129-95c7c2c6a6b6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:41.983218 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a183bcc4-11bc-4415-9129-95c7c2c6a6b6 admin admin] The token cache is being invalidate because project 6903d84e0ae140ef804ff010ebd1634d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:40:41.983744 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a183bcc4-11bc-4415-9129-95c7c2c6a6b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:41.984737 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a183bcc4-11bc-4415-9129-95c7c2c6a6b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:41.988065 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 874/1779] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:40:41 2022] DELETE /identity/v3/projects/6903d84e0ae140ef804ff010ebd1634d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:41.995420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716b980-7429-4b0e-9709-b5461bd9c81c service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:42.032973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716b980-7429-4b0e-9709-b5461bd9c81c service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:42.072968 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:42.142107 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51a3cf-adcf-4adf-a858-bcc621d15b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:42.143050 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51a3cf-adcf-4adf-a858-bcc621d15b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:42.143410 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51a3cf-adcf-4adf-a858-bcc621d15b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:42.143640 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51a3cf-adcf-4adf-a858-bcc621d15b9a admin admin] PATH_INFO: `/v3/users/87b16ec3e492408f8e9b2658e96de13a` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:42.145240 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51a3cf-adcf-4adf-a858-bcc621d15b9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=87b16ec3e492408f8e9b2658e96de13a)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:42.147799 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51a3cf-adcf-4adf-a858-bcc621d15b9a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:42.259457 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9d51a3cf-adcf-4adf-a858-bcc621d15b9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87b16ec3e492408f8e9b2658e96de13a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:42.273412 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9d51a3cf-adcf-4adf-a858-bcc621d15b9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87b16ec3e492408f8e9b2658e96de13a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:42.274254 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9d51a3cf-adcf-4adf-a858-bcc621d15b9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87b16ec3e492408f8e9b2658e96de13a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:42.283393 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9d51a3cf-adcf-4adf-a858-bcc621d15b9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87b16ec3e492408f8e9b2658e96de13a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:42.284297 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9d51a3cf-adcf-4adf-a858-bcc621d15b9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87b16ec3e492408f8e9b2658e96de13a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:42.301654 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 906/1780] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:40:41 2022] DELETE /identity/v3/users/87b16ec3e492408f8e9b2658e96de13a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:42.760727 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183bcc4-11bc-4415-9129-95c7c2c6a6b6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:42.764450 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a183bcc4-11bc-4415-9129-95c7c2c6a6b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:42.779247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183bcc4-11bc-4415-9129-95c7c2c6a6b6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:42.850943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77fd116-2fbf-4820-86bf-dc4e96c6eafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:42.853322 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fd116-2fbf-4820-86bf-dc4e96c6eafa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:42.854090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fd116-2fbf-4820-86bf-dc4e96c6eafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:42.854586 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fd116-2fbf-4820-86bf-dc4e96c6eafa admin admin] PATH_INFO: `/v3/users/92675635861446b2b47c70fc5bf7cc91` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:42.856593 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77fd116-2fbf-4820-86bf-dc4e96c6eafa admin admin] RBAC: Authorizing `identity:delete_user(user_id=92675635861446b2b47c70fc5bf7cc91)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:42.859930 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77fd116-2fbf-4820-86bf-dc4e96c6eafa admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:42.907188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51a3cf-adcf-4adf-a858-bcc621d15b9a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:42.909259 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9d51a3cf-adcf-4adf-a858-bcc621d15b9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:42.920094 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:42.927665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51a3cf-adcf-4adf-a858-bcc621d15b9a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:42.938934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025bf6e3-82f3-4f64-85ce-1f9ec7d9db24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:42.940464 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025bf6e3-82f3-4f64-85ce-1f9ec7d9db24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:42.941364 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025bf6e3-82f3-4f64-85ce-1f9ec7d9db24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:42.941908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025bf6e3-82f3-4f64-85ce-1f9ec7d9db24 admin admin] PATH_INFO: `/v3/projects/497ad5b1e23b4fd48f7d214eafb3ffb4` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:42.944275 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025bf6e3-82f3-4f64-85ce-1f9ec7d9db24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=497ad5b1e23b4fd48f7d214eafb3ffb4)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:42.947454 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e77fd116-2fbf-4820-86bf-dc4e96c6eafa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92675635861446b2b47c70fc5bf7cc91'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:42.948129 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e77fd116-2fbf-4820-86bf-dc4e96c6eafa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92675635861446b2b47c70fc5bf7cc91'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:42.948257 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025bf6e3-82f3-4f64-85ce-1f9ec7d9db24 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:42.958123 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e77fd116-2fbf-4820-86bf-dc4e96c6eafa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92675635861446b2b47c70fc5bf7cc91'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:42.959575 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e77fd116-2fbf-4820-86bf-dc4e96c6eafa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92675635861446b2b47c70fc5bf7cc91'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:42.969984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e77fd116-2fbf-4820-86bf-dc4e96c6eafa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92675635861446b2b47c70fc5bf7cc91'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:42.995545 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 875/1781] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:40:42 2022] DELETE /identity/v3/users/92675635861446b2b47c70fc5bf7cc91 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:43.000723 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05be76f-3921-45b7-87d8-89c3351674ca None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:43.001020 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05be76f-3921-45b7-87d8-89c3351674ca None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:43.001301 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05be76f-3921-45b7-87d8-89c3351674ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:43.014152 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-025bf6e3-82f3-4f64-85ce-1f9ec7d9db24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '497ad5b1e23b4fd48f7d214eafb3ffb4', 'request_id': 'req-025bf6e3-82f3-4f64-85ce-1f9ec7d9db24'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:43.023985 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f05be76f-3921-45b7-87d8-89c3351674ca None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:43.025743 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f05be76f-3921-45b7-87d8-89c3351674ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:43.034794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-025bf6e3-82f3-4f64-85ce-1f9ec7d9db24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '497ad5b1e23b4fd48f7d214eafb3ffb4', 'request_id': 'req-025bf6e3-82f3-4f64-85ce-1f9ec7d9db24'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:43.051021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-025bf6e3-82f3-4f64-85ce-1f9ec7d9db24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '497ad5b1e23b4fd48f7d214eafb3ffb4', 'request_id': 'req-025bf6e3-82f3-4f64-85ce-1f9ec7d9db24'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:43.084577 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-025bf6e3-82f3-4f64-85ce-1f9ec7d9db24 admin admin] The token cache is being invalidate because project 497ad5b1e23b4fd48f7d214eafb3ffb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:40:43.084906 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-025bf6e3-82f3-4f64-85ce-1f9ec7d9db24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:43.086440 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-025bf6e3-82f3-4f64-85ce-1f9ec7d9db24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:43.090098 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 907/1782] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:40:42 2022] DELETE /identity/v3/projects/497ad5b1e23b4fd48f7d214eafb3ffb4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:40:43.094548 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025bf6e3-82f3-4f64-85ce-1f9ec7d9db24 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:43.096967 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-025bf6e3-82f3-4f64-85ce-1f9ec7d9db24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:43.143958 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:43.150082 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 876/1783] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:43.173788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05be76f-3921-45b7-87d8-89c3351674ca None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:43.175646 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f05be76f-3921-45b7-87d8-89c3351674ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:43.206659 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025bf6e3-82f3-4f64-85ce-1f9ec7d9db24 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:43.212954 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c0aef-b601-44d2-a3ad-34b179e2ea23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:43.214124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c0aef-b601-44d2-a3ad-34b179e2ea23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:43.214650 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c0aef-b601-44d2-a3ad-34b179e2ea23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:43.215030 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c0aef-b601-44d2-a3ad-34b179e2ea23 admin admin] PATH_INFO: `/v3/users/7d63eeedb7b345f4880c91e5407d4b6b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:43.216689 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c0aef-b601-44d2-a3ad-34b179e2ea23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d63eeedb7b345f4880c91e5407d4b6b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:43.220983 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c0aef-b601-44d2-a3ad-34b179e2ea23 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:43.262043 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05be76f-3921-45b7-87d8-89c3351674ca None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:43.270276 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52496f-d9bc-48da-82ba-5d7d0f7776bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:43.270985 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52496f-d9bc-48da-82ba-5d7d0f7776bc service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:43.271280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52496f-d9bc-48da-82ba-5d7d0f7776bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:43.271556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52496f-d9bc-48da-82ba-5d7d0f7776bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:43.283505 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-982c0aef-b601-44d2-a3ad-34b179e2ea23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d63eeedb7b345f4880c91e5407d4b6b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:43.288936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52496f-d9bc-48da-82ba-5d7d0f7776bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:43.292018 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52496f-d9bc-48da-82ba-5d7d0f7776bc service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:43.299637 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-982c0aef-b601-44d2-a3ad-34b179e2ea23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d63eeedb7b345f4880c91e5407d4b6b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:43.300829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-982c0aef-b601-44d2-a3ad-34b179e2ea23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d63eeedb7b345f4880c91e5407d4b6b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:43.308636 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 877/1784] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:43.314466 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-982c0aef-b601-44d2-a3ad-34b179e2ea23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d63eeedb7b345f4880c91e5407d4b6b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:43.315237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-982c0aef-b601-44d2-a3ad-34b179e2ea23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d63eeedb7b345f4880c91e5407d4b6b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:43.329576 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 908/1785] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:40:43 2022] DELETE /identity/v3/users/7d63eeedb7b345f4880c91e5407d4b6b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:43.822029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52496f-d9bc-48da-82ba-5d7d0f7776bc service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:43.832867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52496f-d9bc-48da-82ba-5d7d0f7776bc service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:43.888164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:43.918031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f37823-8f4a-4c62-a5e7-ca8573fd7558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:43.919585 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f37823-8f4a-4c62-a5e7-ca8573fd7558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:43.919894 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f37823-8f4a-4c62-a5e7-ca8573fd7558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:43.920535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f37823-8f4a-4c62-a5e7-ca8573fd7558 admin admin] PATH_INFO: `/v3/projects/13ab63a3995147e0bdb25335ebdb594f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:43.922772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f37823-8f4a-4c62-a5e7-ca8573fd7558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13ab63a3995147e0bdb25335ebdb594f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:43.924862 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f37823-8f4a-4c62-a5e7-ca8573fd7558 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:44.013834 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c0aef-b601-44d2-a3ad-34b179e2ea23 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:44.016723 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-982c0aef-b601-44d2-a3ad-34b179e2ea23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:44.030639 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-16f37823-8f4a-4c62-a5e7-ca8573fd7558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13ab63a3995147e0bdb25335ebdb594f', 'request_id': 'req-16f37823-8f4a-4c62-a5e7-ca8573fd7558'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:44.041160 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c0aef-b601-44d2-a3ad-34b179e2ea23 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:44.046158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-16f37823-8f4a-4c62-a5e7-ca8573fd7558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13ab63a3995147e0bdb25335ebdb594f', 'request_id': 'req-16f37823-8f4a-4c62-a5e7-ca8573fd7558'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:44.056676 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-16f37823-8f4a-4c62-a5e7-ca8573fd7558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13ab63a3995147e0bdb25335ebdb594f', 'request_id': 'req-16f37823-8f4a-4c62-a5e7-ca8573fd7558'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:44.070631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-16f37823-8f4a-4c62-a5e7-ca8573fd7558 admin admin] The token cache is being invalidate because project 13ab63a3995147e0bdb25335ebdb594f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:40:44.070921 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-16f37823-8f4a-4c62-a5e7-ca8573fd7558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:44.071603 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-16f37823-8f4a-4c62-a5e7-ca8573fd7558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:44.073509 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 878/1786] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:40:43 2022] DELETE /identity/v3/projects/13ab63a3995147e0bdb25335ebdb594f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:44.080836 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844f223-6793-41b8-89c3-ca2125abc303 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:44.081574 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844f223-6793-41b8-89c3-ca2125abc303 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:44.081574 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844f223-6793-41b8-89c3-ca2125abc303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:44.106513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f844f223-6793-41b8-89c3-ca2125abc303 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:44.107888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f844f223-6793-41b8-89c3-ca2125abc303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:44.125843 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6f192-6ef7-4cb4-8bac-50a08425584b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:44.127011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6f192-6ef7-4cb4-8bac-50a08425584b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:44.127442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6f192-6ef7-4cb4-8bac-50a08425584b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:44.127937 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6f192-6ef7-4cb4-8bac-50a08425584b admin admin] PATH_INFO: `/v3/projects/2e03217c06e348f39b40654321568c04` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:44.129742 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6f192-6ef7-4cb4-8bac-50a08425584b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e03217c06e348f39b40654321568c04)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:44.133023 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6f192-6ef7-4cb4-8bac-50a08425584b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:44.184415 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:44.185737 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 879/1787] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:44.188687 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6ca6f192-6ef7-4cb4-8bac-50a08425584b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e03217c06e348f39b40654321568c04', 'request_id': 'req-6ca6f192-6ef7-4cb4-8bac-50a08425584b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:44.194764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c218d4-9e55-49b3-aa2c-840919634a58 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:44.195066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c218d4-9e55-49b3-aa2c-840919634a58 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:44.195348 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c218d4-9e55-49b3-aa2c-840919634a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:44.198935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6ca6f192-6ef7-4cb4-8bac-50a08425584b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e03217c06e348f39b40654321568c04', 'request_id': 'req-6ca6f192-6ef7-4cb4-8bac-50a08425584b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:44.208003 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6ca6f192-6ef7-4cb4-8bac-50a08425584b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e03217c06e348f39b40654321568c04', 'request_id': 'req-6ca6f192-6ef7-4cb4-8bac-50a08425584b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:44.215758 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d3c218d4-9e55-49b3-aa2c-840919634a58 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:44.217017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d3c218d4-9e55-49b3-aa2c-840919634a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:44.221471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6ca6f192-6ef7-4cb4-8bac-50a08425584b admin admin] The token cache is being invalidate because project 2e03217c06e348f39b40654321568c04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:40:44.221841 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6ca6f192-6ef7-4cb4-8bac-50a08425584b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:44.222831 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6ca6f192-6ef7-4cb4-8bac-50a08425584b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:44.224482 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 909/1788] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:40:44 2022] DELETE /identity/v3/projects/2e03217c06e348f39b40654321568c04 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:40:44.228654 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6f192-6ef7-4cb4-8bac-50a08425584b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:44.230312 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6ca6f192-6ef7-4cb4-8bac-50a08425584b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:44.283529 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 880/1789] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:44.288247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c218d4-9e55-49b3-aa2c-840919634a58 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:44.299116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c218d4-9e55-49b3-aa2c-840919634a58 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:44.304195 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3743eb-6890-4365-ac76-277eaea1cac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:44.305073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3743eb-6890-4365-ac76-277eaea1cac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:44.305414 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3743eb-6890-4365-ac76-277eaea1cac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:44.305698 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3743eb-6890-4365-ac76-277eaea1cac6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:44.306431 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3743eb-6890-4365-ac76-277eaea1cac6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:40:44.306741 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3743eb-6890-4365-ac76-277eaea1cac6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:44.308426 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3743eb-6890-4365-ac76-277eaea1cac6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:44.311144 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6f192-6ef7-4cb4-8bac-50a08425584b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:44.317163 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc130d-7ec9-4abb-a19a-21c5257e0c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:44.318328 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc130d-7ec9-4abb-a19a-21c5257e0c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:44.318611 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc130d-7ec9-4abb-a19a-21c5257e0c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:44.318886 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc130d-7ec9-4abb-a19a-21c5257e0c38 admin admin] PATH_INFO: `/v3/users/21e449c3e1c54c97a291416ea39ba896` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:44.320155 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc130d-7ec9-4abb-a19a-21c5257e0c38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21e449c3e1c54c97a291416ea39ba896)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:44.325455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 881/1790] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:40:44.325643 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc130d-7ec9-4abb-a19a-21c5257e0c38 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:44.327099 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3743eb-6890-4365-ac76-277eaea1cac6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:44.334369 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:44.338548 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3743eb-6890-4365-ac76-277eaea1cac6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:44.344643 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd1fff-ed72-40a8-a6a7-1f86731e9823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:44.345789 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd1fff-ed72-40a8-a6a7-1f86731e9823 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:44.346783 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd1fff-ed72-40a8-a6a7-1f86731e9823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:44.347132 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd1fff-ed72-40a8-a6a7-1f86731e9823 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:44.347896 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd1fff-ed72-40a8-a6a7-1f86731e9823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:44.350564 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd1fff-ed72-40a8-a6a7-1f86731e9823 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:44.384259 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c4dc130d-7ec9-4abb-a19a-21c5257e0c38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21e449c3e1c54c97a291416ea39ba896'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:44.388847 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 882/1791] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:40:44 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:40:44.390834 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd1fff-ed72-40a8-a6a7-1f86731e9823 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:44.398119 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c4dc130d-7ec9-4abb-a19a-21c5257e0c38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21e449c3e1c54c97a291416ea39ba896'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:44.398925 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c4dc130d-7ec9-4abb-a19a-21c5257e0c38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21e449c3e1c54c97a291416ea39ba896'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:44.406955 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c4dc130d-7ec9-4abb-a19a-21c5257e0c38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21e449c3e1c54c97a291416ea39ba896'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:44.407773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c4dc130d-7ec9-4abb-a19a-21c5257e0c38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21e449c3e1c54c97a291416ea39ba896'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:44.423914 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 910/1792] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:40:44 2022] DELETE /identity/v3/users/21e449c3e1c54c97a291416ea39ba896 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:44.463175 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd1fff-ed72-40a8-a6a7-1f86731e9823 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:44.533202 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d4fff-57d2-4568-bd45-786abe8a992f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:44.533962 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d4fff-57d2-4568-bd45-786abe8a992f admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:44.534257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d4fff-57d2-4568-bd45-786abe8a992f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:44.534602 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d4fff-57d2-4568-bd45-786abe8a992f admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:44.535354 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d4fff-57d2-4568-bd45-786abe8a992f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:44.537428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d4fff-57d2-4568-bd45-786abe8a992f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:44.561053 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 883/1793] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:40:44 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:40:44.562822 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc130d-7ec9-4abb-a19a-21c5257e0c38 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:44.564240 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c4dc130d-7ec9-4abb-a19a-21c5257e0c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:44.577235 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc130d-7ec9-4abb-a19a-21c5257e0c38 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:44.581981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5718969-5c6a-4e55-bc24-a6e0785c8d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:44.582649 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5718969-5c6a-4e55-bc24-a6e0785c8d37 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:44.582934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5718969-5c6a-4e55-bc24-a6e0785c8d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:44.583207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5718969-5c6a-4e55-bc24-a6e0785c8d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:44.583925 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5718969-5c6a-4e55-bc24-a6e0785c8d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:44.585571 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5718969-5c6a-4e55-bc24-a6e0785c8d37 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:44.599375 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 911/1794] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:40:44.608257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d4fff-57d2-4568-bd45-786abe8a992f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:44.619550 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d4fff-57d2-4568-bd45-786abe8a992f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:44.624554 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126281ce-026b-4bd5-a1a9-176f2da69ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:44.625222 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126281ce-026b-4bd5-a1a9-176f2da69ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:44.625507 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126281ce-026b-4bd5-a1a9-176f2da69ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:44.626214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126281ce-026b-4bd5-a1a9-176f2da69ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:44.626513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126281ce-026b-4bd5-a1a9-176f2da69ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:44.628293 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126281ce-026b-4bd5-a1a9-176f2da69ce1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:44.638885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 884/1795] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:40:44.642912 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5718969-5c6a-4e55-bc24-a6e0785c8d37 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:44.652823 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5718969-5c6a-4e55-bc24-a6e0785c8d37 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:44.658714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b22d1-f185-4c54-9430-849c03446c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:44.659595 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b22d1-f185-4c54-9430-849c03446c1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:44.659877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b22d1-f185-4c54-9430-849c03446c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:44.660153 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b22d1-f185-4c54-9430-849c03446c1b admin admin] PATH_INFO: `/v3/projects/699b9ccef6394632aa632e371045a2f1/users/7481d5fcc72b448f985d127ee4d62fe6/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:44.679098 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b22d1-f185-4c54-9430-849c03446c1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=699b9ccef6394632aa632e371045a2f1, user_id=7481d5fcc72b448f985d127ee4d62fe6, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:44.681764 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b22d1-f185-4c54-9430-849c03446c1b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:44.697570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 912/1796] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:40:44 2022] PUT /identity/v3/projects/699b9ccef6394632aa632e371045a2f1/users/7481d5fcc72b448f985d127ee4d62fe6/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:44.703247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2c86b-fb92-4225-b8aa-0b1c8ba35b2f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:44.703542 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2c86b-fb92-4225-b8aa-0b1c8ba35b2f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:44.703836 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2c86b-fb92-4225-b8aa-0b1c8ba35b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:44.726937 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-36a2c86b-fb92-4225-b8aa-0b1c8ba35b2f None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:44.728145 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-36a2c86b-fb92-4225-b8aa-0b1c8ba35b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:44.733426 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b22d1-f185-4c54-9430-849c03446c1b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:44.736026 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-386b22d1-f185-4c54-9430-849c03446c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:44.760236 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:44.812363 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b22d1-f185-4c54-9430-849c03446c1b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:44.817215 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297232e-5ccc-45a7-acf6-931c221175c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:44.818197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297232e-5ccc-45a7-acf6-931c221175c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:44.818534 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297232e-5ccc-45a7-acf6-931c221175c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:44.818849 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297232e-5ccc-45a7-acf6-931c221175c5 admin admin] PATH_INFO: `/v3/projects/32fbe6641fe943cf8c073faecf35672a` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:44.820353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297232e-5ccc-45a7-acf6-931c221175c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32fbe6641fe943cf8c073faecf35672a)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:44.822374 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297232e-5ccc-45a7-acf6-931c221175c5 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:44.822995 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 885/1797] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:44.834370 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2c86b-fb92-4225-b8aa-0b1c8ba35b2f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:44.836237 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-36a2c86b-fb92-4225-b8aa-0b1c8ba35b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:44.858107 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:44.884827 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8297232e-5ccc-45a7-acf6-931c221175c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32fbe6641fe943cf8c073faecf35672a', 'request_id': 'req-8297232e-5ccc-45a7-acf6-931c221175c5'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:44.896711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8297232e-5ccc-45a7-acf6-931c221175c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32fbe6641fe943cf8c073faecf35672a', 'request_id': 'req-8297232e-5ccc-45a7-acf6-931c221175c5'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:44.911735 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8297232e-5ccc-45a7-acf6-931c221175c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32fbe6641fe943cf8c073faecf35672a', 'request_id': 'req-8297232e-5ccc-45a7-acf6-931c221175c5'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:44.918801 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2c86b-fb92-4225-b8aa-0b1c8ba35b2f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:44.924083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8297232e-5ccc-45a7-acf6-931c221175c5 admin admin] The token cache is being invalidate because project 32fbe6641fe943cf8c073faecf35672a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:40:44.924593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8297232e-5ccc-45a7-acf6-931c221175c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:44.925546 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8297232e-5ccc-45a7-acf6-931c221175c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:44.927163 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 913/1798] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:40:44 2022] DELETE /identity/v3/projects/32fbe6641fe943cf8c073faecf35672a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:40:44.931834 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76f96b-0a6b-40f1-bb0d-f62564dfa7ca None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:44.932056 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76f96b-0a6b-40f1-bb0d-f62564dfa7ca None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:44.932337 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76f96b-0a6b-40f1-bb0d-f62564dfa7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:44.952245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ce76f96b-0a6b-40f1-bb0d-f62564dfa7ca None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:44.953979 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ce76f96b-0a6b-40f1-bb0d-f62564dfa7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:44.974093 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c5db2-286b-457f-ba79-79bdb99db266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:44.974750 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c5db2-286b-457f-ba79-79bdb99db266 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:44.975038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c5db2-286b-457f-ba79-79bdb99db266 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:44.975318 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c5db2-286b-457f-ba79-79bdb99db266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:44.977119 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2f6c5db2-286b-457f-ba79-79bdb99db266 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:45.024653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 914/1799] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:40:45.033147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038f032-ae77-49cd-b7ad-62969cc6b39e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:45.033438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038f032-ae77-49cd-b7ad-62969cc6b39e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:45.033716 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038f032-ae77-49cd-b7ad-62969cc6b39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:45.050924 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c5db2-286b-457f-ba79-79bdb99db266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:45.052755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c5db2-286b-457f-ba79-79bdb99db266 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:45.053842 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-4038f032-ae77-49cd-b7ad-62969cc6b39e None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:45.055088 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4038f032-ae77-49cd-b7ad-62969cc6b39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:45.063518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 915/1800] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:40:45.066030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 886/1801] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:45.067754 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038f032-ae77-49cd-b7ad-62969cc6b39e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:45.078039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038f032-ae77-49cd-b7ad-62969cc6b39e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:45.084638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94929372-aea8-40ca-898d-014b5f81e794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:45.085448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94929372-aea8-40ca-898d-014b5f81e794 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:45.085801 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94929372-aea8-40ca-898d-014b5f81e794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:45.086219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94929372-aea8-40ca-898d-014b5f81e794 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:45.087345 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94929372-aea8-40ca-898d-014b5f81e794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:40:45.087472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94929372-aea8-40ca-898d-014b5f81e794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:45.089265 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94929372-aea8-40ca-898d-014b5f81e794 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:45.108841 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 916/1802] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:40:45.110668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c5db2-286b-457f-ba79-79bdb99db266 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:45.122511 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c5db2-286b-457f-ba79-79bdb99db266 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:45.129234 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53963b56-fdb3-4463-8a59-c1c299f51e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:45.130229 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53963b56-fdb3-4463-8a59-c1c299f51e4d admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:45.130516 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53963b56-fdb3-4463-8a59-c1c299f51e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:45.130790 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53963b56-fdb3-4463-8a59-c1c299f51e4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:45.131532 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53963b56-fdb3-4463-8a59-c1c299f51e4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:45.133619 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53963b56-fdb3-4463-8a59-c1c299f51e4d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:45.178285 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 887/1803] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:40:45 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:40:45.182702 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94929372-aea8-40ca-898d-014b5f81e794 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:45.194296 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94929372-aea8-40ca-898d-014b5f81e794 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:45.226866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:45.287522 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5380c6-a772-4d61-a5a8-e73db9bb5ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:45.288348 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5380c6-a772-4d61-a5a8-e73db9bb5ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:45.288784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5380c6-a772-4d61-a5a8-e73db9bb5ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:45.289167 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5380c6-a772-4d61-a5a8-e73db9bb5ce4 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:45.290643 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5380c6-a772-4d61-a5a8-e73db9bb5ce4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:45.292165 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5380c6-a772-4d61-a5a8-e73db9bb5ce4 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:45.316797 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 917/1804] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:40:45 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:45.320829 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53963b56-fdb3-4463-8a59-c1c299f51e4d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:45.332295 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53963b56-fdb3-4463-8a59-c1c299f51e4d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:45.337107 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c115a-b977-4f6a-9207-4585580f9493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:45.337769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c115a-b977-4f6a-9207-4585580f9493 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:45.338053 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c115a-b977-4f6a-9207-4585580f9493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:45.338355 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c115a-b977-4f6a-9207-4585580f9493 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:45.339048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c115a-b977-4f6a-9207-4585580f9493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:45.340678 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c115a-b977-4f6a-9207-4585580f9493 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:45.352858 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 888/1805] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:40:45.357751 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5380c6-a772-4d61-a5a8-e73db9bb5ce4 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:45.372157 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5380c6-a772-4d61-a5a8-e73db9bb5ce4 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:45.381376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e731b6-8774-4ded-8e28-5a3bcbb9beda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:45.382227 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e731b6-8774-4ded-8e28-5a3bcbb9beda admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:45.382793 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e731b6-8774-4ded-8e28-5a3bcbb9beda admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:45.383226 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e731b6-8774-4ded-8e28-5a3bcbb9beda admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:45.384099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e731b6-8774-4ded-8e28-5a3bcbb9beda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:45.386154 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e731b6-8774-4ded-8e28-5a3bcbb9beda admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:45.397615 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 918/1806] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:40:45.401752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c115a-b977-4f6a-9207-4585580f9493 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:45.413190 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c115a-b977-4f6a-9207-4585580f9493 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:45.418889 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e940cc-f169-4916-bfbf-d20829b1b35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:45.419911 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e940cc-f169-4916-bfbf-d20829b1b35d admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:45.420297 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e940cc-f169-4916-bfbf-d20829b1b35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:45.420728 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e940cc-f169-4916-bfbf-d20829b1b35d admin admin] PATH_INFO: `/v3/projects/40477f3013b14c02832a0265a835f425/users/631a49978ea14f85839885a1edbd1966/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:45.441598 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e940cc-f169-4916-bfbf-d20829b1b35d admin admin] RBAC: Authorizing `identity:create_grant(project_id=40477f3013b14c02832a0265a835f425, user_id=631a49978ea14f85839885a1edbd1966, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:45.444630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e940cc-f169-4916-bfbf-d20829b1b35d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:45.461235 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 889/1807] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:40:45 2022] PUT /identity/v3/projects/40477f3013b14c02832a0265a835f425/users/631a49978ea14f85839885a1edbd1966/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:40:45.472953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea143d2-5169-480f-a84d-21a78692129e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:45.473176 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea143d2-5169-480f-a84d-21a78692129e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:45.473694 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea143d2-5169-480f-a84d-21a78692129e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:45.505052 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-7ea143d2-5169-480f-a84d-21a78692129e None None] MFA Rules not processed for user `631a49978ea14f85839885a1edbd1966`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:45.506290 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7ea143d2-5169-480f-a84d-21a78692129e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:45.574846 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 919/1808] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:45.579843 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e940cc-f169-4916-bfbf-d20829b1b35d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:45.600035 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:45.648047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e940cc-f169-4916-bfbf-d20829b1b35d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:45.652857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0706c-7caf-4502-8c08-d73323150b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:45.653637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0706c-7caf-4502-8c08-d73323150b43 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:45.653926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0706c-7caf-4502-8c08-d73323150b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:45.654208 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0706c-7caf-4502-8c08-d73323150b43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:45.654913 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0706c-7caf-4502-8c08-d73323150b43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:45.656962 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0706c-7caf-4502-8c08-d73323150b43 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:45.687635 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 890/1809] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:40:45 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:45.689136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea143d2-5169-480f-a84d-21a78692129e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:45.700222 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea143d2-5169-480f-a84d-21a78692129e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:45.771433 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168dc33-e9da-4f30-9d6e-049603ae51a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:45.772495 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168dc33-e9da-4f30-9d6e-049603ae51a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:45.773012 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168dc33-e9da-4f30-9d6e-049603ae51a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:45.773664 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168dc33-e9da-4f30-9d6e-049603ae51a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:45.774517 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168dc33-e9da-4f30-9d6e-049603ae51a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:45.776613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168dc33-e9da-4f30-9d6e-049603ae51a5 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:45.797646 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 920/1810] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:40:45 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:40:45.801747 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0706c-7caf-4502-8c08-d73323150b43 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:45.814202 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0706c-7caf-4502-8c08-d73323150b43 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:45.819710 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8331faf-9b3e-418a-9b0e-c4529b3a0377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:45.820383 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8331faf-9b3e-418a-9b0e-c4529b3a0377 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:45.820701 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8331faf-9b3e-418a-9b0e-c4529b3a0377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:45.820980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8331faf-9b3e-418a-9b0e-c4529b3a0377 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:45.821704 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8331faf-9b3e-418a-9b0e-c4529b3a0377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:45.823322 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8331faf-9b3e-418a-9b0e-c4529b3a0377 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:45.838672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 891/1811] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:40:45.839999 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168dc33-e9da-4f30-9d6e-049603ae51a5 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:45.850915 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168dc33-e9da-4f30-9d6e-049603ae51a5 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:45.856029 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59be548-de21-40bf-b3fd-d0b68e9c4952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:45.857308 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59be548-de21-40bf-b3fd-d0b68e9c4952 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:45.857612 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59be548-de21-40bf-b3fd-d0b68e9c4952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:45.857950 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59be548-de21-40bf-b3fd-d0b68e9c4952 admin admin] PATH_INFO: `/v3/projects/27d8c5caa3cc4614a70bb8c0038e8667/users/1f452d4da8314ef98865f338b7b4f885/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:45.860206 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd638fa6-40e4-47ae-aa12-4bfea953f93e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:45.860585 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd638fa6-40e4-47ae-aa12-4bfea953f93e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:45.860931 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd638fa6-40e4-47ae-aa12-4bfea953f93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:45.876035 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59be548-de21-40bf-b3fd-d0b68e9c4952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d8c5caa3cc4614a70bb8c0038e8667, user_id=1f452d4da8314ef98865f338b7b4f885, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:45.879559 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59be548-de21-40bf-b3fd-d0b68e9c4952 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:45.889571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-fd638fa6-40e4-47ae-aa12-4bfea953f93e None None] MFA Rules not processed for user `7481d5fcc72b448f985d127ee4d62fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:45.890917 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fd638fa6-40e4-47ae-aa12-4bfea953f93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:45.897014 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 921/1812] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:40:45 2022] PUT /identity/v3/projects/27d8c5caa3cc4614a70bb8c0038e8667/users/1f452d4da8314ef98865f338b7b4f885/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:40:45.899099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59be548-de21-40bf-b3fd-d0b68e9c4952 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:45.904431 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:45.984345 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 892/1813] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:40:45.988519 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59be548-de21-40bf-b3fd-d0b68e9c4952 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:45.989417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd638fa6-40e4-47ae-aa12-4bfea953f93e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:45.993499 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fd638fa6-40e4-47ae-aa12-4bfea953f93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:46.013836 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674b439-dd40-47b2-9ec2-050dc40d0594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:46.014520 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674b439-dd40-47b2-9ec2-050dc40d0594 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:46.014842 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674b439-dd40-47b2-9ec2-050dc40d0594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:46.015112 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674b439-dd40-47b2-9ec2-050dc40d0594 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:46.015834 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674b439-dd40-47b2-9ec2-050dc40d0594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:46.017588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674b439-dd40-47b2-9ec2-050dc40d0594 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:46.019171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd638fa6-40e4-47ae-aa12-4bfea953f93e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:46.028683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c5d7f-b4df-4178-8403-b64f14e33034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:46.029707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c5d7f-b4df-4178-8403-b64f14e33034 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:46.030023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c5d7f-b4df-4178-8403-b64f14e33034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:46.032829 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c5d7f-b4df-4178-8403-b64f14e33034 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:46.033718 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c5d7f-b4df-4178-8403-b64f14e33034 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:46.035820 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c5d7f-b4df-4178-8403-b64f14e33034 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:46.040384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 922/1814] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:40:46.048860 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674b439-dd40-47b2-9ec2-050dc40d0594 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:46.064863 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674b439-dd40-47b2-9ec2-050dc40d0594 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:46.071794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 893/1815] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:40:45 2022] POST /identity/v3/projects => generated 369 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:46.072963 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c5d7f-b4df-4178-8403-b64f14e33034 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:46.075105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b8dfb-8399-4cea-adfd-779b3db3e357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:46.076010 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b8dfb-8399-4cea-adfd-779b3db3e357 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:46.076296 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b8dfb-8399-4cea-adfd-779b3db3e357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:46.076609 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b8dfb-8399-4cea-adfd-779b3db3e357 admin admin] PATH_INFO: `/v3/projects/27d8c5caa3cc4614a70bb8c0038e8667/users/1f452d4da8314ef98865f338b7b4f885/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:46.079070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b8dfb-8399-4cea-adfd-779b3db3e357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d8c5caa3cc4614a70bb8c0038e8667, user_id=1f452d4da8314ef98865f338b7b4f885, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:46.081859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b8dfb-8399-4cea-adfd-779b3db3e357 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:46.095389 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 923/1816] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:40:46 2022] PUT /identity/v3/projects/27d8c5caa3cc4614a70bb8c0038e8667/users/1f452d4da8314ef98865f338b7b4f885/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:46.107805 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a552f58-a92c-4bd1-919b-1e6546cd098d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:46.108215 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a552f58-a92c-4bd1-919b-1e6546cd098d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:46.109141 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a552f58-a92c-4bd1-919b-1e6546cd098d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:46.137991 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-1a552f58-a92c-4bd1-919b-1e6546cd098d None None] MFA Rules not processed for user `1f452d4da8314ef98865f338b7b4f885`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:46.139209 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1a552f58-a92c-4bd1-919b-1e6546cd098d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:46.158594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c5d7f-b4df-4178-8403-b64f14e33034 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:46.162596 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:46.223337 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd6c63-df43-498b-b6da-e6c5266f4818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:46.227144 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 924/1817] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:40:46.227272 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd6c63-df43-498b-b6da-e6c5266f4818 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:46.227272 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd6c63-df43-498b-b6da-e6c5266f4818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:46.227272 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd6c63-df43-498b-b6da-e6c5266f4818 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:46.227272 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd6c63-df43-498b-b6da-e6c5266f4818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:46.227683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd6c63-df43-498b-b6da-e6c5266f4818 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:46.235458 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a552f58-a92c-4bd1-919b-1e6546cd098d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:46.236850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1a552f58-a92c-4bd1-919b-1e6546cd098d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:46.252751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 894/1818] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:40:46 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:46.256846 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd6c63-df43-498b-b6da-e6c5266f4818 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:46.266898 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd6c63-df43-498b-b6da-e6c5266f4818 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:46.271600 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fdd3b-049c-4a54-b82f-ae890b3b611c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:46.272409 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fdd3b-049c-4a54-b82f-ae890b3b611c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:46.272722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fdd3b-049c-4a54-b82f-ae890b3b611c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:46.273008 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fdd3b-049c-4a54-b82f-ae890b3b611c admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:46.273733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fdd3b-049c-4a54-b82f-ae890b3b611c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:46.275984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fdd3b-049c-4a54-b82f-ae890b3b611c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:46.286331 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 895/1819] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:40:46.290531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fdd3b-049c-4a54-b82f-ae890b3b611c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:46.300914 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a552f58-a92c-4bd1-919b-1e6546cd098d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:46.301067 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fdd3b-049c-4a54-b82f-ae890b3b611c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:46.304449 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e92617-35a8-46c4-9e89-77e4fc05cd96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:46.305124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e92617-35a8-46c4-9e89-77e4fc05cd96 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:46.305407 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e92617-35a8-46c4-9e89-77e4fc05cd96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:46.305548 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397280e6-74cb-4a18-9c89-3d406e25ebf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:46.305690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e92617-35a8-46c4-9e89-77e4fc05cd96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:46.306440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397280e6-74cb-4a18-9c89-3d406e25ebf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:46.306722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397280e6-74cb-4a18-9c89-3d406e25ebf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:46.307038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397280e6-74cb-4a18-9c89-3d406e25ebf9 admin admin] PATH_INFO: `/v3/projects/34ba620ddbc5461a8680dd374d252e87/users/358b47d885c34eecb295abb42d2427bc/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:46.315017 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e92617-35a8-46c4-9e89-77e4fc05cd96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:46.316452 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e92617-35a8-46c4-9e89-77e4fc05cd96 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:46.322966 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397280e6-74cb-4a18-9c89-3d406e25ebf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34ba620ddbc5461a8680dd374d252e87, user_id=358b47d885c34eecb295abb42d2427bc, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:46.325806 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397280e6-74cb-4a18-9c89-3d406e25ebf9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:46.326295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 925/1820] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:40:46.341176 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 896/1821] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:40:46 2022] PUT /identity/v3/projects/34ba620ddbc5461a8680dd374d252e87/users/358b47d885c34eecb295abb42d2427bc/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:40:46.347308 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e92617-35a8-46c4-9e89-77e4fc05cd96 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:46.358411 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e92617-35a8-46c4-9e89-77e4fc05cd96 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:46.359475 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397280e6-74cb-4a18-9c89-3d406e25ebf9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:46.368537 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:46.427015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455237e-c0b3-4311-8f29-b472bb194db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:46.427693 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455237e-c0b3-4311-8f29-b472bb194db6 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:46.427979 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455237e-c0b3-4311-8f29-b472bb194db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:46.428260 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455237e-c0b3-4311-8f29-b472bb194db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:46.429020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455237e-c0b3-4311-8f29-b472bb194db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:46.430655 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455237e-c0b3-4311-8f29-b472bb194db6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:46.431789 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397280e6-74cb-4a18-9c89-3d406e25ebf9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:46.437330 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7853729-db5a-4593-abe2-bdb11db6c22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:46.438351 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7853729-db5a-4593-abe2-bdb11db6c22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:46.438630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7853729-db5a-4593-abe2-bdb11db6c22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:46.438905 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7853729-db5a-4593-abe2-bdb11db6c22d admin admin] PATH_INFO: `/v3/users/631a49978ea14f85839885a1edbd1966` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:46.440115 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7853729-db5a-4593-abe2-bdb11db6c22d admin admin] RBAC: Authorizing `identity:delete_user(user_id=631a49978ea14f85839885a1edbd1966)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:46.441101 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 926/1822] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:40:46.442067 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7853729-db5a-4593-abe2-bdb11db6c22d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:46.445633 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455237e-c0b3-4311-8f29-b472bb194db6 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:46.457700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455237e-c0b3-4311-8f29-b472bb194db6 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:46.462491 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb401a7a-8879-423e-8d97-0f360cfec849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:46.463376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb401a7a-8879-423e-8d97-0f360cfec849 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:46.463663 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb401a7a-8879-423e-8d97-0f360cfec849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:46.463942 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb401a7a-8879-423e-8d97-0f360cfec849 admin admin] PATH_INFO: `/v3/projects/34ba620ddbc5461a8680dd374d252e87/users/358b47d885c34eecb295abb42d2427bc/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:46.466220 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb401a7a-8879-423e-8d97-0f360cfec849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34ba620ddbc5461a8680dd374d252e87, user_id=358b47d885c34eecb295abb42d2427bc, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:46.469782 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb401a7a-8879-423e-8d97-0f360cfec849 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:46.484273 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 927/1823] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:40:46 2022] PUT /identity/v3/projects/34ba620ddbc5461a8680dd374d252e87/users/358b47d885c34eecb295abb42d2427bc/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:40:46.507641 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b7853729-db5a-4593-abe2-bdb11db6c22d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '631a49978ea14f85839885a1edbd1966'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:46.508835 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b7853729-db5a-4593-abe2-bdb11db6c22d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '631a49978ea14f85839885a1edbd1966'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:46.518419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b7853729-db5a-4593-abe2-bdb11db6c22d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '631a49978ea14f85839885a1edbd1966'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:46.519423 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b7853729-db5a-4593-abe2-bdb11db6c22d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '631a49978ea14f85839885a1edbd1966'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:46.530171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b7853729-db5a-4593-abe2-bdb11db6c22d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '631a49978ea14f85839885a1edbd1966'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:46.533020 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:46.572385 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 897/1824] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:40:46 2022] DELETE /identity/v3/users/631a49978ea14f85839885a1edbd1966 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:40:46.576968 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda7ae5-df12-4fc4-88cd-e34868a4d1bb None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:46.577815 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda7ae5-df12-4fc4-88cd-e34868a4d1bb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:46.578065 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda7ae5-df12-4fc4-88cd-e34868a4d1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:46.597053 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-beda7ae5-df12-4fc4-88cd-e34868a4d1bb None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:46.598256 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-beda7ae5-df12-4fc4-88cd-e34868a4d1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:46.666311 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 928/1825] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:40:46.680319 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7853729-db5a-4593-abe2-bdb11db6c22d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:46.681905 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b7853729-db5a-4593-abe2-bdb11db6c22d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:46.747631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7853729-db5a-4593-abe2-bdb11db6c22d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:46.751217 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939281b0-529b-43e4-9f30-9ce5face324c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:46.751867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939281b0-529b-43e4-9f30-9ce5face324c service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:46.752149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939281b0-529b-43e4-9f30-9ce5face324c service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:46.752426 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939281b0-529b-43e4-9f30-9ce5face324c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:46.762520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939281b0-529b-43e4-9f30-9ce5face324c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:46.763979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939281b0-529b-43e4-9f30-9ce5face324c service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:46.775958 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 898/1826] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:47.242244 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda7ae5-df12-4fc4-88cd-e34868a4d1bb None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:47.246120 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-beda7ae5-df12-4fc4-88cd-e34868a4d1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:47.267582 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda7ae5-df12-4fc4-88cd-e34868a4d1bb None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:47.272343 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7494c98-4725-4cdc-b0e8-1fc2f21703b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:47.273263 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7494c98-4725-4cdc-b0e8-1fc2f21703b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:47.273544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7494c98-4725-4cdc-b0e8-1fc2f21703b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:47.273821 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7494c98-4725-4cdc-b0e8-1fc2f21703b9 admin admin] PATH_INFO: `/v3/projects/40477f3013b14c02832a0265a835f425` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:47.275010 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7494c98-4725-4cdc-b0e8-1fc2f21703b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40477f3013b14c02832a0265a835f425)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:47.276981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7494c98-4725-4cdc-b0e8-1fc2f21703b9 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:47.334241 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a7494c98-4725-4cdc-b0e8-1fc2f21703b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40477f3013b14c02832a0265a835f425', 'request_id': 'req-a7494c98-4725-4cdc-b0e8-1fc2f21703b9'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:47.345639 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a7494c98-4725-4cdc-b0e8-1fc2f21703b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40477f3013b14c02832a0265a835f425', 'request_id': 'req-a7494c98-4725-4cdc-b0e8-1fc2f21703b9'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:47.358117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a7494c98-4725-4cdc-b0e8-1fc2f21703b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40477f3013b14c02832a0265a835f425', 'request_id': 'req-a7494c98-4725-4cdc-b0e8-1fc2f21703b9'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:47.372660 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a7494c98-4725-4cdc-b0e8-1fc2f21703b9 admin admin] The token cache is being invalidate because project 40477f3013b14c02832a0265a835f425 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:40:47.373031 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a7494c98-4725-4cdc-b0e8-1fc2f21703b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:47.373609 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a7494c98-4725-4cdc-b0e8-1fc2f21703b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:47.376448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 929/1827] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:40:47 2022] DELETE /identity/v3/projects/40477f3013b14c02832a0265a835f425 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:47.379918 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939281b0-529b-43e4-9f30-9ce5face324c service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:47.390732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939281b0-529b-43e4-9f30-9ce5face324c service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:47.459880 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5464d-b92c-468d-b5d5-673cb2452b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:47.460797 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5464d-b92c-468d-b5d5-673cb2452b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:47.461097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5464d-b92c-468d-b5d5-673cb2452b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:47.461375 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5464d-b92c-468d-b5d5-673cb2452b36 admin admin] PATH_INFO: `/v3/users/1f452d4da8314ef98865f338b7b4f885` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:47.462584 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5464d-b92c-468d-b5d5-673cb2452b36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f452d4da8314ef98865f338b7b4f885)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:47.464556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5464d-b92c-468d-b5d5-673cb2452b36 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:47.517333 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-99c5464d-b92c-468d-b5d5-673cb2452b36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f452d4da8314ef98865f338b7b4f885'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:47.518033 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-99c5464d-b92c-468d-b5d5-673cb2452b36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f452d4da8314ef98865f338b7b4f885'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:47.525220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-99c5464d-b92c-468d-b5d5-673cb2452b36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f452d4da8314ef98865f338b7b4f885'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:47.526029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-99c5464d-b92c-468d-b5d5-673cb2452b36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f452d4da8314ef98865f338b7b4f885'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:47.533850 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-99c5464d-b92c-468d-b5d5-673cb2452b36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f452d4da8314ef98865f338b7b4f885'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:47.553266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 899/1828] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:40:47 2022] DELETE /identity/v3/users/1f452d4da8314ef98865f338b7b4f885 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:40:48.225978 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7494c98-4725-4cdc-b0e8-1fc2f21703b9 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:48.227709 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a7494c98-4725-4cdc-b0e8-1fc2f21703b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:48.264172 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7494c98-4725-4cdc-b0e8-1fc2f21703b9 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:48.317923 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:48.382334 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c76e4-925a-4c00-989f-8979cce43267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:48.383313 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c76e4-925a-4c00-989f-8979cce43267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:48.383656 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c76e4-925a-4c00-989f-8979cce43267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:48.384064 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c76e4-925a-4c00-989f-8979cce43267 admin admin] PATH_INFO: `/v3/projects/27d8c5caa3cc4614a70bb8c0038e8667` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:48.385848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c76e4-925a-4c00-989f-8979cce43267 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d8c5caa3cc4614a70bb8c0038e8667)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:48.388225 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c76e4-925a-4c00-989f-8979cce43267 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:48.501581 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-435c76e4-925a-4c00-989f-8979cce43267 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d8c5caa3cc4614a70bb8c0038e8667', 'request_id': 'req-435c76e4-925a-4c00-989f-8979cce43267'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:48.511627 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-435c76e4-925a-4c00-989f-8979cce43267 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d8c5caa3cc4614a70bb8c0038e8667', 'request_id': 'req-435c76e4-925a-4c00-989f-8979cce43267'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:48.523155 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-435c76e4-925a-4c00-989f-8979cce43267 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d8c5caa3cc4614a70bb8c0038e8667', 'request_id': 'req-435c76e4-925a-4c00-989f-8979cce43267'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:48.537022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-435c76e4-925a-4c00-989f-8979cce43267 admin admin] The token cache is being invalidate because project 27d8c5caa3cc4614a70bb8c0038e8667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:40:48.537431 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-435c76e4-925a-4c00-989f-8979cce43267 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:48.538210 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-435c76e4-925a-4c00-989f-8979cce43267 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:48.545323 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 930/1829] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:40:48 2022] DELETE /identity/v3/projects/27d8c5caa3cc4614a70bb8c0038e8667 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:48.547461 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77cd88-26c5-4d2e-8726-de15e63fa4d6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:48.549318 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77cd88-26c5-4d2e-8726-de15e63fa4d6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:48.549938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77cd88-26c5-4d2e-8726-de15e63fa4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:48.557469 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:48.574397 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1a77cd88-26c5-4d2e-8726-de15e63fa4d6 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:48.576445 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1a77cd88-26c5-4d2e-8726-de15e63fa4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:48.595937 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40588997-ec41-4c9c-a129-fa30a40edfa9 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:48.596435 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40588997-ec41-4c9c-a129-fa30a40edfa9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:48.596919 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40588997-ec41-4c9c-a129-fa30a40edfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:48.662894 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-40588997-ec41-4c9c-a129-fa30a40edfa9 None None] MFA Rules not processed for user `358b47d885c34eecb295abb42d2427bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:48.666691 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-40588997-ec41-4c9c-a129-fa30a40edfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:48.759795 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 900/1830] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:48.766528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38212462-9c02-4a47-84c7-0532722854d5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:48.766952 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38212462-9c02-4a47-84c7-0532722854d5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:48.767326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38212462-9c02-4a47-84c7-0532722854d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:48.821791 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-38212462-9c02-4a47-84c7-0532722854d5 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:48.832151 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-38212462-9c02-4a47-84c7-0532722854d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:48.841511 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 901/1831] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:40:48.845570 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38212462-9c02-4a47-84c7-0532722854d5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:48.857687 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38212462-9c02-4a47-84c7-0532722854d5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:48.863316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edf8b3-6084-44dc-a557-e56c00c89b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:48.863995 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edf8b3-6084-44dc-a557-e56c00c89b82 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:48.864277 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edf8b3-6084-44dc-a557-e56c00c89b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:48.864587 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edf8b3-6084-44dc-a557-e56c00c89b82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:48.865551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15edf8b3-6084-44dc-a557-e56c00c89b82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:40:48.865858 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15edf8b3-6084-44dc-a557-e56c00c89b82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:48.868907 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15edf8b3-6084-44dc-a557-e56c00c89b82 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:48.880573 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 931/1832] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:48 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:48.889808 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 902/1833] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:40:48.890338 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40588997-ec41-4c9c-a129-fa30a40edfa9 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:48.903449 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edf8b3-6084-44dc-a557-e56c00c89b82 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:48.906565 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-15edf8b3-6084-44dc-a557-e56c00c89b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:48.909231 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40588997-ec41-4c9c-a129-fa30a40edfa9 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:48.924308 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d1ad8-c665-4843-9309-069075037dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:48.927857 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d1ad8-c665-4843-9309-069075037dec admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:48.928586 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d1ad8-c665-4843-9309-069075037dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:48.931209 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d1ad8-c665-4843-9309-069075037dec admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:48.932085 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d1ad8-c665-4843-9309-069075037dec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:48.936313 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d1ad8-c665-4843-9309-069075037dec admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:49.000096 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 932/1834] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:40:48 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:49.004586 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d1ad8-c665-4843-9309-069075037dec admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:49.044325 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:49.061081 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edf8b3-6084-44dc-a557-e56c00c89b82 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:49.161078 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d1ad8-c665-4843-9309-069075037dec admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:49.172740 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b9953-ee9e-402e-8540-0f7e30569253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:49.173295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b9953-ee9e-402e-8540-0f7e30569253 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:49.173582 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b9953-ee9e-402e-8540-0f7e30569253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:49.173861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b9953-ee9e-402e-8540-0f7e30569253 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:49.174874 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b9953-ee9e-402e-8540-0f7e30569253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:49.180788 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b9953-ee9e-402e-8540-0f7e30569253 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:49.182581 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e6adb-1cc3-4fd8-a814-805efcbc3d60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:49.183407 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e6adb-1cc3-4fd8-a814-805efcbc3d60 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:49.184935 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e6adb-1cc3-4fd8-a814-805efcbc3d60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:49.185291 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e6adb-1cc3-4fd8-a814-805efcbc3d60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:49.187659 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-838e6adb-1cc3-4fd8-a814-805efcbc3d60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:49.226260 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 933/1835] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:40:49 2022] POST /identity/v3/users => generated 290 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:40:49.231713 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b9953-ee9e-402e-8540-0f7e30569253 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:49.245572 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b9953-ee9e-402e-8540-0f7e30569253 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:49.250985 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d72053-7fae-4769-834d-b25c58d146b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:49.251667 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d72053-7fae-4769-834d-b25c58d146b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:49.251953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d72053-7fae-4769-834d-b25c58d146b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:49.252228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d72053-7fae-4769-834d-b25c58d146b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:49.252995 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d72053-7fae-4769-834d-b25c58d146b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:49.254665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d72053-7fae-4769-834d-b25c58d146b8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:49.278576 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:49.281938 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 934/1836] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:40:49.285025 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d72053-7fae-4769-834d-b25c58d146b8 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:49.287094 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e6adb-1cc3-4fd8-a814-805efcbc3d60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:49.288995 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e6adb-1cc3-4fd8-a814-805efcbc3d60 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:49.301159 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 903/1837] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:49.301397 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d72053-7fae-4769-834d-b25c58d146b8 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:49.310908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37935c-c55b-4799-a136-59809b6f4183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:49.311979 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37935c-c55b-4799-a136-59809b6f4183 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:49.312232 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37935c-c55b-4799-a136-59809b6f4183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:49.312640 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37935c-c55b-4799-a136-59809b6f4183 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:49.313367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37935c-c55b-4799-a136-59809b6f4183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:49.314951 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37935c-c55b-4799-a136-59809b6f4183 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:49.344898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 935/1838] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:40:49.349340 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e6adb-1cc3-4fd8-a814-805efcbc3d60 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:49.369471 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e6adb-1cc3-4fd8-a814-805efcbc3d60 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:49.389391 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5fd4e-74f8-4825-9b9f-2298d0855d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:49.390325 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5fd4e-74f8-4825-9b9f-2298d0855d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:49.390608 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5fd4e-74f8-4825-9b9f-2298d0855d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:49.390885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5fd4e-74f8-4825-9b9f-2298d0855d34 admin admin] PATH_INFO: `/v3/projects/e602f50f596b4bc1900d29fecb3d7a7f/users/9c880339e73546dca769fb93e5b0d99b/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:49.418207 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5fd4e-74f8-4825-9b9f-2298d0855d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e602f50f596b4bc1900d29fecb3d7a7f, user_id=9c880339e73546dca769fb93e5b0d99b, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:49.424450 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5fd4e-74f8-4825-9b9f-2298d0855d34 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:49.450794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 904/1839] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:40:49 2022] PUT /identity/v3/projects/e602f50f596b4bc1900d29fecb3d7a7f/users/9c880339e73546dca769fb93e5b0d99b/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:49.463748 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e8a78-2687-49f0-a8ce-5d89359b2626 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:49.464273 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e8a78-2687-49f0-a8ce-5d89359b2626 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:49.464776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e8a78-2687-49f0-a8ce-5d89359b2626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:49.529712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d25e8a78-2687-49f0-a8ce-5d89359b2626 None None] MFA Rules not processed for user `9c880339e73546dca769fb93e5b0d99b`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:49.531858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d25e8a78-2687-49f0-a8ce-5d89359b2626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:49.635510 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 936/1840] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:49.640776 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5fd4e-74f8-4825-9b9f-2298d0855d34 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:49.725929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5fd4e-74f8-4825-9b9f-2298d0855d34 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:49.732773 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc9a3d-4fbc-456a-86bb-c91fb6fd70c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:49.733831 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc9a3d-4fbc-456a-86bb-c91fb6fd70c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:49.734766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc9a3d-4fbc-456a-86bb-c91fb6fd70c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:49.735043 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc9a3d-4fbc-456a-86bb-c91fb6fd70c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:49.735748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc9a3d-4fbc-456a-86bb-c91fb6fd70c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:49.737716 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc9a3d-4fbc-456a-86bb-c91fb6fd70c1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:49.788303 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 905/1841] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:40:49 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:49.793523 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e8a78-2687-49f0-a8ce-5d89359b2626 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:49.830125 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e8a78-2687-49f0-a8ce-5d89359b2626 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:50.005171 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fe110-0c53-4df9-af5f-9ed2a5655f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:50.007070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fe110-0c53-4df9-af5f-9ed2a5655f25 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:50.008621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fe110-0c53-4df9-af5f-9ed2a5655f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:50.009845 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fe110-0c53-4df9-af5f-9ed2a5655f25 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:50.014449 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31fe110-0c53-4df9-af5f-9ed2a5655f25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:50.030929 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31fe110-0c53-4df9-af5f-9ed2a5655f25 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:50.075233 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:50.086020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 937/1842] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:40:49 2022] POST /identity/v3/users => generated 297 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:50.091502 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc9a3d-4fbc-456a-86bb-c91fb6fd70c1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:50.109239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc9a3d-4fbc-456a-86bb-c91fb6fd70c1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:50.125572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c11d7-91e9-4df9-aa40-f38631bc5caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:50.126509 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c11d7-91e9-4df9-aa40-f38631bc5caf admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:50.127037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c11d7-91e9-4df9-aa40-f38631bc5caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:50.128139 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c11d7-91e9-4df9-aa40-f38631bc5caf admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:50.129141 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c11d7-91e9-4df9-aa40-f38631bc5caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:50.135317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c11d7-91e9-4df9-aa40-f38631bc5caf admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:50.155649 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 906/1843] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:40:50.157201 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fe110-0c53-4df9-af5f-9ed2a5655f25 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:50.171518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fe110-0c53-4df9-af5f-9ed2a5655f25 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:50.178525 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728cf5b9-2f6f-4ac4-a3e6-25522f545f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:50.180286 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cf5b9-2f6f-4ac4-a3e6-25522f545f80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:50.180765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cf5b9-2f6f-4ac4-a3e6-25522f545f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:50.181266 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cf5b9-2f6f-4ac4-a3e6-25522f545f80 admin admin] PATH_INFO: `/v3/projects/02555e3716e3474db131e360b3112c27/users/c95c745331de47bfb555f0a2769f2b86/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:50.217125 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728cf5b9-2f6f-4ac4-a3e6-25522f545f80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02555e3716e3474db131e360b3112c27, user_id=c95c745331de47bfb555f0a2769f2b86, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:50.226297 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728cf5b9-2f6f-4ac4-a3e6-25522f545f80 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:50.245524 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 938/1844] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:40:50 2022] PUT /identity/v3/projects/02555e3716e3474db131e360b3112c27/users/c95c745331de47bfb555f0a2769f2b86/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:50.250468 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c11d7-91e9-4df9-aa40-f38631bc5caf admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:50.271811 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c11d7-91e9-4df9-aa40-f38631bc5caf admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:50.398718 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7060400-c17a-480e-83b8-c74ca9b62c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:50.399676 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7060400-c17a-480e-83b8-c74ca9b62c51 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:50.400163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7060400-c17a-480e-83b8-c74ca9b62c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:50.400630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7060400-c17a-480e-83b8-c74ca9b62c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:50.403046 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7060400-c17a-480e-83b8-c74ca9b62c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:50.406154 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7060400-c17a-480e-83b8-c74ca9b62c51 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:50.440657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 907/1845] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:40:50.444931 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728cf5b9-2f6f-4ac4-a3e6-25522f545f80 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:50.481017 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728cf5b9-2f6f-4ac4-a3e6-25522f545f80 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:50.491071 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97a108-30f9-4c49-9936-136ecf1035e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:50.491983 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97a108-30f9-4c49-9936-136ecf1035e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:50.492273 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97a108-30f9-4c49-9936-136ecf1035e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:50.493085 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97a108-30f9-4c49-9936-136ecf1035e3 admin admin] PATH_INFO: `/v3/projects/02555e3716e3474db131e360b3112c27/users/c95c745331de47bfb555f0a2769f2b86/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:50.495132 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97a108-30f9-4c49-9936-136ecf1035e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02555e3716e3474db131e360b3112c27, user_id=c95c745331de47bfb555f0a2769f2b86, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:50.497878 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97a108-30f9-4c49-9936-136ecf1035e3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:50.511044 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 939/1846] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:40:50 2022] PUT /identity/v3/projects/02555e3716e3474db131e360b3112c27/users/c95c745331de47bfb555f0a2769f2b86/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:50.522314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c18fb3-5a52-4507-b1cc-ce097fffa511 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:50.522594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c18fb3-5a52-4507-b1cc-ce097fffa511 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:50.522878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c18fb3-5a52-4507-b1cc-ce097fffa511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:50.567301 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f8c18fb3-5a52-4507-b1cc-ce097fffa511 None None] MFA Rules not processed for user `c95c745331de47bfb555f0a2769f2b86`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:50.568692 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f8c18fb3-5a52-4507-b1cc-ce097fffa511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:50.601951 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:50.665703 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 908/1847] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:50.679551 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97a108-30f9-4c49-9936-136ecf1035e3 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:50.681535 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9b97a108-30f9-4c49-9936-136ecf1035e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:50.753026 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97a108-30f9-4c49-9936-136ecf1035e3 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:50.758953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67d0f0-8931-4c79-b0d0-e9c0f25415da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:50.759851 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67d0f0-8931-4c79-b0d0-e9c0f25415da service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:50.760094 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67d0f0-8931-4c79-b0d0-e9c0f25415da service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:50.760614 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67d0f0-8931-4c79-b0d0-e9c0f25415da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:50.774451 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67d0f0-8931-4c79-b0d0-e9c0f25415da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:50.775902 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67d0f0-8931-4c79-b0d0-e9c0f25415da service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:50.787990 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 940/1848] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:51.040568 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c18fb3-5a52-4507-b1cc-ce097fffa511 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:51.052493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c18fb3-5a52-4507-b1cc-ce097fffa511 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:51.061699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba570d-c8ff-4824-b2f5-063c3fa58803 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:51.062933 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba570d-c8ff-4824-b2f5-063c3fa58803 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:51.063407 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba570d-c8ff-4824-b2f5-063c3fa58803 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:51.063875 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba570d-c8ff-4824-b2f5-063c3fa58803 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:51.193307 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba570d-c8ff-4824-b2f5-063c3fa58803 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:51.195477 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba570d-c8ff-4824-b2f5-063c3fa58803 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:51.211417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 909/1849] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:51 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:51.227299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67d0f0-8931-4c79-b0d0-e9c0f25415da service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:51.237577 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67d0f0-8931-4c79-b0d0-e9c0f25415da service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:51.242697 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09fe13-2e7e-404c-80a8-63a21c3d1202 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95c745331de47bfb555f0a2769f2b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02555e3716e3474db131e360b3112c27', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:51.243431 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09fe13-2e7e-404c-80a8-63a21c3d1202 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:51.243431 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09fe13-2e7e-404c-80a8-63a21c3d1202 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:51.243630 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09fe13-2e7e-404c-80a8-63a21c3d1202 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:51.244540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09fe13-2e7e-404c-80a8-63a21c3d1202 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:40:51.244724 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09fe13-2e7e-404c-80a8-63a21c3d1202 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:51.246548 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09fe13-2e7e-404c-80a8-63a21c3d1202 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:51.265999 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 941/1850] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:40:51.272259 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba570d-c8ff-4824-b2f5-063c3fa58803 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:51.288860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba570d-c8ff-4824-b2f5-063c3fa58803 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:51.304244 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af0d32-dc91-48d1-a914-c6b3bedf6c79 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95c745331de47bfb555f0a2769f2b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02555e3716e3474db131e360b3112c27', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:51.304244 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af0d32-dc91-48d1-a914-c6b3bedf6c79 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:51.304690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af0d32-dc91-48d1-a914-c6b3bedf6c79 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:51.311342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af0d32-dc91-48d1-a914-c6b3bedf6c79 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:51.313117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af0d32-dc91-48d1-a914-c6b3bedf6c79 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:51.314949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af0d32-dc91-48d1-a914-c6b3bedf6c79 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:51.357826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 910/1851] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:40:51 2022] POST /identity/v3/projects => generated 355 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:51.362025 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09fe13-2e7e-404c-80a8-63a21c3d1202 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:51.374952 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09fe13-2e7e-404c-80a8-63a21c3d1202 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:51.460976 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f165c3f-9bce-4d93-b071-339bb478d52a tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95c745331de47bfb555f0a2769f2b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02555e3716e3474db131e360b3112c27', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:51.461661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f165c3f-9bce-4d93-b071-339bb478d52a tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:51.461958 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f165c3f-9bce-4d93-b071-339bb478d52a tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:51.462242 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f165c3f-9bce-4d93-b071-339bb478d52a tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:51.463145 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f165c3f-9bce-4d93-b071-339bb478d52a tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:40:51.463347 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f165c3f-9bce-4d93-b071-339bb478d52a tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:51.465010 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f165c3f-9bce-4d93-b071-339bb478d52a tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:51.484868 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 942/1852] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:40:51.537462 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af0d32-dc91-48d1-a914-c6b3bedf6c79 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:51.550200 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af0d32-dc91-48d1-a914-c6b3bedf6c79 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:51.555586 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61693b86-b9a9-4ee8-a45e-4e46b9f9b615 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95c745331de47bfb555f0a2769f2b86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02555e3716e3474db131e360b3112c27', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:51.556579 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61693b86-b9a9-4ee8-a45e-4e46b9f9b615 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:51.556974 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61693b86-b9a9-4ee8-a45e-4e46b9f9b615 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:51.557322 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61693b86-b9a9-4ee8-a45e-4e46b9f9b615 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] PATH_INFO: `/v3/projects/a7fb733c0ae94110aaa6ba6913028781` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:51.558623 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61693b86-b9a9-4ee8-a45e-4e46b9f9b615 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a7fb733c0ae94110aaa6ba6913028781)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:51.560982 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61693b86-b9a9-4ee8-a45e-4e46b9f9b615 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:51.674482 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-61693b86-b9a9-4ee8-a45e-4e46b9f9b615 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7fb733c0ae94110aaa6ba6913028781', 'request_id': 'req-61693b86-b9a9-4ee8-a45e-4e46b9f9b615'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:51.692335 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-61693b86-b9a9-4ee8-a45e-4e46b9f9b615 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7fb733c0ae94110aaa6ba6913028781', 'request_id': 'req-61693b86-b9a9-4ee8-a45e-4e46b9f9b615'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:51.700611 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-61693b86-b9a9-4ee8-a45e-4e46b9f9b615 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7fb733c0ae94110aaa6ba6913028781', 'request_id': 'req-61693b86-b9a9-4ee8-a45e-4e46b9f9b615'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:51.724008 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-61693b86-b9a9-4ee8-a45e-4e46b9f9b615 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] The token cache is being invalidate because project a7fb733c0ae94110aaa6ba6913028781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:40:51.724309 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-61693b86-b9a9-4ee8-a45e-4e46b9f9b615 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:51.725232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-61693b86-b9a9-4ee8-a45e-4e46b9f9b615 tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:51.727519 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 911/1853] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:40:51 2022] DELETE /identity/v3/projects/a7fb733c0ae94110aaa6ba6913028781 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:52.005776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f165c3f-9bce-4d93-b071-339bb478d52a tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:52.007907 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2f165c3f-9bce-4d93-b071-339bb478d52a tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:52.095854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:52.116866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f165c3f-9bce-4d93-b071-339bb478d52a tempest-VolumeQuotaClassesTest-1594058888 tempest-VolumeQuotaClassesTest-1594058888-project-admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:52.212302 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bd033-163b-42b2-a661-a9475f5a7536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:52.213446 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bd033-163b-42b2-a661-a9475f5a7536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:52.213739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bd033-163b-42b2-a661-a9475f5a7536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:52.214020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bd033-163b-42b2-a661-a9475f5a7536 admin admin] PATH_INFO: `/v3/users/9c880339e73546dca769fb93e5b0d99b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:52.216158 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bd033-163b-42b2-a661-a9475f5a7536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c880339e73546dca769fb93e5b0d99b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:52.219053 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bd033-163b-42b2-a661-a9475f5a7536 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:52.292111 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-023bd033-163b-42b2-a661-a9475f5a7536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c880339e73546dca769fb93e5b0d99b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:52.304188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-023bd033-163b-42b2-a661-a9475f5a7536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c880339e73546dca769fb93e5b0d99b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:52.305663 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-023bd033-163b-42b2-a661-a9475f5a7536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c880339e73546dca769fb93e5b0d99b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:52.313843 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-023bd033-163b-42b2-a661-a9475f5a7536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c880339e73546dca769fb93e5b0d99b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:52.314791 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-023bd033-163b-42b2-a661-a9475f5a7536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c880339e73546dca769fb93e5b0d99b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:52.329950 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 943/1854] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:40:52 2022] DELETE /identity/v3/users/9c880339e73546dca769fb93e5b0d99b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:52.334515 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07273198-2ed8-4b93-bb3a-b83198caf530 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:52.334797 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07273198-2ed8-4b93-bb3a-b83198caf530 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:52.335090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07273198-2ed8-4b93-bb3a-b83198caf530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:52.352860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-07273198-2ed8-4b93-bb3a-b83198caf530 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:52.354088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-07273198-2ed8-4b93-bb3a-b83198caf530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:52.367051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:52.428202 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 912/1855] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:52.434835 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bd033-163b-42b2-a661-a9475f5a7536 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:52.436236 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-023bd033-163b-42b2-a661-a9475f5a7536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:52.498128 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bd033-163b-42b2-a661-a9475f5a7536 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:52.502876 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5264077-3b5f-42e5-9340-a659f637078e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:52.503641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5264077-3b5f-42e5-9340-a659f637078e service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:52.503929 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5264077-3b5f-42e5-9340-a659f637078e service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:52.504241 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5264077-3b5f-42e5-9340-a659f637078e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:52.514047 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5264077-3b5f-42e5-9340-a659f637078e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:52.515522 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5264077-3b5f-42e5-9340-a659f637078e service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:52.525589 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 944/1856] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:52.925756 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07273198-2ed8-4b93-bb3a-b83198caf530 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:52.927855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-07273198-2ed8-4b93-bb3a-b83198caf530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:52.941601 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07273198-2ed8-4b93-bb3a-b83198caf530 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:52.946450 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee3516-84c4-4bf3-82cd-d301fe93d6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:52.947305 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee3516-84c4-4bf3-82cd-d301fe93d6cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:52.947588 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee3516-84c4-4bf3-82cd-d301fe93d6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:52.947861 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee3516-84c4-4bf3-82cd-d301fe93d6cd admin admin] PATH_INFO: `/v3/projects/e602f50f596b4bc1900d29fecb3d7a7f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:52.949068 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee3516-84c4-4bf3-82cd-d301fe93d6cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e602f50f596b4bc1900d29fecb3d7a7f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:52.951002 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee3516-84c4-4bf3-82cd-d301fe93d6cd admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:53.006470 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cbee3516-84c4-4bf3-82cd-d301fe93d6cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e602f50f596b4bc1900d29fecb3d7a7f', 'request_id': 'req-cbee3516-84c4-4bf3-82cd-d301fe93d6cd'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:53.014629 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cbee3516-84c4-4bf3-82cd-d301fe93d6cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e602f50f596b4bc1900d29fecb3d7a7f', 'request_id': 'req-cbee3516-84c4-4bf3-82cd-d301fe93d6cd'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:53.020618 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cbee3516-84c4-4bf3-82cd-d301fe93d6cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e602f50f596b4bc1900d29fecb3d7a7f', 'request_id': 'req-cbee3516-84c4-4bf3-82cd-d301fe93d6cd'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:53.032465 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cbee3516-84c4-4bf3-82cd-d301fe93d6cd admin admin] The token cache is being invalidate because project e602f50f596b4bc1900d29fecb3d7a7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:40:53.032779 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cbee3516-84c4-4bf3-82cd-d301fe93d6cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:53.033443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cbee3516-84c4-4bf3-82cd-d301fe93d6cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:53.034996 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 913/1857] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:40:52 2022] DELETE /identity/v3/projects/e602f50f596b4bc1900d29fecb3d7a7f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:53.038968 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5264077-3b5f-42e5-9340-a659f637078e service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:53.049406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5264077-3b5f-42e5-9340-a659f637078e service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:53.061182 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:53.124479 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d990d2-7f57-4e1a-9b11-9ffae07f5e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:53.125483 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d990d2-7f57-4e1a-9b11-9ffae07f5e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:53.125764 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d990d2-7f57-4e1a-9b11-9ffae07f5e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:53.126063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d990d2-7f57-4e1a-9b11-9ffae07f5e82 admin admin] PATH_INFO: `/v3/users/c95c745331de47bfb555f0a2769f2b86` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:53.127664 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d990d2-7f57-4e1a-9b11-9ffae07f5e82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c95c745331de47bfb555f0a2769f2b86)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:53.129718 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d990d2-7f57-4e1a-9b11-9ffae07f5e82 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:53.180005 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b5d990d2-7f57-4e1a-9b11-9ffae07f5e82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c95c745331de47bfb555f0a2769f2b86'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:53.191673 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b5d990d2-7f57-4e1a-9b11-9ffae07f5e82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c95c745331de47bfb555f0a2769f2b86'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:53.192343 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b5d990d2-7f57-4e1a-9b11-9ffae07f5e82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c95c745331de47bfb555f0a2769f2b86'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:53.199511 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b5d990d2-7f57-4e1a-9b11-9ffae07f5e82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c95c745331de47bfb555f0a2769f2b86'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:53.200163 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b5d990d2-7f57-4e1a-9b11-9ffae07f5e82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c95c745331de47bfb555f0a2769f2b86'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:53.213468 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 945/1858] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:40:53 2022] DELETE /identity/v3/users/c95c745331de47bfb555f0a2769f2b86 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:40:53.508233 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee3516-84c4-4bf3-82cd-d301fe93d6cd admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:53.509989 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cbee3516-84c4-4bf3-82cd-d301fe93d6cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:53.533727 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee3516-84c4-4bf3-82cd-d301fe93d6cd admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:53.605849 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e164656-eb1f-4cfe-8ac1-368a6b5e4704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:53.606818 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e164656-eb1f-4cfe-8ac1-368a6b5e4704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:53.606998 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e164656-eb1f-4cfe-8ac1-368a6b5e4704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:53.607257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e164656-eb1f-4cfe-8ac1-368a6b5e4704 admin admin] PATH_INFO: `/v3/projects/02555e3716e3474db131e360b3112c27` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:53.609076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e164656-eb1f-4cfe-8ac1-368a6b5e4704 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02555e3716e3474db131e360b3112c27)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:53.610998 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e164656-eb1f-4cfe-8ac1-368a6b5e4704 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:53.657573 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:53.661865 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7e164656-eb1f-4cfe-8ac1-368a6b5e4704 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02555e3716e3474db131e360b3112c27', 'request_id': 'req-7e164656-eb1f-4cfe-8ac1-368a6b5e4704'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:53.669013 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7e164656-eb1f-4cfe-8ac1-368a6b5e4704 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02555e3716e3474db131e360b3112c27', 'request_id': 'req-7e164656-eb1f-4cfe-8ac1-368a6b5e4704'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:53.675818 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7e164656-eb1f-4cfe-8ac1-368a6b5e4704 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02555e3716e3474db131e360b3112c27', 'request_id': 'req-7e164656-eb1f-4cfe-8ac1-368a6b5e4704'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:53.688344 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7e164656-eb1f-4cfe-8ac1-368a6b5e4704 admin admin] The token cache is being invalidate because project 02555e3716e3474db131e360b3112c27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:40:53.688675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7e164656-eb1f-4cfe-8ac1-368a6b5e4704 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:53.689335 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7e164656-eb1f-4cfe-8ac1-368a6b5e4704 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:40:53.690884 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 914/1859] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:40:53 2022] DELETE /identity/v3/projects/02555e3716e3474db131e360b3112c27 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:53.696034 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cd8ee-d13d-47c6-bf9f-a4eddb4873fe None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:53.696482 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cd8ee-d13d-47c6-bf9f-a4eddb4873fe None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:53.696802 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cd8ee-d13d-47c6-bf9f-a4eddb4873fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:53.716596 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ce1cd8ee-d13d-47c6-bf9f-a4eddb4873fe None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:53.717918 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ce1cd8ee-d13d-47c6-bf9f-a4eddb4873fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:53.776773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 946/1860] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:53.784591 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68444909-27d8-4772-9e44-814c13f6468f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:53.784870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68444909-27d8-4772-9e44-814c13f6468f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:53.785152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68444909-27d8-4772-9e44-814c13f6468f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:53.803540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-68444909-27d8-4772-9e44-814c13f6468f None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:53.804784 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-68444909-27d8-4772-9e44-814c13f6468f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:53.813395 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 915/1861] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:53.817430 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1cd8ee-d13d-47c6-bf9f-a4eddb4873fe None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:53.827147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1cd8ee-d13d-47c6-bf9f-a4eddb4873fe None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:53.832275 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c008643-bf2e-4d10-894b-d0581c369fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:53.832955 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c008643-bf2e-4d10-894b-d0581c369fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:53.833241 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c008643-bf2e-4d10-894b-d0581c369fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:53.833517 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c008643-bf2e-4d10-894b-d0581c369fb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:53.834232 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c008643-bf2e-4d10-894b-d0581c369fb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:40:53.834539 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c008643-bf2e-4d10-894b-d0581c369fb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:53.836129 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c008643-bf2e-4d10-894b-d0581c369fb7 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:53.847488 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 947/1862] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:40:53.851655 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68444909-27d8-4772-9e44-814c13f6468f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:53.861270 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68444909-27d8-4772-9e44-814c13f6468f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:53.865840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf3e1b-79a9-44d9-8e1e-18b82a06198c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:53.866470 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf3e1b-79a9-44d9-8e1e-18b82a06198c admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:53.866759 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf3e1b-79a9-44d9-8e1e-18b82a06198c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:53.867032 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf3e1b-79a9-44d9-8e1e-18b82a06198c admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:53.867713 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf3e1b-79a9-44d9-8e1e-18b82a06198c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:53.869671 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf3e1b-79a9-44d9-8e1e-18b82a06198c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:53.895062 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 916/1863] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:40:53 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:53.899059 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c008643-bf2e-4d10-894b-d0581c369fb7 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:53.908882 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c008643-bf2e-4d10-894b-d0581c369fb7 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:53.927207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:53.965345 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebcdf1-10f0-411a-85fa-98cbc81ee68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:53.966000 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebcdf1-10f0-411a-85fa-98cbc81ee68b admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:53.966277 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebcdf1-10f0-411a-85fa-98cbc81ee68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:53.966548 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebcdf1-10f0-411a-85fa-98cbc81ee68b admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:53.967218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebcdf1-10f0-411a-85fa-98cbc81ee68b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:53.969185 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebcdf1-10f0-411a-85fa-98cbc81ee68b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:53.988790 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 948/1864] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:40:53 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:53.994303 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf3e1b-79a9-44d9-8e1e-18b82a06198c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:54.005352 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf3e1b-79a9-44d9-8e1e-18b82a06198c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:54.009946 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c41e53-6521-4888-b03c-e0036d111e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:54.010599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c41e53-6521-4888-b03c-e0036d111e15 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:54.010885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c41e53-6521-4888-b03c-e0036d111e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:54.011160 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c41e53-6521-4888-b03c-e0036d111e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:54.011881 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c41e53-6521-4888-b03c-e0036d111e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:54.013510 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c41e53-6521-4888-b03c-e0036d111e15 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:54.027031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 917/1865] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:40:54.028164 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebcdf1-10f0-411a-85fa-98cbc81ee68b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:54.038093 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebcdf1-10f0-411a-85fa-98cbc81ee68b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:54.042745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69876cba-555b-45ec-bb79-1048f4d0c9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:54.043402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69876cba-555b-45ec-bb79-1048f4d0c9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:54.043684 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69876cba-555b-45ec-bb79-1048f4d0c9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:54.043965 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69876cba-555b-45ec-bb79-1048f4d0c9c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:54.044717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69876cba-555b-45ec-bb79-1048f4d0c9c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:54.046841 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69876cba-555b-45ec-bb79-1048f4d0c9c9 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:54.057172 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 949/1866] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:40:54.061378 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c41e53-6521-4888-b03c-e0036d111e15 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:54.072136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c41e53-6521-4888-b03c-e0036d111e15 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:54.076710 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478efd98-2347-4ad5-a201-5278b1faf694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:54.077634 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478efd98-2347-4ad5-a201-5278b1faf694 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:54.077863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478efd98-2347-4ad5-a201-5278b1faf694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:54.078137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478efd98-2347-4ad5-a201-5278b1faf694 admin admin] PATH_INFO: `/v3/projects/51d86bd4ca114d5ab90e63f95d0f7315/users/9457f8d0d6a441bc92a681d937070e09/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:54.093112 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478efd98-2347-4ad5-a201-5278b1faf694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d86bd4ca114d5ab90e63f95d0f7315, user_id=9457f8d0d6a441bc92a681d937070e09, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:54.095768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478efd98-2347-4ad5-a201-5278b1faf694 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:54.110082 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 918/1867] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:40:54 2022] PUT /identity/v3/projects/51d86bd4ca114d5ab90e63f95d0f7315/users/9457f8d0d6a441bc92a681d937070e09/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:54.120543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c86875-247e-4216-9f56-863379c639c2 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:54.120863 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c86875-247e-4216-9f56-863379c639c2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:54.121177 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c86875-247e-4216-9f56-863379c639c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:54.149163 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-96c86875-247e-4216-9f56-863379c639c2 None None] MFA Rules not processed for user `9457f8d0d6a441bc92a681d937070e09`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:54.150387 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-96c86875-247e-4216-9f56-863379c639c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:54.216137 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 950/1868] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:54.220613 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478efd98-2347-4ad5-a201-5278b1faf694 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:54.285921 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478efd98-2347-4ad5-a201-5278b1faf694 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:54.290695 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe28818-f065-46d3-b23a-5fd563c06962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:54.291352 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe28818-f065-46d3-b23a-5fd563c06962 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:54.291642 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe28818-f065-46d3-b23a-5fd563c06962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:54.291925 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe28818-f065-46d3-b23a-5fd563c06962 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:54.292702 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe28818-f065-46d3-b23a-5fd563c06962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:54.294642 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe28818-f065-46d3-b23a-5fd563c06962 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:54.322790 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 919/1869] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:40:54 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:54.326828 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c86875-247e-4216-9f56-863379c639c2 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:54.337597 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c86875-247e-4216-9f56-863379c639c2 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:54.393062 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af7dd9-4585-4c9a-83d7-5f705e83a477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:54.393712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af7dd9-4585-4c9a-83d7-5f705e83a477 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:54.393994 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af7dd9-4585-4c9a-83d7-5f705e83a477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:54.394269 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af7dd9-4585-4c9a-83d7-5f705e83a477 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:54.394961 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af7dd9-4585-4c9a-83d7-5f705e83a477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:54.396922 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af7dd9-4585-4c9a-83d7-5f705e83a477 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:54.416573 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 951/1870] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:40:54 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:40:54.421529 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe28818-f065-46d3-b23a-5fd563c06962 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:54.432024 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe28818-f065-46d3-b23a-5fd563c06962 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:54.436707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f04ee-0f07-45e3-9220-0b13d089712f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:54.437440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f04ee-0f07-45e3-9220-0b13d089712f admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:54.437931 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f04ee-0f07-45e3-9220-0b13d089712f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:54.438412 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f04ee-0f07-45e3-9220-0b13d089712f admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:54.439644 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f04ee-0f07-45e3-9220-0b13d089712f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:54.442319 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f04ee-0f07-45e3-9220-0b13d089712f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:54.460111 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 920/1871] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:40:54.464354 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af7dd9-4585-4c9a-83d7-5f705e83a477 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:54.474892 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af7dd9-4585-4c9a-83d7-5f705e83a477 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:54.479515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca484b-c6fd-45b4-bfd0-8779f21a80d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:54.480690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca484b-c6fd-45b4-bfd0-8779f21a80d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:54.480968 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca484b-c6fd-45b4-bfd0-8779f21a80d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:54.481273 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca484b-c6fd-45b4-bfd0-8779f21a80d1 admin admin] PATH_INFO: `/v3/projects/edb1372894b5441dbd5a1dc8ecabf39d/users/d45ab9e9c38b4844b03f6b1cdc2275e7/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:54.498745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca484b-c6fd-45b4-bfd0-8779f21a80d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edb1372894b5441dbd5a1dc8ecabf39d, user_id=d45ab9e9c38b4844b03f6b1cdc2275e7, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:54.501685 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca484b-c6fd-45b4-bfd0-8779f21a80d1 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:54.506341 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:54.520131 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 952/1872] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:40:54 2022] PUT /identity/v3/projects/edb1372894b5441dbd5a1dc8ecabf39d/users/d45ab9e9c38b4844b03f6b1cdc2275e7/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:40:54.523941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f04ee-0f07-45e3-9220-0b13d089712f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:54.534769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f04ee-0f07-45e3-9220-0b13d089712f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:54.586421 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:54.601490 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd65fe4-62f6-42d5-acb2-713c55ebc248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:54.601490 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd65fe4-62f6-42d5-acb2-713c55ebc248 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:54.601902 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd65fe4-62f6-42d5-acb2-713c55ebc248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:54.602413 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd65fe4-62f6-42d5-acb2-713c55ebc248 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:54.603232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd65fe4-62f6-42d5-acb2-713c55ebc248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:54.605350 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd65fe4-62f6-42d5-acb2-713c55ebc248 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:54.618045 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 921/1873] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:40:54.622290 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca484b-c6fd-45b4-bfd0-8779f21a80d1 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:54.649015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca484b-c6fd-45b4-bfd0-8779f21a80d1 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:54.658116 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052959cd-a004-4ad9-82e5-74cdcd2653c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:54.659163 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052959cd-a004-4ad9-82e5-74cdcd2653c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:54.659688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052959cd-a004-4ad9-82e5-74cdcd2653c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:54.660061 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052959cd-a004-4ad9-82e5-74cdcd2653c9 admin admin] PATH_INFO: `/v3/projects/edb1372894b5441dbd5a1dc8ecabf39d/users/d45ab9e9c38b4844b03f6b1cdc2275e7/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:54.662771 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052959cd-a004-4ad9-82e5-74cdcd2653c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edb1372894b5441dbd5a1dc8ecabf39d, user_id=d45ab9e9c38b4844b03f6b1cdc2275e7, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:54.666717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052959cd-a004-4ad9-82e5-74cdcd2653c9 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:54.692996 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 953/1874] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:40:54 2022] PUT /identity/v3/projects/edb1372894b5441dbd5a1dc8ecabf39d/users/d45ab9e9c38b4844b03f6b1cdc2275e7/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:40:54.695322 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304f431-6345-483d-b9df-a777572895ed None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:54.695940 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304f431-6345-483d-b9df-a777572895ed None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:54.696226 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304f431-6345-483d-b9df-a777572895ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:54.727906 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6304f431-6345-483d-b9df-a777572895ed None None] MFA Rules not processed for user `d45ab9e9c38b4844b03f6b1cdc2275e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:54.729185 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6304f431-6345-483d-b9df-a777572895ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:54.825017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 922/1875] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:40:54 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:54.837043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052959cd-a004-4ad9-82e5-74cdcd2653c9 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:54.838962 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-052959cd-a004-4ad9-82e5-74cdcd2653c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:54.906408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052959cd-a004-4ad9-82e5-74cdcd2653c9 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:54.910689 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6385333-fef1-40f3-ae15-0b27834b8011 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:54.911543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6385333-fef1-40f3-ae15-0b27834b8011 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:54.911901 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6385333-fef1-40f3-ae15-0b27834b8011 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:54.912247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6385333-fef1-40f3-ae15-0b27834b8011 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:54.923844 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6385333-fef1-40f3-ae15-0b27834b8011 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:54.925399 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6385333-fef1-40f3-ae15-0b27834b8011 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:54.935699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 954/1876] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:54 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:55.019463 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304f431-6345-483d-b9df-a777572895ed None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:55.029597 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304f431-6345-483d-b9df-a777572895ed None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:55.033275 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751ff76-f9ec-45da-8816-9fda68e83f30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:55.033907 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751ff76-f9ec-45da-8816-9fda68e83f30 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:55.034189 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751ff76-f9ec-45da-8816-9fda68e83f30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:55.034459 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751ff76-f9ec-45da-8816-9fda68e83f30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:55.097573 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751ff76-f9ec-45da-8816-9fda68e83f30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:55.099457 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751ff76-f9ec-45da-8816-9fda68e83f30 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:55.109764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 923/1877] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:55 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:40:58.079760 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603c01c-5753-47d0-8ccd-b4983e6d8d20 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:58.080218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603c01c-5753-47d0-8ccd-b4983e6d8d20 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:58.080303 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603c01c-5753-47d0-8ccd-b4983e6d8d20 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:58.081951 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 955/1878] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 30 10:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:40:58.091823 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17951cba-4bd5-40fc-8748-f912b76e6b34 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:58.092238 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17951cba-4bd5-40fc-8748-f912b76e6b34 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:58.092310 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17951cba-4bd5-40fc-8748-f912b76e6b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:58.129959 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-17951cba-4bd5-40fc-8748-f912b76e6b34 None None] MFA Rules not processed for user `1bfd036d747241d9bc314b60bf8648b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:40:58.131162 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-17951cba-4bd5-40fc-8748-f912b76e6b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:58.241932 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:40:58.276074 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 924/1879] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 30 10:40:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:40:58.505853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603c01c-5753-47d0-8ccd-b4983e6d8d20 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:40:58.507873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8603c01c-5753-47d0-8ccd-b4983e6d8d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:40:58.546530 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603c01c-5753-47d0-8ccd-b4983e6d8d20 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:40:58.555793 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68fccd-7864-43f7-9a27-283e0f92b2bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:40:58.556740 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68fccd-7864-43f7-9a27-283e0f92b2bb service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:40:58.557089 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68fccd-7864-43f7-9a27-283e0f92b2bb service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:40:58.557457 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68fccd-7864-43f7-9a27-283e0f92b2bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:40:58.567753 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68fccd-7864-43f7-9a27-283e0f92b2bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:40:58.569584 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68fccd-7864-43f7-9a27-283e0f92b2bb service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:40:58.582850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 956/1880] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:40:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:41:00.347957 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17951cba-4bd5-40fc-8748-f912b76e6b34 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:00.410680 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17951cba-4bd5-40fc-8748-f912b76e6b34 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:00.415243 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b68c4-176a-48e1-a91b-0662148a6de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:00.416109 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b68c4-176a-48e1-a91b-0662148a6de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:00.416396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b68c4-176a-48e1-a91b-0662148a6de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:00.416715 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b68c4-176a-48e1-a91b-0662148a6de5 admin admin] PATH_INFO: `/v3/users/9457f8d0d6a441bc92a681d937070e09` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:00.418006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b68c4-176a-48e1-a91b-0662148a6de5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9457f8d0d6a441bc92a681d937070e09)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:00.420026 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b68c4-176a-48e1-a91b-0662148a6de5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:00.469803 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-287b68c4-176a-48e1-a91b-0662148a6de5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9457f8d0d6a441bc92a681d937070e09'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:00.470533 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-287b68c4-176a-48e1-a91b-0662148a6de5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9457f8d0d6a441bc92a681d937070e09'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:00.481185 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-287b68c4-176a-48e1-a91b-0662148a6de5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9457f8d0d6a441bc92a681d937070e09'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:00.482392 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-287b68c4-176a-48e1-a91b-0662148a6de5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9457f8d0d6a441bc92a681d937070e09'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:00.490396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-287b68c4-176a-48e1-a91b-0662148a6de5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9457f8d0d6a441bc92a681d937070e09'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:00.517634 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 925/1881] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:41:00 2022] DELETE /identity/v3/users/9457f8d0d6a441bc92a681d937070e09 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:00.519317 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ca734-8426-4056-9ac2-a30e3a483e55 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:00.519766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ca734-8426-4056-9ac2-a30e3a483e55 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:00.519958 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ca734-8426-4056-9ac2-a30e3a483e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:00.542425 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-515ca734-8426-4056-9ac2-a30e3a483e55 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:00.543787 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-515ca734-8426-4056-9ac2-a30e3a483e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:00.603281 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 957/1882] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:00.613139 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b68c4-176a-48e1-a91b-0662148a6de5 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:00.614570 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-287b68c4-176a-48e1-a91b-0662148a6de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:00.673278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b68c4-176a-48e1-a91b-0662148a6de5 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:00.676879 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40473f-069c-4bd5-a78b-d8f9b58636e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:00.677520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40473f-069c-4bd5-a78b-d8f9b58636e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:00.677805 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40473f-069c-4bd5-a78b-d8f9b58636e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:00.678086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40473f-069c-4bd5-a78b-d8f9b58636e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:00.687044 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40473f-069c-4bd5-a78b-d8f9b58636e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:00.688870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40473f-069c-4bd5-a78b-d8f9b58636e2 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:00.698535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 926/1883] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:41:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:41:00.837231 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ca734-8426-4056-9ac2-a30e3a483e55 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:00.838678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-515ca734-8426-4056-9ac2-a30e3a483e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:00.851153 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ca734-8426-4056-9ac2-a30e3a483e55 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:00.856088 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83311fc7-6356-4ab2-a9c7-e8bfea344244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:00.857002 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83311fc7-6356-4ab2-a9c7-e8bfea344244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:00.857288 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83311fc7-6356-4ab2-a9c7-e8bfea344244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:00.857562 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83311fc7-6356-4ab2-a9c7-e8bfea344244 admin admin] PATH_INFO: `/v3/users/3ebc319b6fbd44ceb397b6c65054d0cd` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:00.858756 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83311fc7-6356-4ab2-a9c7-e8bfea344244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ebc319b6fbd44ceb397b6c65054d0cd)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:00.860710 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83311fc7-6356-4ab2-a9c7-e8bfea344244 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:00.910503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-83311fc7-6356-4ab2-a9c7-e8bfea344244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ebc319b6fbd44ceb397b6c65054d0cd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:00.922233 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-83311fc7-6356-4ab2-a9c7-e8bfea344244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ebc319b6fbd44ceb397b6c65054d0cd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:00.922955 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-83311fc7-6356-4ab2-a9c7-e8bfea344244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ebc319b6fbd44ceb397b6c65054d0cd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:00.925286 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:00.931002 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-83311fc7-6356-4ab2-a9c7-e8bfea344244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ebc319b6fbd44ceb397b6c65054d0cd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:00.932169 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-83311fc7-6356-4ab2-a9c7-e8bfea344244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ebc319b6fbd44ceb397b6c65054d0cd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:00.945862 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 958/1884] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:41:00 2022] DELETE /identity/v3/users/3ebc319b6fbd44ceb397b6c65054d0cd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:00.950472 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11acda1-5a31-4c57-8349-62856e7e4f6f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:00.950851 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11acda1-5a31-4c57-8349-62856e7e4f6f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:00.951138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11acda1-5a31-4c57-8349-62856e7e4f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:00.974998 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b11acda1-5a31-4c57-8349-62856e7e4f6f None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:00.976937 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b11acda1-5a31-4c57-8349-62856e7e4f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:00.997790 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:01.103720 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 927/1885] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:01.118534 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83311fc7-6356-4ab2-a9c7-e8bfea344244 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:01.120847 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-83311fc7-6356-4ab2-a9c7-e8bfea344244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:01.158076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11acda1-5a31-4c57-8349-62856e7e4f6f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:01.159504 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b11acda1-5a31-4c57-8349-62856e7e4f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:01.172274 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11acda1-5a31-4c57-8349-62856e7e4f6f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:01.180029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8816781-64ce-4a4d-8471-af7e77f1dec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:01.180931 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8816781-64ce-4a4d-8471-af7e77f1dec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:01.181350 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8816781-64ce-4a4d-8471-af7e77f1dec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:01.181471 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8816781-64ce-4a4d-8471-af7e77f1dec2 admin admin] PATH_INFO: `/v3/projects/51d86bd4ca114d5ab90e63f95d0f7315` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:01.182783 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8816781-64ce-4a4d-8471-af7e77f1dec2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51d86bd4ca114d5ab90e63f95d0f7315)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:01.185291 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8816781-64ce-4a4d-8471-af7e77f1dec2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:01.249546 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83311fc7-6356-4ab2-a9c7-e8bfea344244 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:01.266609 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcf70e-99ea-4180-b544-d51851bb3c1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:01.267632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcf70e-99ea-4180-b544-d51851bb3c1a service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:01.268077 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcf70e-99ea-4180-b544-d51851bb3c1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:01.268801 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcf70e-99ea-4180-b544-d51851bb3c1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:01.277686 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d8816781-64ce-4a4d-8471-af7e77f1dec2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51d86bd4ca114d5ab90e63f95d0f7315', 'request_id': 'req-d8816781-64ce-4a4d-8471-af7e77f1dec2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:01.294002 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcf70e-99ea-4180-b544-d51851bb3c1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:01.296537 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcf70e-99ea-4180-b544-d51851bb3c1a service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:01.299907 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d8816781-64ce-4a4d-8471-af7e77f1dec2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51d86bd4ca114d5ab90e63f95d0f7315', 'request_id': 'req-d8816781-64ce-4a4d-8471-af7e77f1dec2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:01.307435 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d8816781-64ce-4a4d-8471-af7e77f1dec2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51d86bd4ca114d5ab90e63f95d0f7315', 'request_id': 'req-d8816781-64ce-4a4d-8471-af7e77f1dec2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:01.309932 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 959/1886] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:41:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:41:01.327502 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d8816781-64ce-4a4d-8471-af7e77f1dec2 admin admin] The token cache is being invalidate because project 51d86bd4ca114d5ab90e63f95d0f7315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:41:01.327983 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d8816781-64ce-4a4d-8471-af7e77f1dec2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:01.329329 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d8816781-64ce-4a4d-8471-af7e77f1dec2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:01.332667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 928/1887] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:41:01 2022] DELETE /identity/v3/projects/51d86bd4ca114d5ab90e63f95d0f7315 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:41:01.336991 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcf70e-99ea-4180-b544-d51851bb3c1a service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:01.353760 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcf70e-99ea-4180-b544-d51851bb3c1a service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:01.421267 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d83268-ee88-4f58-845f-6085601c7501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:01.422352 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d83268-ee88-4f58-845f-6085601c7501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:01.422643 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d83268-ee88-4f58-845f-6085601c7501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:01.422922 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d83268-ee88-4f58-845f-6085601c7501 admin admin] PATH_INFO: `/v3/users/d45ab9e9c38b4844b03f6b1cdc2275e7` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:01.424559 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d83268-ee88-4f58-845f-6085601c7501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d45ab9e9c38b4844b03f6b1cdc2275e7)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:01.426627 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d83268-ee88-4f58-845f-6085601c7501 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:01.486842 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e5d83268-ee88-4f58-845f-6085601c7501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd45ab9e9c38b4844b03f6b1cdc2275e7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:01.500484 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e5d83268-ee88-4f58-845f-6085601c7501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd45ab9e9c38b4844b03f6b1cdc2275e7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:01.501262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e5d83268-ee88-4f58-845f-6085601c7501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd45ab9e9c38b4844b03f6b1cdc2275e7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:01.509964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e5d83268-ee88-4f58-845f-6085601c7501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd45ab9e9c38b4844b03f6b1cdc2275e7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:01.511469 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e5d83268-ee88-4f58-845f-6085601c7501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd45ab9e9c38b4844b03f6b1cdc2275e7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:01.525518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 960/1888] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:41:01 2022] DELETE /identity/v3/users/d45ab9e9c38b4844b03f6b1cdc2275e7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:41:01.910118 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8816781-64ce-4a4d-8471-af7e77f1dec2 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:01.912551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d8816781-64ce-4a4d-8471-af7e77f1dec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:01.926541 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8816781-64ce-4a4d-8471-af7e77f1dec2 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:01.999211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bd1f5-c0c2-4242-b783-35bcf01f7eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:02.000246 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bd1f5-c0c2-4242-b783-35bcf01f7eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:02.000672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bd1f5-c0c2-4242-b783-35bcf01f7eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:02.001114 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bd1f5-c0c2-4242-b783-35bcf01f7eef admin admin] PATH_INFO: `/v3/projects/84e4d3f7035e4103bdc86a6e43919428` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:02.002564 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625bd1f5-c0c2-4242-b783-35bcf01f7eef admin admin] RBAC: Authorizing `identity:delete_project(project_id=84e4d3f7035e4103bdc86a6e43919428)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:02.004652 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625bd1f5-c0c2-4242-b783-35bcf01f7eef admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:02.027188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d83268-ee88-4f58-845f-6085601c7501 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:02.029775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e5d83268-ee88-4f58-845f-6085601c7501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:02.050921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d83268-ee88-4f58-845f-6085601c7501 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:02.059736 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:02.064337 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:02.076071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-625bd1f5-c0c2-4242-b783-35bcf01f7eef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84e4d3f7035e4103bdc86a6e43919428', 'request_id': 'req-625bd1f5-c0c2-4242-b783-35bcf01f7eef'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:02.091869 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-625bd1f5-c0c2-4242-b783-35bcf01f7eef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84e4d3f7035e4103bdc86a6e43919428', 'request_id': 'req-625bd1f5-c0c2-4242-b783-35bcf01f7eef'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:02.120544 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-625bd1f5-c0c2-4242-b783-35bcf01f7eef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84e4d3f7035e4103bdc86a6e43919428', 'request_id': 'req-625bd1f5-c0c2-4242-b783-35bcf01f7eef'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:02.137783 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-625bd1f5-c0c2-4242-b783-35bcf01f7eef admin admin] The token cache is being invalidate because project 84e4d3f7035e4103bdc86a6e43919428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:41:02.138075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-625bd1f5-c0c2-4242-b783-35bcf01f7eef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:02.138987 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-625bd1f5-c0c2-4242-b783-35bcf01f7eef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:02.141286 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 929/1889] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:41:01 2022] DELETE /identity/v3/projects/84e4d3f7035e4103bdc86a6e43919428 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:02.141749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41870f-f51b-4ec3-9bda-1c1db9af6ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:02.142706 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41870f-f51b-4ec3-9bda-1c1db9af6ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:02.143090 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41870f-f51b-4ec3-9bda-1c1db9af6ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:02.143409 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41870f-f51b-4ec3-9bda-1c1db9af6ed1 admin admin] PATH_INFO: `/v3/projects/edb1372894b5441dbd5a1dc8ecabf39d` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:02.144782 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41870f-f51b-4ec3-9bda-1c1db9af6ed1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edb1372894b5441dbd5a1dc8ecabf39d)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:02.146112 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bd1f5-c0c2-4242-b783-35bcf01f7eef admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:02.146875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41870f-f51b-4ec3-9bda-1c1db9af6ed1 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:02.148989 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-625bd1f5-c0c2-4242-b783-35bcf01f7eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:02.173575 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bd1f5-c0c2-4242-b783-35bcf01f7eef admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:02.182616 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1154b-3f61-4bbc-a4c9-dae5f46768f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:02.183776 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1154b-3f61-4bbc-a4c9-dae5f46768f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:02.184064 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1154b-3f61-4bbc-a4c9-dae5f46768f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:02.184340 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1154b-3f61-4bbc-a4c9-dae5f46768f4 admin admin] PATH_INFO: `/v3/users/5202b32bb85d4f5a92e9b4d4ea6e006b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:02.185929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1154b-3f61-4bbc-a4c9-dae5f46768f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5202b32bb85d4f5a92e9b4d4ea6e006b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:02.191905 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1154b-3f61-4bbc-a4c9-dae5f46768f4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:02.214244 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-3e41870f-f51b-4ec3-9bda-1c1db9af6ed1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edb1372894b5441dbd5a1dc8ecabf39d', 'request_id': 'req-3e41870f-f51b-4ec3-9bda-1c1db9af6ed1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:02.225405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-3e41870f-f51b-4ec3-9bda-1c1db9af6ed1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edb1372894b5441dbd5a1dc8ecabf39d', 'request_id': 'req-3e41870f-f51b-4ec3-9bda-1c1db9af6ed1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:02.239833 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-3e41870f-f51b-4ec3-9bda-1c1db9af6ed1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edb1372894b5441dbd5a1dc8ecabf39d', 'request_id': 'req-3e41870f-f51b-4ec3-9bda-1c1db9af6ed1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:02.260275 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-3e41870f-f51b-4ec3-9bda-1c1db9af6ed1 admin admin] The token cache is being invalidate because project edb1372894b5441dbd5a1dc8ecabf39d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:41:02.260606 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-3e41870f-f51b-4ec3-9bda-1c1db9af6ed1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:02.261288 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-3e41870f-f51b-4ec3-9bda-1c1db9af6ed1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:02.263744 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 961/1890] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:41:02 2022] DELETE /identity/v3/projects/edb1372894b5441dbd5a1dc8ecabf39d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:41:02.271457 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386fa1b-f66d-46a5-926f-c93294e32993 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:02.271457 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386fa1b-f66d-46a5-926f-c93294e32993 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:02.276452 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e7d1154b-3f61-4bbc-a4c9-dae5f46768f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5202b32bb85d4f5a92e9b4d4ea6e006b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:02.277583 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e7d1154b-3f61-4bbc-a4c9-dae5f46768f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5202b32bb85d4f5a92e9b4d4ea6e006b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:02.277714 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386fa1b-f66d-46a5-926f-c93294e32993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:02.289495 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e7d1154b-3f61-4bbc-a4c9-dae5f46768f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5202b32bb85d4f5a92e9b4d4ea6e006b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:02.291116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e7d1154b-3f61-4bbc-a4c9-dae5f46768f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5202b32bb85d4f5a92e9b4d4ea6e006b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:02.300389 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e7d1154b-3f61-4bbc-a4c9-dae5f46768f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5202b32bb85d4f5a92e9b4d4ea6e006b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:02.311104 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c386fa1b-f66d-46a5-926f-c93294e32993 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:02.312572 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c386fa1b-f66d-46a5-926f-c93294e32993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:02.323085 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 930/1891] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:41:02 2022] DELETE /identity/v3/users/5202b32bb85d4f5a92e9b4d4ea6e006b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:02.452622 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e810f-7462-4dc1-821a-7b1d79a4926e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:02.452973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e810f-7462-4dc1-821a-7b1d79a4926e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:02.453458 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e810f-7462-4dc1-821a-7b1d79a4926e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:02.458124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 962/1892] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:41:02.510332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0f8e810f-7462-4dc1-821a-7b1d79a4926e None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:02.511933 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0f8e810f-7462-4dc1-821a-7b1d79a4926e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:02.604530 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 931/1893] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:02.609007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386fa1b-f66d-46a5-926f-c93294e32993 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:02.618948 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386fa1b-f66d-46a5-926f-c93294e32993 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:02.625457 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713b9b4-49b6-4c1a-84bb-a08d9febba30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:02.626526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713b9b4-49b6-4c1a-84bb-a08d9febba30 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:02.626961 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713b9b4-49b6-4c1a-84bb-a08d9febba30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:02.627390 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713b9b4-49b6-4c1a-84bb-a08d9febba30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:02.628414 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713b9b4-49b6-4c1a-84bb-a08d9febba30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:41:02.628870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713b9b4-49b6-4c1a-84bb-a08d9febba30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:02.630753 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713b9b4-49b6-4c1a-84bb-a08d9febba30 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:02.648338 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 963/1894] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:41:02.649529 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e810f-7462-4dc1-821a-7b1d79a4926e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:02.660290 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e810f-7462-4dc1-821a-7b1d79a4926e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:02.671459 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0a20b-5028-40e4-a22d-6d14850a6ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:02.672669 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0a20b-5028-40e4-a22d-6d14850a6ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:02.673204 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0a20b-5028-40e4-a22d-6d14850a6ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:02.673880 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0a20b-5028-40e4-a22d-6d14850a6ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:02.674685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0a20b-5028-40e4-a22d-6d14850a6ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:02.677049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0a20b-5028-40e4-a22d-6d14850a6ce5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:02.733198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713b9b4-49b6-4c1a-84bb-a08d9febba30 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:02.740749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 932/1895] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:41:02 2022] POST /identity/v3/projects => generated 371 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:41:02.747334 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713b9b4-49b6-4c1a-84bb-a08d9febba30 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:02.774395 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:02.816003 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71130ac1-551b-46b7-84a3-9b0d1c65f766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:02.816879 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71130ac1-551b-46b7-84a3-9b0d1c65f766 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:02.817280 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71130ac1-551b-46b7-84a3-9b0d1c65f766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:02.817656 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71130ac1-551b-46b7-84a3-9b0d1c65f766 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:02.818436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71130ac1-551b-46b7-84a3-9b0d1c65f766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:02.820452 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71130ac1-551b-46b7-84a3-9b0d1c65f766 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:02.848277 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 964/1896] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:41:02 2022] POST /identity/v3/users => generated 286 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:41:02.848415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0a20b-5028-40e4-a22d-6d14850a6ce5 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:02.869578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0a20b-5028-40e4-a22d-6d14850a6ce5 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:02.877772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae9f20-d9c3-4b20-a2a6-d3c1ef08dfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:02.881686 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae9f20-d9c3-4b20-a2a6-d3c1ef08dfab admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:02.882307 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae9f20-d9c3-4b20-a2a6-d3c1ef08dfab admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:02.882749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae9f20-d9c3-4b20-a2a6-d3c1ef08dfab admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:02.884045 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae9f20-d9c3-4b20-a2a6-d3c1ef08dfab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:02.886861 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae9f20-d9c3-4b20-a2a6-d3c1ef08dfab admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:02.896604 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71130ac1-551b-46b7-84a3-9b0d1c65f766 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:02.899564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-71130ac1-551b-46b7-84a3-9b0d1c65f766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:02.914166 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71130ac1-551b-46b7-84a3-9b0d1c65f766 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:02.918675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 933/1897] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:41:02.922716 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae9f20-d9c3-4b20-a2a6-d3c1ef08dfab admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:02.923866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60464e9-0e7a-43db-922e-c2116b3857fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:02.924858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60464e9-0e7a-43db-922e-c2116b3857fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:02.925212 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60464e9-0e7a-43db-922e-c2116b3857fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:02.925621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60464e9-0e7a-43db-922e-c2116b3857fd admin admin] PATH_INFO: `/v3/projects/097806665bf24f07b1dca1d9673ff2d5` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:02.927774 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60464e9-0e7a-43db-922e-c2116b3857fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=097806665bf24f07b1dca1d9673ff2d5)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:02.930652 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60464e9-0e7a-43db-922e-c2116b3857fd admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:02.935729 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae9f20-d9c3-4b20-a2a6-d3c1ef08dfab admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:02.941279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725e39b-fb55-4c71-85ab-104003f81b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:02.942211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725e39b-fb55-4c71-85ab-104003f81b0e admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:02.942565 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725e39b-fb55-4c71-85ab-104003f81b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:02.942901 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725e39b-fb55-4c71-85ab-104003f81b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:02.944003 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725e39b-fb55-4c71-85ab-104003f81b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:02.945887 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725e39b-fb55-4c71-85ab-104003f81b0e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:02.952460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:02.963244 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 934/1898] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:41:02.965468 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725e39b-fb55-4c71-85ab-104003f81b0e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:02.983728 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725e39b-fb55-4c71-85ab-104003f81b0e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:02.990822 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a73ef-9a6b-4bf5-a2a5-847f37074e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:02.992169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a73ef-9a6b-4bf5-a2a5-847f37074e3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:02.992658 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a73ef-9a6b-4bf5-a2a5-847f37074e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:02.993125 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a73ef-9a6b-4bf5-a2a5-847f37074e3a admin admin] PATH_INFO: `/v3/projects/d60ed6f6064a4cd88a03cf97ab7abeae/users/f5c0ccbf16fe4a399945aa5ad34754b5/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:03.012748 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f60464e9-0e7a-43db-922e-c2116b3857fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '097806665bf24f07b1dca1d9673ff2d5', 'request_id': 'req-f60464e9-0e7a-43db-922e-c2116b3857fd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:03.017282 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a73ef-9a6b-4bf5-a2a5-847f37074e3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60ed6f6064a4cd88a03cf97ab7abeae, user_id=f5c0ccbf16fe4a399945aa5ad34754b5, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:03.021137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a73ef-9a6b-4bf5-a2a5-847f37074e3a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:03.024103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f60464e9-0e7a-43db-922e-c2116b3857fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '097806665bf24f07b1dca1d9673ff2d5', 'request_id': 'req-f60464e9-0e7a-43db-922e-c2116b3857fd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:03.034508 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f60464e9-0e7a-43db-922e-c2116b3857fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '097806665bf24f07b1dca1d9673ff2d5', 'request_id': 'req-f60464e9-0e7a-43db-922e-c2116b3857fd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:03.041729 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 935/1899] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:41:02 2022] PUT /identity/v3/projects/d60ed6f6064a4cd88a03cf97ab7abeae/users/f5c0ccbf16fe4a399945aa5ad34754b5/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:03.048468 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14be8d2-3641-4a74-b266-dc00f3cfba8d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:03.049038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f60464e9-0e7a-43db-922e-c2116b3857fd admin admin] The token cache is being invalidate because project 097806665bf24f07b1dca1d9673ff2d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:41:03.049392 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f60464e9-0e7a-43db-922e-c2116b3857fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:03.050158 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f60464e9-0e7a-43db-922e-c2116b3857fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:03.050479 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14be8d2-3641-4a74-b266-dc00f3cfba8d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:03.050925 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14be8d2-3641-4a74-b266-dc00f3cfba8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:03.051925 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 965/1900] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:41:02 2022] DELETE /identity/v3/projects/097806665bf24f07b1dca1d9673ff2d5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:41:03.057955 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e97b07-b87f-4c6b-bd18-09c1de276d8b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:03.058239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e97b07-b87f-4c6b-bd18-09c1de276d8b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:03.058571 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e97b07-b87f-4c6b-bd18-09c1de276d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:03.077820 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f14be8d2-3641-4a74-b266-dc00f3cfba8d None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:03.079344 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f14be8d2-3641-4a74-b266-dc00f3cfba8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:03.080531 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-20e97b07-b87f-4c6b-bd18-09c1de276d8b None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:03.081736 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-20e97b07-b87f-4c6b-bd18-09c1de276d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:03.153112 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 936/1901] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:03.158168 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 966/1902] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:03.164722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14be8d2-3641-4a74-b266-dc00f3cfba8d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:03.165100 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55816bb-2136-4125-be23-aeefeaaf200a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:03.165401 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55816bb-2136-4125-be23-aeefeaaf200a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:03.166051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55816bb-2136-4125-be23-aeefeaaf200a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:03.166365 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f14be8d2-3641-4a74-b266-dc00f3cfba8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:03.183925 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e55816bb-2136-4125-be23-aeefeaaf200a None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:03.185156 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e55816bb-2136-4125-be23-aeefeaaf200a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:03.193194 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 967/1903] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:41:03.197222 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55816bb-2136-4125-be23-aeefeaaf200a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:03.208114 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55816bb-2136-4125-be23-aeefeaaf200a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:03.214673 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e42587-7a53-408d-a66b-f0d0d6913591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:03.215611 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e42587-7a53-408d-a66b-f0d0d6913591 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:03.216028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e42587-7a53-408d-a66b-f0d0d6913591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:03.216439 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e42587-7a53-408d-a66b-f0d0d6913591 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:03.218202 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e42587-7a53-408d-a66b-f0d0d6913591 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:41:03.218673 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e42587-7a53-408d-a66b-f0d0d6913591 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:03.221201 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e42587-7a53-408d-a66b-f0d0d6913591 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:03.225829 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14be8d2-3641-4a74-b266-dc00f3cfba8d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:03.229595 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8622c-96f4-456e-b433-a80e2763089a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:03.230494 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8622c-96f4-456e-b433-a80e2763089a service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:03.230801 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8622c-96f4-456e-b433-a80e2763089a service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:03.231126 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8622c-96f4-456e-b433-a80e2763089a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:03.236991 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 968/1904] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:41:03.241639 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8622c-96f4-456e-b433-a80e2763089a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:03.242254 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e42587-7a53-408d-a66b-f0d0d6913591 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:03.243275 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8622c-96f4-456e-b433-a80e2763089a service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:03.254127 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 937/1905] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:41:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:41:03.254613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e42587-7a53-408d-a66b-f0d0d6913591 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:03.259287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b979e0-e067-4c74-b50d-cc15ae82ae02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:03.260080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b979e0-e067-4c74-b50d-cc15ae82ae02 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:03.260371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b979e0-e067-4c74-b50d-cc15ae82ae02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:03.260690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b979e0-e067-4c74-b50d-cc15ae82ae02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:03.261406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b979e0-e067-4c74-b50d-cc15ae82ae02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:03.263353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b979e0-e067-4c74-b50d-cc15ae82ae02 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:03.278819 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:03.298007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 969/1906] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:41:03 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:41:03.299193 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8622c-96f4-456e-b433-a80e2763089a service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:03.309257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8622c-96f4-456e-b433-a80e2763089a service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:03.373335 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191b2ad-5e4a-45b0-a25b-d672bf2f879e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:03.374558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191b2ad-5e4a-45b0-a25b-d672bf2f879e admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:03.374846 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191b2ad-5e4a-45b0-a25b-d672bf2f879e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:03.375158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191b2ad-5e4a-45b0-a25b-d672bf2f879e admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:03.375869 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191b2ad-5e4a-45b0-a25b-d672bf2f879e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:03.377888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191b2ad-5e4a-45b0-a25b-d672bf2f879e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:03.399981 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 938/1907] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:41:03 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:41:03.404390 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b979e0-e067-4c74-b50d-cc15ae82ae02 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:03.414964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b979e0-e067-4c74-b50d-cc15ae82ae02 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:03.426057 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b79d0-6d4c-4b72-9e24-2b762f2b0c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:03.440633 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b79d0-6d4c-4b72-9e24-2b762f2b0c37 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:03.440954 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b79d0-6d4c-4b72-9e24-2b762f2b0c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:03.441261 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b79d0-6d4c-4b72-9e24-2b762f2b0c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:03.442068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b79d0-6d4c-4b72-9e24-2b762f2b0c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:03.443689 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b79d0-6d4c-4b72-9e24-2b762f2b0c37 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:03.468281 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 970/1908] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:41:03.469640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191b2ad-5e4a-45b0-a25b-d672bf2f879e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:03.481411 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191b2ad-5e4a-45b0-a25b-d672bf2f879e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:03.487035 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12941128-2149-41b8-9dea-322ac9007b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:03.487710 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12941128-2149-41b8-9dea-322ac9007b53 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:03.488004 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12941128-2149-41b8-9dea-322ac9007b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:03.488292 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12941128-2149-41b8-9dea-322ac9007b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:03.489125 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12941128-2149-41b8-9dea-322ac9007b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:03.491466 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12941128-2149-41b8-9dea-322ac9007b53 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:03.494849 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:03.509477 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 939/1909] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:41:03.511292 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b79d0-6d4c-4b72-9e24-2b762f2b0c37 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:03.522288 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b79d0-6d4c-4b72-9e24-2b762f2b0c37 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:03.526903 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b5fad-a059-4590-a4f2-9a158612f755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:03.527784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b5fad-a059-4590-a4f2-9a158612f755 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:03.528071 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b5fad-a059-4590-a4f2-9a158612f755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:03.528350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b5fad-a059-4590-a4f2-9a158612f755 admin admin] PATH_INFO: `/v3/projects/ad79c37076e842149d38afc28709dc11/users/a96a22ad4f1e4cf7a4d7814758eefda1/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:03.547588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b5fad-a059-4590-a4f2-9a158612f755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad79c37076e842149d38afc28709dc11, user_id=a96a22ad4f1e4cf7a4d7814758eefda1, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:03.550395 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b5fad-a059-4590-a4f2-9a158612f755 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:03.567025 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 971/1910] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:41:03 2022] PUT /identity/v3/projects/ad79c37076e842149d38afc28709dc11/users/a96a22ad4f1e4cf7a4d7814758eefda1/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:03.577951 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237fb05-ab18-48de-a614-c56d87be3541 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:03.578464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237fb05-ab18-48de-a614-c56d87be3541 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:03.578848 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237fb05-ab18-48de-a614-c56d87be3541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:03.606738 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d237fb05-ab18-48de-a614-c56d87be3541 None None] MFA Rules not processed for user `a96a22ad4f1e4cf7a4d7814758eefda1`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:03.608108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d237fb05-ab18-48de-a614-c56d87be3541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:03.680368 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 940/1911] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:41:03.684978 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b5fad-a059-4590-a4f2-9a158612f755 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:03.753485 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b5fad-a059-4590-a4f2-9a158612f755 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:03.758709 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba616f-fbd5-4191-8cfb-21748db62678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:03.759676 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba616f-fbd5-4191-8cfb-21748db62678 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:03.759961 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba616f-fbd5-4191-8cfb-21748db62678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:03.760314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba616f-fbd5-4191-8cfb-21748db62678 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:03.760968 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba616f-fbd5-4191-8cfb-21748db62678 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:03.762884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba616f-fbd5-4191-8cfb-21748db62678 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:03.798690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 972/1912] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:41:03 2022] POST /identity/v3/projects => generated 389 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:41:03.800400 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237fb05-ab18-48de-a614-c56d87be3541 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:03.813869 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237fb05-ab18-48de-a614-c56d87be3541 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:03.905624 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049e5f1-ba7e-4125-bd69-86952552cf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:03.906762 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049e5f1-ba7e-4125-bd69-86952552cf62 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:03.907112 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049e5f1-ba7e-4125-bd69-86952552cf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:03.907402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049e5f1-ba7e-4125-bd69-86952552cf62 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:03.909462 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049e5f1-ba7e-4125-bd69-86952552cf62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:03.910600 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049e5f1-ba7e-4125-bd69-86952552cf62 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:03.955922 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 941/1913] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:41:03 2022] POST /identity/v3/users => generated 301 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:41:03.966567 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba616f-fbd5-4191-8cfb-21748db62678 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:03.985498 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba616f-fbd5-4191-8cfb-21748db62678 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:03.999983 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd212013-a8b7-43d1-be82-719aab690eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:04.000815 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd212013-a8b7-43d1-be82-719aab690eba admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:04.001333 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd212013-a8b7-43d1-be82-719aab690eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:04.001749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd212013-a8b7-43d1-be82-719aab690eba admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:04.002749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd212013-a8b7-43d1-be82-719aab690eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:04.004346 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd212013-a8b7-43d1-be82-719aab690eba admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:04.031563 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 973/1914] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:41:04.033143 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049e5f1-ba7e-4125-bd69-86952552cf62 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:04.047467 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049e5f1-ba7e-4125-bd69-86952552cf62 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:04.062206 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9cb86a-8065-47c2-9dd7-f5557365574c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:04.063136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9cb86a-8065-47c2-9dd7-f5557365574c admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:04.063421 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9cb86a-8065-47c2-9dd7-f5557365574c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:04.063704 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9cb86a-8065-47c2-9dd7-f5557365574c admin admin] PATH_INFO: `/v3/projects/c65be5f4ccc848ab823ec62f8eb7d16a/users/4d57a0cfd2d046b7ac43d2603b40b2d8/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:04.091554 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9cb86a-8065-47c2-9dd7-f5557365574c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c65be5f4ccc848ab823ec62f8eb7d16a, user_id=4d57a0cfd2d046b7ac43d2603b40b2d8, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:04.095232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9cb86a-8065-47c2-9dd7-f5557365574c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:04.128312 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 942/1915] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:41:04 2022] PUT /identity/v3/projects/c65be5f4ccc848ab823ec62f8eb7d16a/users/4d57a0cfd2d046b7ac43d2603b40b2d8/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:04.132521 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd212013-a8b7-43d1-be82-719aab690eba admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:04.155967 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd212013-a8b7-43d1-be82-719aab690eba admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:04.284090 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923ceac-7849-492b-a0bb-980fde629a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:04.284809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923ceac-7849-492b-a0bb-980fde629a98 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:04.294696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923ceac-7849-492b-a0bb-980fde629a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:04.295031 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923ceac-7849-492b-a0bb-980fde629a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:04.296479 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923ceac-7849-492b-a0bb-980fde629a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:04.298413 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923ceac-7849-492b-a0bb-980fde629a98 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:04.318414 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 974/1916] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:41:04.319237 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9cb86a-8065-47c2-9dd7-f5557365574c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:04.330408 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9cb86a-8065-47c2-9dd7-f5557365574c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:04.335652 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b4274-01d6-4e11-b8f4-a125d29068ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:04.336597 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b4274-01d6-4e11-b8f4-a125d29068ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:04.336884 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b4274-01d6-4e11-b8f4-a125d29068ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:04.337176 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b4274-01d6-4e11-b8f4-a125d29068ce admin admin] PATH_INFO: `/v3/projects/c65be5f4ccc848ab823ec62f8eb7d16a/users/4d57a0cfd2d046b7ac43d2603b40b2d8/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:04.339159 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b4274-01d6-4e11-b8f4-a125d29068ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=c65be5f4ccc848ab823ec62f8eb7d16a, user_id=4d57a0cfd2d046b7ac43d2603b40b2d8, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:04.341985 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b4274-01d6-4e11-b8f4-a125d29068ce admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:04.364537 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 943/1917] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:41:04 2022] PUT /identity/v3/projects/c65be5f4ccc848ab823ec62f8eb7d16a/users/4d57a0cfd2d046b7ac43d2603b40b2d8/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:41:04.370709 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cc07a-b6fb-410e-a4f9-36a1da269eb5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:04.371177 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cc07a-b6fb-410e-a4f9-36a1da269eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:04.371661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cc07a-b6fb-410e-a4f9-36a1da269eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:04.410501 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ac6cc07a-b6fb-410e-a4f9-36a1da269eb5 None None] MFA Rules not processed for user `4d57a0cfd2d046b7ac43d2603b40b2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:04.413515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ac6cc07a-b6fb-410e-a4f9-36a1da269eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:04.447661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:04.513182 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 975/1918] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:04.524565 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b4274-01d6-4e11-b8f4-a125d29068ce admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:04.526297 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a63b4274-01d6-4e11-b8f4-a125d29068ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:04.587268 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:04.598965 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57466d-4ad5-473c-842f-3213c768b237 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:04.599329 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57466d-4ad5-473c-842f-3213c768b237 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:04.599681 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57466d-4ad5-473c-842f-3213c768b237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:04.604489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b4274-01d6-4e11-b8f4-a125d29068ce admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:04.608977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d13b5-b93d-41b1-a0cd-f7c623fb0561 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:04.609627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d13b5-b93d-41b1-a0cd-f7c623fb0561 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:04.609921 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d13b5-b93d-41b1-a0cd-f7c623fb0561 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:04.610199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d13b5-b93d-41b1-a0cd-f7c623fb0561 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:04.619836 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d13b5-b93d-41b1-a0cd-f7c623fb0561 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:04.621313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d13b5-b93d-41b1-a0cd-f7c623fb0561 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:04.628572 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ec57466d-4ad5-473c-842f-3213c768b237 None None] MFA Rules not processed for user `f5c0ccbf16fe4a399945aa5ad34754b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:04.629852 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ec57466d-4ad5-473c-842f-3213c768b237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:04.631435 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 944/1919] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:41:04 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:41:04.709681 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 976/1920] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:04.725228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d13b5-b93d-41b1-a0cd-f7c623fb0561 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:04.735571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d13b5-b93d-41b1-a0cd-f7c623fb0561 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:04.740820 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0089f10-7e84-49ff-aa1a-2c87ae2a391f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:04.741460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0089f10-7e84-49ff-aa1a-2c87ae2a391f service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:04.741739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0089f10-7e84-49ff-aa1a-2c87ae2a391f service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:04.742023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0089f10-7e84-49ff-aa1a-2c87ae2a391f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:04.752215 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0089f10-7e84-49ff-aa1a-2c87ae2a391f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:04.753788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0089f10-7e84-49ff-aa1a-2c87ae2a391f service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:04.763638 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 945/1921] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:41:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:41:04.773564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57466d-4ad5-473c-842f-3213c768b237 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:04.842761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57466d-4ad5-473c-842f-3213c768b237 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:04.847625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cc87c-aba6-47af-9972-29e11328f198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:04.853061 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cc87c-aba6-47af-9972-29e11328f198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:04.853761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cc87c-aba6-47af-9972-29e11328f198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:04.854216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cc87c-aba6-47af-9972-29e11328f198 admin admin] PATH_INFO: `/v3/users/a96a22ad4f1e4cf7a4d7814758eefda1` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:04.857021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cc87c-aba6-47af-9972-29e11328f198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a96a22ad4f1e4cf7a4d7814758eefda1)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:04.859156 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cc87c-aba6-47af-9972-29e11328f198 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:04.909384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2f3cc87c-aba6-47af-9972-29e11328f198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a96a22ad4f1e4cf7a4d7814758eefda1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:04.910506 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:04.925049 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2f3cc87c-aba6-47af-9972-29e11328f198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a96a22ad4f1e4cf7a4d7814758eefda1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:04.925838 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2f3cc87c-aba6-47af-9972-29e11328f198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a96a22ad4f1e4cf7a4d7814758eefda1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:04.932967 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2f3cc87c-aba6-47af-9972-29e11328f198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a96a22ad4f1e4cf7a4d7814758eefda1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:04.933635 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2f3cc87c-aba6-47af-9972-29e11328f198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a96a22ad4f1e4cf7a4d7814758eefda1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:04.948174 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 977/1922] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:41:04 2022] DELETE /identity/v3/users/a96a22ad4f1e4cf7a4d7814758eefda1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:04.953400 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c0627-b8e8-49df-bee3-fbad568d859e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:04.953697 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c0627-b8e8-49df-bee3-fbad568d859e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:04.954430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c0627-b8e8-49df-bee3-fbad568d859e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:04.971628 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-899c0627-b8e8-49df-bee3-fbad568d859e None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:04.973087 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-899c0627-b8e8-49df-bee3-fbad568d859e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:05.057415 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 946/1923] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:41:05.068190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cc87c-aba6-47af-9972-29e11328f198 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:05.069546 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2f3cc87c-aba6-47af-9972-29e11328f198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:05.167964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cc87c-aba6-47af-9972-29e11328f198 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:05.173049 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1d808-f4ba-4ed5-87c0-e6f7d317c4ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:05.173756 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1d808-f4ba-4ed5-87c0-e6f7d317c4ac service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:05.174045 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1d808-f4ba-4ed5-87c0-e6f7d317c4ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:05.174412 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1d808-f4ba-4ed5-87c0-e6f7d317c4ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:05.187349 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1d808-f4ba-4ed5-87c0-e6f7d317c4ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:05.189229 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1d808-f4ba-4ed5-87c0-e6f7d317c4ac service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:05.203338 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 978/1924] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:41:05.559681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c0627-b8e8-49df-bee3-fbad568d859e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:05.561708 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-899c0627-b8e8-49df-bee3-fbad568d859e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:05.580572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c0627-b8e8-49df-bee3-fbad568d859e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:05.586921 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ddf6b-879c-4730-bfea-aa66d9d29139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:05.588406 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ddf6b-879c-4730-bfea-aa66d9d29139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:05.588861 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ddf6b-879c-4730-bfea-aa66d9d29139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:05.589357 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ddf6b-879c-4730-bfea-aa66d9d29139 admin admin] PATH_INFO: `/v3/projects/ad79c37076e842149d38afc28709dc11` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:05.591552 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ddf6b-879c-4730-bfea-aa66d9d29139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad79c37076e842149d38afc28709dc11)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:05.593924 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ddf6b-879c-4730-bfea-aa66d9d29139 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:05.649737 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7e3ddf6b-879c-4730-bfea-aa66d9d29139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad79c37076e842149d38afc28709dc11', 'request_id': 'req-7e3ddf6b-879c-4730-bfea-aa66d9d29139'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:05.657727 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7e3ddf6b-879c-4730-bfea-aa66d9d29139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad79c37076e842149d38afc28709dc11', 'request_id': 'req-7e3ddf6b-879c-4730-bfea-aa66d9d29139'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:05.664358 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7e3ddf6b-879c-4730-bfea-aa66d9d29139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad79c37076e842149d38afc28709dc11', 'request_id': 'req-7e3ddf6b-879c-4730-bfea-aa66d9d29139'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:05.675933 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7e3ddf6b-879c-4730-bfea-aa66d9d29139 admin admin] The token cache is being invalidate because project ad79c37076e842149d38afc28709dc11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:41:05.676216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7e3ddf6b-879c-4730-bfea-aa66d9d29139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:05.676877 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7e3ddf6b-879c-4730-bfea-aa66d9d29139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:05.678404 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 947/1925] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:41:05 2022] DELETE /identity/v3/projects/ad79c37076e842149d38afc28709dc11 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:05.682322 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1d808-f4ba-4ed5-87c0-e6f7d317c4ac service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:05.692370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1d808-f4ba-4ed5-87c0-e6f7d317c4ac service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:05.750494 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10f198-5d21-4168-ad65-9e030a2af9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:05.751394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10f198-5d21-4168-ad65-9e030a2af9f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:05.751674 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10f198-5d21-4168-ad65-9e030a2af9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:05.751948 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10f198-5d21-4168-ad65-9e030a2af9f6 admin admin] PATH_INFO: `/v3/users/4d57a0cfd2d046b7ac43d2603b40b2d8` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:05.753151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10f198-5d21-4168-ad65-9e030a2af9f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d57a0cfd2d046b7ac43d2603b40b2d8)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:05.755109 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10f198-5d21-4168-ad65-9e030a2af9f6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:05.801143 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2e10f198-5d21-4168-ad65-9e030a2af9f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d57a0cfd2d046b7ac43d2603b40b2d8'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:05.813169 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2e10f198-5d21-4168-ad65-9e030a2af9f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d57a0cfd2d046b7ac43d2603b40b2d8'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:05.813832 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2e10f198-5d21-4168-ad65-9e030a2af9f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d57a0cfd2d046b7ac43d2603b40b2d8'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:05.818463 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:05.821138 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2e10f198-5d21-4168-ad65-9e030a2af9f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d57a0cfd2d046b7ac43d2603b40b2d8'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:05.821855 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2e10f198-5d21-4168-ad65-9e030a2af9f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d57a0cfd2d046b7ac43d2603b40b2d8'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:05.836670 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 979/1926] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:41:05 2022] DELETE /identity/v3/users/4d57a0cfd2d046b7ac43d2603b40b2d8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:06.119753 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ddf6b-879c-4730-bfea-aa66d9d29139 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:06.124938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7e3ddf6b-879c-4730-bfea-aa66d9d29139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:06.141943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ddf6b-879c-4730-bfea-aa66d9d29139 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:06.175861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3d33a-04a9-4f5f-9a65-d47e64fc3b51 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:06.176154 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3d33a-04a9-4f5f-9a65-d47e64fc3b51 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:06.176433 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3d33a-04a9-4f5f-9a65-d47e64fc3b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:06.197616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-14a3d33a-04a9-4f5f-9a65-d47e64fc3b51 None None] MFA Rules not processed for user `f5c0ccbf16fe4a399945aa5ad34754b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:06.199274 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-14a3d33a-04a9-4f5f-9a65-d47e64fc3b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:06.209167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:06.226390 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a4a64-807e-49f2-ac5c-b08c62cd1409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:06.227353 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a4a64-807e-49f2-ac5c-b08c62cd1409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:06.227641 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a4a64-807e-49f2-ac5c-b08c62cd1409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:06.227930 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a4a64-807e-49f2-ac5c-b08c62cd1409 admin admin] PATH_INFO: `/v3/projects/c65be5f4ccc848ab823ec62f8eb7d16a` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:06.229531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a4a64-807e-49f2-ac5c-b08c62cd1409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c65be5f4ccc848ab823ec62f8eb7d16a)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:06.232623 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a4a64-807e-49f2-ac5c-b08c62cd1409 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:06.282198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 980/1927] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:41:06.292389 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7a9a4a64-807e-49f2-ac5c-b08c62cd1409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c65be5f4ccc848ab823ec62f8eb7d16a', 'request_id': 'req-7a9a4a64-807e-49f2-ac5c-b08c62cd1409'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:06.303033 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7a9a4a64-807e-49f2-ac5c-b08c62cd1409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c65be5f4ccc848ab823ec62f8eb7d16a', 'request_id': 'req-7a9a4a64-807e-49f2-ac5c-b08c62cd1409'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:06.310673 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7a9a4a64-807e-49f2-ac5c-b08c62cd1409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c65be5f4ccc848ab823ec62f8eb7d16a', 'request_id': 'req-7a9a4a64-807e-49f2-ac5c-b08c62cd1409'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:06.323975 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7a9a4a64-807e-49f2-ac5c-b08c62cd1409 admin admin] The token cache is being invalidate because project c65be5f4ccc848ab823ec62f8eb7d16a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:41:06.323975 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7a9a4a64-807e-49f2-ac5c-b08c62cd1409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:06.325140 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7a9a4a64-807e-49f2-ac5c-b08c62cd1409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:06.328562 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 948/1928] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:41:06 2022] DELETE /identity/v3/projects/c65be5f4ccc848ab823ec62f8eb7d16a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:06.332277 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186ffc8-dbd3-4009-8ab7-e1da52d5fdd8 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:06.332600 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186ffc8-dbd3-4009-8ab7-e1da52d5fdd8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:06.332888 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186ffc8-dbd3-4009-8ab7-e1da52d5fdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:06.352831 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-1186ffc8-dbd3-4009-8ab7-e1da52d5fdd8 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:06.354029 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1186ffc8-dbd3-4009-8ab7-e1da52d5fdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:06.416570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 981/1929] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:06.424418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbde6f2-dda5-42ad-8d22-b8386d276f52 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:06.424816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbde6f2-dda5-42ad-8d22-b8386d276f52 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:06.425158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbde6f2-dda5-42ad-8d22-b8386d276f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:06.447273 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6bbde6f2-dda5-42ad-8d22-b8386d276f52 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:06.448955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6bbde6f2-dda5-42ad-8d22-b8386d276f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:06.458431 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 949/1930] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:06.463134 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186ffc8-dbd3-4009-8ab7-e1da52d5fdd8 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:06.473827 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186ffc8-dbd3-4009-8ab7-e1da52d5fdd8 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:06.480593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17747e-e1ce-49fd-a796-e1a167513d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:06.482070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17747e-e1ce-49fd-a796-e1a167513d28 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:06.482443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17747e-e1ce-49fd-a796-e1a167513d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:06.482810 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17747e-e1ce-49fd-a796-e1a167513d28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:06.483692 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17747e-e1ce-49fd-a796-e1a167513d28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:41:06.484615 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17747e-e1ce-49fd-a796-e1a167513d28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:06.485815 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17747e-e1ce-49fd-a796-e1a167513d28 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:06.502689 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 982/1931] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:41:06.504576 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbde6f2-dda5-42ad-8d22-b8386d276f52 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:06.516386 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbde6f2-dda5-42ad-8d22-b8386d276f52 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:06.531215 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9cfe8-ea6c-4ea2-bc0a-27cc37794a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:06.532882 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9cfe8-ea6c-4ea2-bc0a-27cc37794a99 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:06.533179 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9cfe8-ea6c-4ea2-bc0a-27cc37794a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:06.533464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9cfe8-ea6c-4ea2-bc0a-27cc37794a99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:06.534172 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9cfe8-ea6c-4ea2-bc0a-27cc37794a99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:06.536655 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9cfe8-ea6c-4ea2-bc0a-27cc37794a99 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:06.577480 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 950/1932] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:41:06 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:41:06.581835 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17747e-e1ce-49fd-a796-e1a167513d28 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:06.593174 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17747e-e1ce-49fd-a796-e1a167513d28 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:06.680899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e0b2c-a1d8-4033-b9ca-f77c5e57b2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:06.681705 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e0b2c-a1d8-4033-b9ca-f77c5e57b2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:06.681901 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e0b2c-a1d8-4033-b9ca-f77c5e57b2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:06.682166 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e0b2c-a1d8-4033-b9ca-f77c5e57b2c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:06.683019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e0b2c-a1d8-4033-b9ca-f77c5e57b2c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:06.685242 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e0b2c-a1d8-4033-b9ca-f77c5e57b2c4 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:06.723207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 983/1933] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:41:06 2022] POST /identity/v3/users => generated 291 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:41:06.727471 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9cfe8-ea6c-4ea2-bc0a-27cc37794a99 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:06.742373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9cfe8-ea6c-4ea2-bc0a-27cc37794a99 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:06.747906 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615dea6-5e9e-44dc-a9c9-d6a65fdf08f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:06.749306 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615dea6-5e9e-44dc-a9c9-d6a65fdf08f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:06.749524 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615dea6-5e9e-44dc-a9c9-d6a65fdf08f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:06.749807 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615dea6-5e9e-44dc-a9c9-d6a65fdf08f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:06.750957 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615dea6-5e9e-44dc-a9c9-d6a65fdf08f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:06.752634 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615dea6-5e9e-44dc-a9c9-d6a65fdf08f4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:06.765603 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 951/1934] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:41:06.770060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e0b2c-a1d8-4033-b9ca-f77c5e57b2c4 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:06.783791 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e0b2c-a1d8-4033-b9ca-f77c5e57b2c4 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:06.791279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4d61d-b121-4526-89aa-c67269692917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:06.792314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4d61d-b121-4526-89aa-c67269692917 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:06.792738 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4d61d-b121-4526-89aa-c67269692917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:06.793120 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4d61d-b121-4526-89aa-c67269692917 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:06.794745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4d61d-b121-4526-89aa-c67269692917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:06.797685 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4d61d-b121-4526-89aa-c67269692917 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:06.801288 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:06.817260 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 984/1935] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:41:06.821970 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615dea6-5e9e-44dc-a9c9-d6a65fdf08f4 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:06.845304 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615dea6-5e9e-44dc-a9c9-d6a65fdf08f4 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:06.862824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6989482-99e7-43d8-8615-1851e3dedda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:06.863703 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6989482-99e7-43d8-8615-1851e3dedda5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:06.864052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6989482-99e7-43d8-8615-1851e3dedda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:06.864334 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6989482-99e7-43d8-8615-1851e3dedda5 admin admin] PATH_INFO: `/v3/projects/d17a24e21f0f40468ffa1fc66d827485/users/ed6f51699fa24899bf4e8240defd56a7/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:06.889283 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6989482-99e7-43d8-8615-1851e3dedda5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d17a24e21f0f40468ffa1fc66d827485, user_id=ed6f51699fa24899bf4e8240defd56a7, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:06.892679 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6989482-99e7-43d8-8615-1851e3dedda5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:06.913657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 952/1936] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:41:06 2022] PUT /identity/v3/projects/d17a24e21f0f40468ffa1fc66d827485/users/ed6f51699fa24899bf4e8240defd56a7/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:06.923380 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e15168-f66f-4318-b19c-d384f5d31ea5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:06.923673 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e15168-f66f-4318-b19c-d384f5d31ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:06.923956 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e15168-f66f-4318-b19c-d384f5d31ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:06.977320 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-70e15168-f66f-4318-b19c-d384f5d31ea5 None None] MFA Rules not processed for user `ed6f51699fa24899bf4e8240defd56a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:06.981128 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-70e15168-f66f-4318-b19c-d384f5d31ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:07.166746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 985/1937] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:07.172216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6989482-99e7-43d8-8615-1851e3dedda5 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:07.306246 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6989482-99e7-43d8-8615-1851e3dedda5 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:07.314906 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6202f-7817-4b86-8c34-66ca52c56125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:07.315587 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6202f-7817-4b86-8c34-66ca52c56125 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:07.315873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6202f-7817-4b86-8c34-66ca52c56125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:07.316153 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6202f-7817-4b86-8c34-66ca52c56125 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:07.316907 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6202f-7817-4b86-8c34-66ca52c56125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:07.319455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6202f-7817-4b86-8c34-66ca52c56125 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:07.359994 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 953/1938] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:41:07 2022] POST /identity/v3/projects => generated 381 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:41:07.364089 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e15168-f66f-4318-b19c-d384f5d31ea5 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:07.379440 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e15168-f66f-4318-b19c-d384f5d31ea5 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:07.462291 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83f720-23aa-44c1-a892-9327eab587f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:07.463177 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83f720-23aa-44c1-a892-9327eab587f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:07.463580 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83f720-23aa-44c1-a892-9327eab587f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:07.463907 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83f720-23aa-44c1-a892-9327eab587f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:07.464737 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83f720-23aa-44c1-a892-9327eab587f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:07.466725 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83f720-23aa-44c1-a892-9327eab587f0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:07.490186 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 986/1939] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:41:07 2022] POST /identity/v3/users => generated 297 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:41:07.493828 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6202f-7817-4b86-8c34-66ca52c56125 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:07.501145 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:07.505619 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6202f-7817-4b86-8c34-66ca52c56125 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:07.515242 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562880e5-fbb2-4e2c-b059-53b62836edfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:07.516420 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562880e5-fbb2-4e2c-b059-53b62836edfb admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:07.516914 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562880e5-fbb2-4e2c-b059-53b62836edfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:07.517620 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562880e5-fbb2-4e2c-b059-53b62836edfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:07.519005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562880e5-fbb2-4e2c-b059-53b62836edfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:07.521467 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562880e5-fbb2-4e2c-b059-53b62836edfb admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:07.536593 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 954/1940] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:41:07.538745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83f720-23aa-44c1-a892-9327eab587f0 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:07.548941 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83f720-23aa-44c1-a892-9327eab587f0 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:07.553928 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962198c5-d01c-4fd6-9fbb-2e1efa8f6fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:07.555090 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962198c5-d01c-4fd6-9fbb-2e1efa8f6fda admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:07.555382 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962198c5-d01c-4fd6-9fbb-2e1efa8f6fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:07.556128 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962198c5-d01c-4fd6-9fbb-2e1efa8f6fda admin admin] PATH_INFO: `/v3/projects/beaeed37ddb5418eacef989d7b0335f1/users/52a9802ee4364dcc93f1f2580f51f521/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:07.572204 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962198c5-d01c-4fd6-9fbb-2e1efa8f6fda admin admin] RBAC: Authorizing `identity:create_grant(project_id=beaeed37ddb5418eacef989d7b0335f1, user_id=52a9802ee4364dcc93f1f2580f51f521, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:07.575492 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962198c5-d01c-4fd6-9fbb-2e1efa8f6fda admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:07.589077 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 987/1941] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:41:07 2022] PUT /identity/v3/projects/beaeed37ddb5418eacef989d7b0335f1/users/52a9802ee4364dcc93f1f2580f51f521/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:07.594475 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562880e5-fbb2-4e2c-b059-53b62836edfb admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:07.607967 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562880e5-fbb2-4e2c-b059-53b62836edfb admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:07.675238 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba024c-1a71-4136-a81b-04e7fd4e98a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:07.676894 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba024c-1a71-4136-a81b-04e7fd4e98a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:07.676894 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba024c-1a71-4136-a81b-04e7fd4e98a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:07.677115 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba024c-1a71-4136-a81b-04e7fd4e98a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:07.677792 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba024c-1a71-4136-a81b-04e7fd4e98a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:07.680268 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba024c-1a71-4136-a81b-04e7fd4e98a5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:07.695378 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 955/1942] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:41:07.696548 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962198c5-d01c-4fd6-9fbb-2e1efa8f6fda admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:07.710350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962198c5-d01c-4fd6-9fbb-2e1efa8f6fda admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:07.715623 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba887096-9057-4786-9e75-b7e66e7f486b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:07.716681 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba887096-9057-4786-9e75-b7e66e7f486b admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:07.716966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba887096-9057-4786-9e75-b7e66e7f486b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:07.717243 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba887096-9057-4786-9e75-b7e66e7f486b admin admin] PATH_INFO: `/v3/projects/beaeed37ddb5418eacef989d7b0335f1/users/52a9802ee4364dcc93f1f2580f51f521/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:07.719806 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba887096-9057-4786-9e75-b7e66e7f486b admin admin] RBAC: Authorizing `identity:create_grant(project_id=beaeed37ddb5418eacef989d7b0335f1, user_id=52a9802ee4364dcc93f1f2580f51f521, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:07.722474 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba887096-9057-4786-9e75-b7e66e7f486b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:07.733321 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 988/1943] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:41:07 2022] PUT /identity/v3/projects/beaeed37ddb5418eacef989d7b0335f1/users/52a9802ee4364dcc93f1f2580f51f521/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:41:07.744423 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ad1f8-4a93-46ac-91cd-640d45f1d336 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:07.744753 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ad1f8-4a93-46ac-91cd-640d45f1d336 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:07.745041 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ad1f8-4a93-46ac-91cd-640d45f1d336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:07.772037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-069ad1f8-4a93-46ac-91cd-640d45f1d336 None None] MFA Rules not processed for user `52a9802ee4364dcc93f1f2580f51f521`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:07.773268 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-069ad1f8-4a93-46ac-91cd-640d45f1d336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:07.840844 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 956/1944] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:07.851450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba887096-9057-4786-9e75-b7e66e7f486b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:07.853185 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ba887096-9057-4786-9e75-b7e66e7f486b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:07.898615 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:07.913525 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba887096-9057-4786-9e75-b7e66e7f486b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:07.917440 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bdb824-5a67-4e10-9a44-5d663665fc8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:07.918093 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdb824-5a67-4e10-9a44-5d663665fc8b service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:07.918381 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdb824-5a67-4e10-9a44-5d663665fc8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:07.918690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdb824-5a67-4e10-9a44-5d663665fc8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:07.928021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bdb824-5a67-4e10-9a44-5d663665fc8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:07.929494 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bdb824-5a67-4e10-9a44-5d663665fc8b service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:07.940168 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 989/1945] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:41:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:41:08.369763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ad1f8-4a93-46ac-91cd-640d45f1d336 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:08.442161 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ad1f8-4a93-46ac-91cd-640d45f1d336 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:08.446806 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e302dc9-c5b5-44e7-ad9f-99d0f186550a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:08.447675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e302dc9-c5b5-44e7-ad9f-99d0f186550a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:08.447959 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e302dc9-c5b5-44e7-ad9f-99d0f186550a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:08.448362 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e302dc9-c5b5-44e7-ad9f-99d0f186550a admin admin] PATH_INFO: `/v3/users/ed6f51699fa24899bf4e8240defd56a7` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:08.449597 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e302dc9-c5b5-44e7-ad9f-99d0f186550a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed6f51699fa24899bf4e8240defd56a7)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:08.451535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e302dc9-c5b5-44e7-ad9f-99d0f186550a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:08.472596 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:08.517592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9e302dc9-c5b5-44e7-ad9f-99d0f186550a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed6f51699fa24899bf4e8240defd56a7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:08.518468 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9e302dc9-c5b5-44e7-ad9f-99d0f186550a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed6f51699fa24899bf4e8240defd56a7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:08.525428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9e302dc9-c5b5-44e7-ad9f-99d0f186550a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed6f51699fa24899bf4e8240defd56a7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:08.526071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9e302dc9-c5b5-44e7-ad9f-99d0f186550a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed6f51699fa24899bf4e8240defd56a7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:08.536485 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9e302dc9-c5b5-44e7-ad9f-99d0f186550a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed6f51699fa24899bf4e8240defd56a7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:08.559838 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 957/1946] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:41:08 2022] DELETE /identity/v3/users/ed6f51699fa24899bf4e8240defd56a7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:08.565831 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0430664-376d-441e-ac7b-e8dab95fb3cb None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:08.565831 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0430664-376d-441e-ac7b-e8dab95fb3cb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:08.567081 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0430664-376d-441e-ac7b-e8dab95fb3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:08.586544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b0430664-376d-441e-ac7b-e8dab95fb3cb None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:08.588202 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b0430664-376d-441e-ac7b-e8dab95fb3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:08.657618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 990/1947] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:08.668366 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e302dc9-c5b5-44e7-ad9f-99d0f186550a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:08.671125 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9e302dc9-c5b5-44e7-ad9f-99d0f186550a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:08.739513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e302dc9-c5b5-44e7-ad9f-99d0f186550a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:08.744412 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03071b-1af9-4709-9360-c1fec635749a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:08.744876 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03071b-1af9-4709-9360-c1fec635749a service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:08.745053 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03071b-1af9-4709-9360-c1fec635749a service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:08.745379 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03071b-1af9-4709-9360-c1fec635749a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:08.756183 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03071b-1af9-4709-9360-c1fec635749a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:08.757835 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03071b-1af9-4709-9360-c1fec635749a service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:08.770412 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 958/1948] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:41:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:41:09.653038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f27f57-042f-4c70-852e-b087c792d8ef None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:09.654154 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f27f57-042f-4c70-852e-b087c792d8ef None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:09.654760 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f27f57-042f-4c70-852e-b087c792d8ef None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:09.658286 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 991/1949] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 30 10:41:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:41:09.675274 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981756b6-2022-42a8-b3ce-6c77b7c304ad None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:09.675848 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981756b6-2022-42a8-b3ce-6c77b7c304ad None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:09.675848 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981756b6-2022-42a8-b3ce-6c77b7c304ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:09.698582 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-981756b6-2022-42a8-b3ce-6c77b7c304ad None None] MFA Rules not processed for user `48709a771ab64ed38018873313f37c84`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:09.700064 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-981756b6-2022-42a8-b3ce-6c77b7c304ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:09.809586 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 959/1950] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 30 10:41:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:09.911802 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f27f57-042f-4c70-852e-b087c792d8ef None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:09.915305 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b0f27f57-042f-4c70-852e-b087c792d8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:09.942920 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f27f57-042f-4c70-852e-b087c792d8ef None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:09.949916 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27819f9a-7ea8-4042-9288-07a1128177c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48709a771ab64ed38018873313f37c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:09.951076 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27819f9a-7ea8-4042-9288-07a1128177c4 service placement] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:09.951430 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27819f9a-7ea8-4042-9288-07a1128177c4 service placement] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:09.951750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27819f9a-7ea8-4042-9288-07a1128177c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:09.971419 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27819f9a-7ea8-4042-9288-07a1128177c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:09.973926 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27819f9a-7ea8-4042-9288-07a1128177c4 service placement] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:10.010758 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 992/1951] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:41:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:41:10.334883 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981756b6-2022-42a8-b3ce-6c77b7c304ad None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:10.336934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-981756b6-2022-42a8-b3ce-6c77b7c304ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:10.362068 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981756b6-2022-42a8-b3ce-6c77b7c304ad None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:10.369877 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb191a-8bfb-4177-9e37-2062922c065b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:10.370915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb191a-8bfb-4177-9e37-2062922c065b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:10.371209 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb191a-8bfb-4177-9e37-2062922c065b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:10.371494 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb191a-8bfb-4177-9e37-2062922c065b admin admin] PATH_INFO: `/v3/projects/d17a24e21f0f40468ffa1fc66d827485` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:10.374291 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb191a-8bfb-4177-9e37-2062922c065b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d17a24e21f0f40468ffa1fc66d827485)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:10.378464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb191a-8bfb-4177-9e37-2062922c065b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:10.467339 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:10.519220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-34eb191a-8bfb-4177-9e37-2062922c065b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd17a24e21f0f40468ffa1fc66d827485', 'request_id': 'req-34eb191a-8bfb-4177-9e37-2062922c065b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:10.537662 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-34eb191a-8bfb-4177-9e37-2062922c065b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd17a24e21f0f40468ffa1fc66d827485', 'request_id': 'req-34eb191a-8bfb-4177-9e37-2062922c065b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:10.553884 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-34eb191a-8bfb-4177-9e37-2062922c065b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd17a24e21f0f40468ffa1fc66d827485', 'request_id': 'req-34eb191a-8bfb-4177-9e37-2062922c065b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:10.578983 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-34eb191a-8bfb-4177-9e37-2062922c065b admin admin] The token cache is being invalidate because project d17a24e21f0f40468ffa1fc66d827485 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:41:10.580924 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-34eb191a-8bfb-4177-9e37-2062922c065b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:10.586179 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-34eb191a-8bfb-4177-9e37-2062922c065b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:10.588748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 960/1952] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:41:10 2022] DELETE /identity/v3/projects/d17a24e21f0f40468ffa1fc66d827485 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:10.592967 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27819f9a-7ea8-4042-9288-07a1128177c4 service placement] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:10.608667 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27819f9a-7ea8-4042-9288-07a1128177c4 service placement] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:10.732152 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60417af4-a4f9-4dfb-a859-fd89c8e5df8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:10.733808 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60417af4-a4f9-4dfb-a859-fd89c8e5df8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:10.734270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60417af4-a4f9-4dfb-a859-fd89c8e5df8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:10.734825 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60417af4-a4f9-4dfb-a859-fd89c8e5df8e admin admin] PATH_INFO: `/v3/users/52a9802ee4364dcc93f1f2580f51f521` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:10.736625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60417af4-a4f9-4dfb-a859-fd89c8e5df8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=52a9802ee4364dcc93f1f2580f51f521)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:10.738957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60417af4-a4f9-4dfb-a859-fd89c8e5df8e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:10.806575 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-60417af4-a4f9-4dfb-a859-fd89c8e5df8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52a9802ee4364dcc93f1f2580f51f521'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:10.832127 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-60417af4-a4f9-4dfb-a859-fd89c8e5df8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52a9802ee4364dcc93f1f2580f51f521'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:10.832127 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-60417af4-a4f9-4dfb-a859-fd89c8e5df8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52a9802ee4364dcc93f1f2580f51f521'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:10.833003 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:10.835162 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-60417af4-a4f9-4dfb-a859-fd89c8e5df8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52a9802ee4364dcc93f1f2580f51f521'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:10.835896 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-60417af4-a4f9-4dfb-a859-fd89c8e5df8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52a9802ee4364dcc93f1f2580f51f521'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:10.850145 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 993/1953] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:41:10 2022] DELETE /identity/v3/users/52a9802ee4364dcc93f1f2580f51f521 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:11.099774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb191a-8bfb-4177-9e37-2062922c065b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:11.102402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-34eb191a-8bfb-4177-9e37-2062922c065b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:11.116964 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb191a-8bfb-4177-9e37-2062922c065b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:11.167403 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60417af4-a4f9-4dfb-a859-fd89c8e5df8e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:11.169186 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-60417af4-a4f9-4dfb-a859-fd89c8e5df8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:11.211913 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff7b3d-0d49-4014-8c5f-6e71e51478b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:11.215328 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff7b3d-0d49-4014-8c5f-6e71e51478b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:11.215623 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff7b3d-0d49-4014-8c5f-6e71e51478b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:11.215900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff7b3d-0d49-4014-8c5f-6e71e51478b1 admin admin] PATH_INFO: `/v3/users/7481d5fcc72b448f985d127ee4d62fe6` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:11.219687 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff7b3d-0d49-4014-8c5f-6e71e51478b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7481d5fcc72b448f985d127ee4d62fe6)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:11.222457 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff7b3d-0d49-4014-8c5f-6e71e51478b1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:11.303177 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60417af4-a4f9-4dfb-a859-fd89c8e5df8e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:11.312378 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c7220-2229-4c86-9724-b1b319fa7a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:11.313533 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c7220-2229-4c86-9724-b1b319fa7a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:11.313961 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c7220-2229-4c86-9724-b1b319fa7a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:11.314305 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c7220-2229-4c86-9724-b1b319fa7a36 admin admin] PATH_INFO: `/v3/projects/beaeed37ddb5418eacef989d7b0335f1` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:11.319865 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c7220-2229-4c86-9724-b1b319fa7a36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beaeed37ddb5418eacef989d7b0335f1)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:11.321940 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c7220-2229-4c86-9724-b1b319fa7a36 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:11.328319 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-afff7b3d-0d49-4014-8c5f-6e71e51478b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7481d5fcc72b448f985d127ee4d62fe6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:11.329066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-afff7b3d-0d49-4014-8c5f-6e71e51478b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7481d5fcc72b448f985d127ee4d62fe6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:11.341858 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-afff7b3d-0d49-4014-8c5f-6e71e51478b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7481d5fcc72b448f985d127ee4d62fe6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:11.342634 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-afff7b3d-0d49-4014-8c5f-6e71e51478b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7481d5fcc72b448f985d127ee4d62fe6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:11.354015 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-afff7b3d-0d49-4014-8c5f-6e71e51478b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7481d5fcc72b448f985d127ee4d62fe6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:11.382827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 961/1954] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:41:11 2022] DELETE /identity/v3/users/7481d5fcc72b448f985d127ee4d62fe6 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:11.387204 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e40c7220-2229-4c86-9724-b1b319fa7a36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beaeed37ddb5418eacef989d7b0335f1', 'request_id': 'req-e40c7220-2229-4c86-9724-b1b319fa7a36'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:11.398526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e40c7220-2229-4c86-9724-b1b319fa7a36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beaeed37ddb5418eacef989d7b0335f1', 'request_id': 'req-e40c7220-2229-4c86-9724-b1b319fa7a36'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:11.409766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e40c7220-2229-4c86-9724-b1b319fa7a36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beaeed37ddb5418eacef989d7b0335f1', 'request_id': 'req-e40c7220-2229-4c86-9724-b1b319fa7a36'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:11.422138 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e40c7220-2229-4c86-9724-b1b319fa7a36 admin admin] The token cache is being invalidate because project beaeed37ddb5418eacef989d7b0335f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:41:11.422467 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e40c7220-2229-4c86-9724-b1b319fa7a36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:11.423084 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e40c7220-2229-4c86-9724-b1b319fa7a36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:11.428021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 994/1955] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:41:11 2022] DELETE /identity/v3/projects/beaeed37ddb5418eacef989d7b0335f1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:41:11.429773 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c046b92-208f-496b-927f-78133c04780a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:11.430083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c046b92-208f-496b-927f-78133c04780a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:11.430365 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c046b92-208f-496b-927f-78133c04780a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:11.455156 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9c046b92-208f-496b-927f-78133c04780a None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:11.456658 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9c046b92-208f-496b-927f-78133c04780a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:11.495610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:11.546968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 962/1956] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:11.549412 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e24c9a-78a4-4ece-97bd-33fcca391b21 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:11.549412 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e24c9a-78a4-4ece-97bd-33fcca391b21 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:11.550016 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e24c9a-78a4-4ece-97bd-33fcca391b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:11.573885 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a6e24c9a-78a4-4ece-97bd-33fcca391b21 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:11.575493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a6e24c9a-78a4-4ece-97bd-33fcca391b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:11.590078 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 995/1957] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:11.591840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c046b92-208f-496b-927f-78133c04780a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:11.603107 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c046b92-208f-496b-927f-78133c04780a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:11.608852 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10c708-3b76-4369-a7e9-2290889d9684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:11.609585 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10c708-3b76-4369-a7e9-2290889d9684 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:11.609936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10c708-3b76-4369-a7e9-2290889d9684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:11.610280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10c708-3b76-4369-a7e9-2290889d9684 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:11.611109 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10c708-3b76-4369-a7e9-2290889d9684 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:41:11.611480 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10c708-3b76-4369-a7e9-2290889d9684 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:11.613237 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10c708-3b76-4369-a7e9-2290889d9684 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:11.628576 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 963/1958] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:41:11.631603 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e24c9a-78a4-4ece-97bd-33fcca391b21 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:11.644622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e24c9a-78a4-4ece-97bd-33fcca391b21 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:11.651009 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1cb8d-571d-46aa-9c56-b85e41fec5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:11.651682 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1cb8d-571d-46aa-9c56-b85e41fec5df admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:11.651961 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1cb8d-571d-46aa-9c56-b85e41fec5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:11.652233 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1cb8d-571d-46aa-9c56-b85e41fec5df admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:11.652960 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1cb8d-571d-46aa-9c56-b85e41fec5df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:11.655431 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1cb8d-571d-46aa-9c56-b85e41fec5df admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:11.697780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 996/1959] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:41:11 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:41:11.701561 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10c708-3b76-4369-a7e9-2290889d9684 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:11.713167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10c708-3b76-4369-a7e9-2290889d9684 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:11.748296 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1cb8d-571d-46aa-9c56-b85e41fec5df admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:11.750454 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-38a1cb8d-571d-46aa-9c56-b85e41fec5df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:11.789703 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17f0e3-9917-47a0-be01-e95eca8cbda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:11.790438 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17f0e3-9917-47a0-be01-e95eca8cbda4 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:11.790731 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17f0e3-9917-47a0-be01-e95eca8cbda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:11.791010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17f0e3-9917-47a0-be01-e95eca8cbda4 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:11.791714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17f0e3-9917-47a0-be01-e95eca8cbda4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:11.793802 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17f0e3-9917-47a0-be01-e95eca8cbda4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:11.824659 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 964/1960] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:41:11 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:41:11.827445 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17f0e3-9917-47a0-be01-e95eca8cbda4 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:11.828996 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:11.840158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17f0e3-9917-47a0-be01-e95eca8cbda4 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:11.848436 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a4b0e-511f-4a7f-a261-c079c37d9530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:11.849137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a4b0e-511f-4a7f-a261-c079c37d9530 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:11.849419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a4b0e-511f-4a7f-a261-c079c37d9530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:11.849690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a4b0e-511f-4a7f-a261-c079c37d9530 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:11.850556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a4b0e-511f-4a7f-a261-c079c37d9530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:11.852126 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1cb8d-571d-46aa-9c56-b85e41fec5df admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:11.852250 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a4b0e-511f-4a7f-a261-c079c37d9530 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:11.863748 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97905efb-b7cb-498f-a4bf-7d537fb784f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:11.864795 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 965/1961] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:41:11.865076 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97905efb-b7cb-498f-a4bf-7d537fb784f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:11.865432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97905efb-b7cb-498f-a4bf-7d537fb784f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:11.865779 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97905efb-b7cb-498f-a4bf-7d537fb784f6 admin admin] PATH_INFO: `/v3/projects/699b9ccef6394632aa632e371045a2f1` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:11.867064 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97905efb-b7cb-498f-a4bf-7d537fb784f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=699b9ccef6394632aa632e371045a2f1)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:11.869388 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97905efb-b7cb-498f-a4bf-7d537fb784f6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:11.869529 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a4b0e-511f-4a7f-a261-c079c37d9530 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:11.881022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a4b0e-511f-4a7f-a261-c079c37d9530 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:11.886658 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba41c2e-5826-43d0-8405-05775cab2918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:11.888463 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba41c2e-5826-43d0-8405-05775cab2918 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:11.888463 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba41c2e-5826-43d0-8405-05775cab2918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:11.888463 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba41c2e-5826-43d0-8405-05775cab2918 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:11.889494 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba41c2e-5826-43d0-8405-05775cab2918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:11.891263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba41c2e-5826-43d0-8405-05775cab2918 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:11.908121 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 966/1962] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:41:11.909271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba41c2e-5826-43d0-8405-05775cab2918 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:11.922924 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba41c2e-5826-43d0-8405-05775cab2918 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:11.934478 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-97905efb-b7cb-498f-a4bf-7d537fb784f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '699b9ccef6394632aa632e371045a2f1', 'request_id': 'req-97905efb-b7cb-498f-a4bf-7d537fb784f6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:11.945784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-97905efb-b7cb-498f-a4bf-7d537fb784f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '699b9ccef6394632aa632e371045a2f1', 'request_id': 'req-97905efb-b7cb-498f-a4bf-7d537fb784f6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:11.954580 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-97905efb-b7cb-498f-a4bf-7d537fb784f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '699b9ccef6394632aa632e371045a2f1', 'request_id': 'req-97905efb-b7cb-498f-a4bf-7d537fb784f6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:11.974187 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-97905efb-b7cb-498f-a4bf-7d537fb784f6 admin admin] The token cache is being invalidate because project 699b9ccef6394632aa632e371045a2f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:41:11.975044 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-97905efb-b7cb-498f-a4bf-7d537fb784f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:11.976076 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-97905efb-b7cb-498f-a4bf-7d537fb784f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:11.979462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 997/1963] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:41:11 2022] DELETE /identity/v3/projects/699b9ccef6394632aa632e371045a2f1 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:41:11.986297 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97905efb-b7cb-498f-a4bf-7d537fb784f6 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:11.989504 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-97905efb-b7cb-498f-a4bf-7d537fb784f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:12.001396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af0b52-85f7-4bb5-a884-5c9aabc2106e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:12.002766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af0b52-85f7-4bb5-a884-5c9aabc2106e admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:12.003083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af0b52-85f7-4bb5-a884-5c9aabc2106e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:12.003363 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af0b52-85f7-4bb5-a884-5c9aabc2106e admin admin] PATH_INFO: `/v3/projects/31f00c3f5e574b949cd18ac2090adf0d/users/2f14d07549a44f06b25056254945ca52/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:12.021312 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af0b52-85f7-4bb5-a884-5c9aabc2106e admin admin] RBAC: Authorizing `identity:create_grant(project_id=31f00c3f5e574b949cd18ac2090adf0d, user_id=2f14d07549a44f06b25056254945ca52, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:12.024151 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af0b52-85f7-4bb5-a884-5c9aabc2106e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:12.046539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 967/1964] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:41:11 2022] PUT /identity/v3/projects/31f00c3f5e574b949cd18ac2090adf0d/users/2f14d07549a44f06b25056254945ca52/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:12.056339 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfbf1b-e63f-4ae9-8523-8442196c9538 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:12.056672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfbf1b-e63f-4ae9-8523-8442196c9538 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:12.056958 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfbf1b-e63f-4ae9-8523-8442196c9538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:12.080043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97905efb-b7cb-498f-a4bf-7d537fb784f6 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:12.081054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:12.084260 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3bcfbf1b-e63f-4ae9-8523-8442196c9538 None None] MFA Rules not processed for user `2f14d07549a44f06b25056254945ca52`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:12.086827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3bcfbf1b-e63f-4ae9-8523-8442196c9538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:12.148091 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0811b-57f2-43e3-bbde-b47e979360ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:12.149111 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0811b-57f2-43e3-bbde-b47e979360ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:12.149480 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0811b-57f2-43e3-bbde-b47e979360ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:12.149958 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0811b-57f2-43e3-bbde-b47e979360ea admin admin] PATH_INFO: `/v3/users/358b47d885c34eecb295abb42d2427bc` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:12.151389 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0811b-57f2-43e3-bbde-b47e979360ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=358b47d885c34eecb295abb42d2427bc)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:12.153732 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0811b-57f2-43e3-bbde-b47e979360ea admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:12.186221 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 968/1965] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:41:12.194085 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:12.200682 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfbf1b-e63f-4ae9-8523-8442196c9538 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:12.202978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3bcfbf1b-e63f-4ae9-8523-8442196c9538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:12.211243 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9bd0811b-57f2-43e3-bbde-b47e979360ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '358b47d885c34eecb295abb42d2427bc'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:12.224327 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9bd0811b-57f2-43e3-bbde-b47e979360ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '358b47d885c34eecb295abb42d2427bc'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:12.225278 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9bd0811b-57f2-43e3-bbde-b47e979360ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '358b47d885c34eecb295abb42d2427bc'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:12.234494 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9bd0811b-57f2-43e3-bbde-b47e979360ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '358b47d885c34eecb295abb42d2427bc'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:12.235275 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9bd0811b-57f2-43e3-bbde-b47e979360ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '358b47d885c34eecb295abb42d2427bc'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:12.254522 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 998/1966] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:41:11 2022] DELETE /identity/v3/users/358b47d885c34eecb295abb42d2427bc => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:12.306177 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfbf1b-e63f-4ae9-8523-8442196c9538 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:12.370855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094dcb00-f7cb-4c2c-9b4b-c10b46a3218b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:12.371428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094dcb00-f7cb-4c2c-9b4b-c10b46a3218b service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:12.372083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094dcb00-f7cb-4c2c-9b4b-c10b46a3218b service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:12.372083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094dcb00-f7cb-4c2c-9b4b-c10b46a3218b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:12.374455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-094dcb00-f7cb-4c2c-9b4b-c10b46a3218b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:12.456753 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094dcb00-f7cb-4c2c-9b4b-c10b46a3218b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:12.458336 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094dcb00-f7cb-4c2c-9b4b-c10b46a3218b service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:12.465504 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0811b-57f2-43e3-bbde-b47e979360ea admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:12.467145 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9bd0811b-57f2-43e3-bbde-b47e979360ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:12.476696 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 969/1967] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:41:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:41:12.569056 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0811b-57f2-43e3-bbde-b47e979360ea admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:12.573829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad7c0f-25d1-422f-a32d-8183af46f5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:12.574798 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad7c0f-25d1-422f-a32d-8183af46f5d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:12.575159 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad7c0f-25d1-422f-a32d-8183af46f5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:12.575513 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad7c0f-25d1-422f-a32d-8183af46f5d3 admin admin] PATH_INFO: `/v3/projects/34ba620ddbc5461a8680dd374d252e87` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:12.577450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad7c0f-25d1-422f-a32d-8183af46f5d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34ba620ddbc5461a8680dd374d252e87)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:12.579501 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad7c0f-25d1-422f-a32d-8183af46f5d3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:12.648570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d6ad7c0f-25d1-422f-a32d-8183af46f5d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34ba620ddbc5461a8680dd374d252e87', 'request_id': 'req-d6ad7c0f-25d1-422f-a32d-8183af46f5d3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:12.655616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d6ad7c0f-25d1-422f-a32d-8183af46f5d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34ba620ddbc5461a8680dd374d252e87', 'request_id': 'req-d6ad7c0f-25d1-422f-a32d-8183af46f5d3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:12.662707 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d6ad7c0f-25d1-422f-a32d-8183af46f5d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34ba620ddbc5461a8680dd374d252e87', 'request_id': 'req-d6ad7c0f-25d1-422f-a32d-8183af46f5d3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:12.675357 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d6ad7c0f-25d1-422f-a32d-8183af46f5d3 admin admin] The token cache is being invalidate because project 34ba620ddbc5461a8680dd374d252e87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:41:12.675650 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d6ad7c0f-25d1-422f-a32d-8183af46f5d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:12.676300 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d6ad7c0f-25d1-422f-a32d-8183af46f5d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:12.677872 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 999/1968] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:41:12 2022] DELETE /identity/v3/projects/34ba620ddbc5461a8680dd374d252e87 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:12.682712 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62674348-440e-40e8-ae4c-060dc4859919 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:12.683003 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62674348-440e-40e8-ae4c-060dc4859919 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:12.683281 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62674348-440e-40e8-ae4c-060dc4859919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:12.702987 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-62674348-440e-40e8-ae4c-060dc4859919 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:12.704230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-62674348-440e-40e8-ae4c-060dc4859919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:12.712810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:12.769320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 970/1969] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:12.776555 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5daf0e-5fb6-45df-b85d-c7d608adf052 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:12.777016 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5daf0e-5fb6-45df-b85d-c7d608adf052 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:12.777173 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5daf0e-5fb6-45df-b85d-c7d608adf052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:12.799029 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ac5daf0e-5fb6-45df-b85d-c7d608adf052 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:12.800392 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ac5daf0e-5fb6-45df-b85d-c7d608adf052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:12.809174 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1000/1970] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:12.818344 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62674348-440e-40e8-ae4c-060dc4859919 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:12.828671 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62674348-440e-40e8-ae4c-060dc4859919 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:12.833598 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551038b3-b401-43be-995e-881ebb85d55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:12.834212 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551038b3-b401-43be-995e-881ebb85d55e admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:12.834596 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551038b3-b401-43be-995e-881ebb85d55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:12.834772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551038b3-b401-43be-995e-881ebb85d55e admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:12.835505 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551038b3-b401-43be-995e-881ebb85d55e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:41:12.835820 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551038b3-b401-43be-995e-881ebb85d55e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:12.837636 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551038b3-b401-43be-995e-881ebb85d55e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:12.853182 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 971/1971] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:41:12.857442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5daf0e-5fb6-45df-b85d-c7d608adf052 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:12.871138 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5daf0e-5fb6-45df-b85d-c7d608adf052 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:12.885605 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d690a3-5c7a-4e20-b58c-5188b5c90d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:12.886375 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d690a3-5c7a-4e20-b58c-5188b5c90d84 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:12.886811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d690a3-5c7a-4e20-b58c-5188b5c90d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:12.887229 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d690a3-5c7a-4e20-b58c-5188b5c90d84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:12.888165 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d690a3-5c7a-4e20-b58c-5188b5c90d84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:12.890534 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d690a3-5c7a-4e20-b58c-5188b5c90d84 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:12.919090 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1001/1972] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:41:12 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:41:12.923254 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551038b3-b401-43be-995e-881ebb85d55e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:12.933462 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551038b3-b401-43be-995e-881ebb85d55e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:12.997129 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec732f59-fd50-41dc-bbad-544428054681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:12.997806 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec732f59-fd50-41dc-bbad-544428054681 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:12.998097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec732f59-fd50-41dc-bbad-544428054681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:12.998384 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec732f59-fd50-41dc-bbad-544428054681 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:12.999643 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec732f59-fd50-41dc-bbad-544428054681 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:13.001622 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec732f59-fd50-41dc-bbad-544428054681 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:13.021792 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 972/1973] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:41:12 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:41:13.025787 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d690a3-5c7a-4e20-b58c-5188b5c90d84 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:13.036208 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d690a3-5c7a-4e20-b58c-5188b5c90d84 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:13.041216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ba419-4435-470e-9c78-ca6a121ce371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:13.041955 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ba419-4435-470e-9c78-ca6a121ce371 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:13.042329 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ba419-4435-470e-9c78-ca6a121ce371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:13.042676 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ba419-4435-470e-9c78-ca6a121ce371 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:13.043753 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ba419-4435-470e-9c78-ca6a121ce371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:13.046153 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ba419-4435-470e-9c78-ca6a121ce371 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:13.054598 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:13.071009 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1002/1974] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:41:13.072552 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec732f59-fd50-41dc-bbad-544428054681 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:13.083079 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec732f59-fd50-41dc-bbad-544428054681 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:13.088429 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6457fc-0669-4266-b307-bdc66ece4f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:13.089171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6457fc-0669-4266-b307-bdc66ece4f20 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:13.089470 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6457fc-0669-4266-b307-bdc66ece4f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:13.089780 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6457fc-0669-4266-b307-bdc66ece4f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:13.090615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6457fc-0669-4266-b307-bdc66ece4f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:13.092758 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6457fc-0669-4266-b307-bdc66ece4f20 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:13.106171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 973/1975] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:41:13.107615 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ba419-4435-470e-9c78-ca6a121ce371 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:13.118201 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ba419-4435-470e-9c78-ca6a121ce371 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:13.122945 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1850ee-0658-44c6-8814-2d295c37e7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:13.123866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1850ee-0658-44c6-8814-2d295c37e7f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:13.124182 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1850ee-0658-44c6-8814-2d295c37e7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:13.124457 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1850ee-0658-44c6-8814-2d295c37e7f5 admin admin] PATH_INFO: `/v3/projects/ade5608bdb5b4f138c9e715ceb13a125/users/8e2c507431b74df5bb0decaedef978a9/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:13.139105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1850ee-0658-44c6-8814-2d295c37e7f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ade5608bdb5b4f138c9e715ceb13a125, user_id=8e2c507431b74df5bb0decaedef978a9, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:13.141849 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1850ee-0658-44c6-8814-2d295c37e7f5 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:13.156179 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1003/1976] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:41:13 2022] PUT /identity/v3/projects/ade5608bdb5b4f138c9e715ceb13a125/users/8e2c507431b74df5bb0decaedef978a9/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:13.167114 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0e611-0676-4e09-8084-47fbf85c6241 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:13.167499 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0e611-0676-4e09-8084-47fbf85c6241 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:13.167871 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0e611-0676-4e09-8084-47fbf85c6241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:13.195532 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d5d0e611-0676-4e09-8084-47fbf85c6241 None None] MFA Rules not processed for user `8e2c507431b74df5bb0decaedef978a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:13.196779 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d5d0e611-0676-4e09-8084-47fbf85c6241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:13.268142 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 974/1977] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:13.279473 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1850ee-0658-44c6-8814-2d295c37e7f5 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:13.281724 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4f1850ee-0658-44c6-8814-2d295c37e7f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:13.337031 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1850ee-0658-44c6-8814-2d295c37e7f5 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:13.340601 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6baac2c-1d91-4edc-becc-9400ad161396 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:13.341235 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baac2c-1d91-4edc-becc-9400ad161396 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:13.341514 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baac2c-1d91-4edc-becc-9400ad161396 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:13.341786 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baac2c-1d91-4edc-becc-9400ad161396 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:13.350326 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6baac2c-1d91-4edc-becc-9400ad161396 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:13.351737 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6baac2c-1d91-4edc-becc-9400ad161396 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:13.361460 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1004/1978] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:41:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:41:13.379418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0e611-0676-4e09-8084-47fbf85c6241 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:13.389028 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:13.442718 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0e611-0676-4e09-8084-47fbf85c6241 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:13.447475 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa8bde-13d7-4989-9e72-a3d87e89398f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:13.448272 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa8bde-13d7-4989-9e72-a3d87e89398f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:13.448613 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa8bde-13d7-4989-9e72-a3d87e89398f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:13.448891 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa8bde-13d7-4989-9e72-a3d87e89398f admin admin] PATH_INFO: `/v3/users/8e2c507431b74df5bb0decaedef978a9` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:13.450071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa8bde-13d7-4989-9e72-a3d87e89398f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e2c507431b74df5bb0decaedef978a9)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:13.452474 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa8bde-13d7-4989-9e72-a3d87e89398f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:13.497870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-65aa8bde-13d7-4989-9e72-a3d87e89398f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e2c507431b74df5bb0decaedef978a9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:13.498563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-65aa8bde-13d7-4989-9e72-a3d87e89398f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e2c507431b74df5bb0decaedef978a9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:13.505398 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-65aa8bde-13d7-4989-9e72-a3d87e89398f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e2c507431b74df5bb0decaedef978a9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:13.506045 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-65aa8bde-13d7-4989-9e72-a3d87e89398f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e2c507431b74df5bb0decaedef978a9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:13.513022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-65aa8bde-13d7-4989-9e72-a3d87e89398f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e2c507431b74df5bb0decaedef978a9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:13.531768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 975/1979] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:41:13 2022] DELETE /identity/v3/users/8e2c507431b74df5bb0decaedef978a9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:13.536118 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f43384-8245-4660-a552-600d90861d16 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:13.536527 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f43384-8245-4660-a552-600d90861d16 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:13.536918 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f43384-8245-4660-a552-600d90861d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:13.555754 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e7f43384-8245-4660-a552-600d90861d16 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:13.557278 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e7f43384-8245-4660-a552-600d90861d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:13.622815 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1005/1980] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:13.632853 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa8bde-13d7-4989-9e72-a3d87e89398f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:13.634349 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-65aa8bde-13d7-4989-9e72-a3d87e89398f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:13.695376 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa8bde-13d7-4989-9e72-a3d87e89398f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:13.699485 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3748d-6a02-4bf5-9c9f-45af08fa867c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:13.700120 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3748d-6a02-4bf5-9c9f-45af08fa867c service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:13.700352 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3748d-6a02-4bf5-9c9f-45af08fa867c service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:13.700701 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3748d-6a02-4bf5-9c9f-45af08fa867c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:13.710484 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3748d-6a02-4bf5-9c9f-45af08fa867c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:13.711933 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3748d-6a02-4bf5-9c9f-45af08fa867c service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:13.722187 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 976/1981] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:41:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:41:14.004786 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f43384-8245-4660-a552-600d90861d16 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:14.006414 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e7f43384-8245-4660-a552-600d90861d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:14.032533 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f43384-8245-4660-a552-600d90861d16 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:14.036220 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c97b9-7016-49cc-a052-4b9f5cbf9cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:14.037679 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c97b9-7016-49cc-a052-4b9f5cbf9cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:14.037840 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c97b9-7016-49cc-a052-4b9f5cbf9cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:14.038137 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c97b9-7016-49cc-a052-4b9f5cbf9cc1 admin admin] PATH_INFO: `/v3/projects/ade5608bdb5b4f138c9e715ceb13a125` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:14.039383 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c97b9-7016-49cc-a052-4b9f5cbf9cc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ade5608bdb5b4f138c9e715ceb13a125)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:14.041733 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c97b9-7016-49cc-a052-4b9f5cbf9cc1 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:14.107455 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e32c97b9-7016-49cc-a052-4b9f5cbf9cc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ade5608bdb5b4f138c9e715ceb13a125', 'request_id': 'req-e32c97b9-7016-49cc-a052-4b9f5cbf9cc1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:14.118917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e32c97b9-7016-49cc-a052-4b9f5cbf9cc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ade5608bdb5b4f138c9e715ceb13a125', 'request_id': 'req-e32c97b9-7016-49cc-a052-4b9f5cbf9cc1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:14.134242 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e32c97b9-7016-49cc-a052-4b9f5cbf9cc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ade5608bdb5b4f138c9e715ceb13a125', 'request_id': 'req-e32c97b9-7016-49cc-a052-4b9f5cbf9cc1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:14.151369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:14.156195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e32c97b9-7016-49cc-a052-4b9f5cbf9cc1 admin admin] The token cache is being invalidate because project ade5608bdb5b4f138c9e715ceb13a125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:41:14.157122 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e32c97b9-7016-49cc-a052-4b9f5cbf9cc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:14.159301 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e32c97b9-7016-49cc-a052-4b9f5cbf9cc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:14.161754 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1006/1982] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:41:14 2022] DELETE /identity/v3/projects/ade5608bdb5b4f138c9e715ceb13a125 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:41:14.168169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02125c3-a00a-4e0c-abef-b435a52ea0de None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:14.168169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02125c3-a00a-4e0c-abef-b435a52ea0de None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:14.168169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02125c3-a00a-4e0c-abef-b435a52ea0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:14.188904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d02125c3-a00a-4e0c-abef-b435a52ea0de None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:14.190392 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d02125c3-a00a-4e0c-abef-b435a52ea0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:14.230824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:14.298417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 977/1983] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:14.305728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf83bf-1118-4006-a238-5cf4167b8556 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:14.306023 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf83bf-1118-4006-a238-5cf4167b8556 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:14.306494 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf83bf-1118-4006-a238-5cf4167b8556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:14.333396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-afaf83bf-1118-4006-a238-5cf4167b8556 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:14.335519 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-afaf83bf-1118-4006-a238-5cf4167b8556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:14.347937 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1007/1984] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:14.352524 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02125c3-a00a-4e0c-abef-b435a52ea0de None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:14.364219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02125c3-a00a-4e0c-abef-b435a52ea0de None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:14.372305 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb1f4e-10e2-4db0-852e-51072f17302f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:14.373158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb1f4e-10e2-4db0-852e-51072f17302f admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:14.373353 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb1f4e-10e2-4db0-852e-51072f17302f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:14.374198 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb1f4e-10e2-4db0-852e-51072f17302f admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:14.375162 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb1f4e-10e2-4db0-852e-51072f17302f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:41:14.375359 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb1f4e-10e2-4db0-852e-51072f17302f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:14.377685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb1f4e-10e2-4db0-852e-51072f17302f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:14.399074 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf83bf-1118-4006-a238-5cf4167b8556 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:14.403551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 978/1985] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:41:14.409692 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf83bf-1118-4006-a238-5cf4167b8556 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:14.416741 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c56a6-6e07-4909-8a52-331c1f09320e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:14.418075 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c56a6-6e07-4909-8a52-331c1f09320e admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:14.418587 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c56a6-6e07-4909-8a52-331c1f09320e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:14.419633 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c56a6-6e07-4909-8a52-331c1f09320e admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:14.421286 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c56a6-6e07-4909-8a52-331c1f09320e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:14.423907 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c56a6-6e07-4909-8a52-331c1f09320e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:14.460421 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1008/1986] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:41:14 2022] POST /identity/v3/projects => generated 359 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:41:14.465008 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb1f4e-10e2-4db0-852e-51072f17302f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:14.477948 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb1f4e-10e2-4db0-852e-51072f17302f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:14.546757 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967d483-7dd2-433e-96e3-c661946e82a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:14.547754 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967d483-7dd2-433e-96e3-c661946e82a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:14.548152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967d483-7dd2-433e-96e3-c661946e82a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:14.548551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967d483-7dd2-433e-96e3-c661946e82a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:14.549377 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967d483-7dd2-433e-96e3-c661946e82a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:14.551435 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967d483-7dd2-433e-96e3-c661946e82a6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:14.575363 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 979/1987] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:41:14 2022] POST /identity/v3/users => generated 280 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:41:14.579148 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c56a6-6e07-4909-8a52-331c1f09320e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:14.589810 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c56a6-6e07-4909-8a52-331c1f09320e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:14.595339 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18ca21-59e6-4841-bfa6-410fb888209e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:14.596428 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18ca21-59e6-4841-bfa6-410fb888209e admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:14.596428 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18ca21-59e6-4841-bfa6-410fb888209e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:14.596777 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18ca21-59e6-4841-bfa6-410fb888209e admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:14.597414 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18ca21-59e6-4841-bfa6-410fb888209e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:14.599079 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18ca21-59e6-4841-bfa6-410fb888209e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:14.611143 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1009/1988] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:41:14.616795 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967d483-7dd2-433e-96e3-c661946e82a6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:14.626866 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967d483-7dd2-433e-96e3-c661946e82a6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:14.632363 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f7a40-01a5-4259-98a0-2ef0a2278556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:14.633056 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f7a40-01a5-4259-98a0-2ef0a2278556 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:14.633342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f7a40-01a5-4259-98a0-2ef0a2278556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:14.633620 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f7a40-01a5-4259-98a0-2ef0a2278556 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:14.634339 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f7a40-01a5-4259-98a0-2ef0a2278556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:14.635942 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f7a40-01a5-4259-98a0-2ef0a2278556 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:14.646382 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 980/1989] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:41:14.650636 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18ca21-59e6-4841-bfa6-410fb888209e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:14.662221 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18ca21-59e6-4841-bfa6-410fb888209e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:14.666848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847192f-2d9c-42d7-ba0e-7d7efb777bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:14.667736 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847192f-2d9c-42d7-ba0e-7d7efb777bad admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:14.668068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847192f-2d9c-42d7-ba0e-7d7efb777bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:14.668336 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847192f-2d9c-42d7-ba0e-7d7efb777bad admin admin] PATH_INFO: `/v3/projects/a2c69217a9c74a53a4287ad6342dee17/users/126e1edb7c6c46b4896b11df9d3bec40/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:14.684091 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847192f-2d9c-42d7-ba0e-7d7efb777bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2c69217a9c74a53a4287ad6342dee17, user_id=126e1edb7c6c46b4896b11df9d3bec40, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:14.686849 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847192f-2d9c-42d7-ba0e-7d7efb777bad admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:14.701225 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1010/1990] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:41:14 2022] PUT /identity/v3/projects/a2c69217a9c74a53a4287ad6342dee17/users/126e1edb7c6c46b4896b11df9d3bec40/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:14.711650 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad80bb-8612-49d3-a476-473ad22aa9cc None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:14.711946 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad80bb-8612-49d3-a476-473ad22aa9cc None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:14.712227 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad80bb-8612-49d3-a476-473ad22aa9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:14.741376 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b0ad80bb-8612-49d3-a476-473ad22aa9cc None None] MFA Rules not processed for user `126e1edb7c6c46b4896b11df9d3bec40`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:14.742504 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b0ad80bb-8612-49d3-a476-473ad22aa9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:14.817425 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 981/1991] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:14 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:14.855847 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847192f-2d9c-42d7-ba0e-7d7efb777bad admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:14.858782 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d847192f-2d9c-42d7-ba0e-7d7efb777bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:14.927514 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847192f-2d9c-42d7-ba0e-7d7efb777bad admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:14.932754 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd67464-7248-463b-9772-2f442ee5b817 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:14.933409 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd67464-7248-463b-9772-2f442ee5b817 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:14.933735 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd67464-7248-463b-9772-2f442ee5b817 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:14.934006 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd67464-7248-463b-9772-2f442ee5b817 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:14.944016 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd67464-7248-463b-9772-2f442ee5b817 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:14.945494 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd67464-7248-463b-9772-2f442ee5b817 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:14.957123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1011/1992] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:41:14 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:41:14.972359 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad80bb-8612-49d3-a476-473ad22aa9cc None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:15.008146 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:15.075403 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad80bb-8612-49d3-a476-473ad22aa9cc None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:15.080705 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ffb0d-8982-48a9-8013-19cb15d06e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:15.081575 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ffb0d-8982-48a9-8013-19cb15d06e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:15.081853 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ffb0d-8982-48a9-8013-19cb15d06e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:15.082145 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ffb0d-8982-48a9-8013-19cb15d06e81 admin admin] PATH_INFO: `/v3/users/126e1edb7c6c46b4896b11df9d3bec40` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:15.083469 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ffb0d-8982-48a9-8013-19cb15d06e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=126e1edb7c6c46b4896b11df9d3bec40)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:15.085964 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ffb0d-8982-48a9-8013-19cb15d06e81 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:15.139583 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-165ffb0d-8982-48a9-8013-19cb15d06e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '126e1edb7c6c46b4896b11df9d3bec40'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:15.140264 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-165ffb0d-8982-48a9-8013-19cb15d06e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '126e1edb7c6c46b4896b11df9d3bec40'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:15.147132 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-165ffb0d-8982-48a9-8013-19cb15d06e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '126e1edb7c6c46b4896b11df9d3bec40'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:15.147755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-165ffb0d-8982-48a9-8013-19cb15d06e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '126e1edb7c6c46b4896b11df9d3bec40'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:15.155688 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-165ffb0d-8982-48a9-8013-19cb15d06e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '126e1edb7c6c46b4896b11df9d3bec40'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:15.172641 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 982/1993] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:41:14 2022] DELETE /identity/v3/users/126e1edb7c6c46b4896b11df9d3bec40 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:15.177084 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a0f4d-0363-4977-ac10-cf052210c044 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:15.177547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a0f4d-0363-4977-ac10-cf052210c044 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:15.177649 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a0f4d-0363-4977-ac10-cf052210c044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:15.194420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-376a0f4d-0363-4977-ac10-cf052210c044 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:15.195597 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-376a0f4d-0363-4977-ac10-cf052210c044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:15.252421 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1012/1994] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:41:15.262039 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ffb0d-8982-48a9-8013-19cb15d06e81 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:15.263521 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-165ffb0d-8982-48a9-8013-19cb15d06e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:15.322745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ffb0d-8982-48a9-8013-19cb15d06e81 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:15.326432 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afc546-8dd0-45e2-99f3-3303f839096e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:15.327604 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afc546-8dd0-45e2-99f3-3303f839096e service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:15.327890 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afc546-8dd0-45e2-99f3-3303f839096e service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:15.328165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afc546-8dd0-45e2-99f3-3303f839096e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:15.337165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afc546-8dd0-45e2-99f3-3303f839096e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:15.338617 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afc546-8dd0-45e2-99f3-3303f839096e service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:15.348314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 983/1995] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:41:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:41:15.762232 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a0f4d-0363-4977-ac10-cf052210c044 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:15.763649 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-376a0f4d-0363-4977-ac10-cf052210c044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:15.777951 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a0f4d-0363-4977-ac10-cf052210c044 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:15.782608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dcd3c-9b73-4103-bdd0-4248fdf693ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:15.783470 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dcd3c-9b73-4103-bdd0-4248fdf693ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:15.783753 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dcd3c-9b73-4103-bdd0-4248fdf693ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:15.784036 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dcd3c-9b73-4103-bdd0-4248fdf693ec admin admin] PATH_INFO: `/v3/projects/a2c69217a9c74a53a4287ad6342dee17` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:15.785234 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2dcd3c-9b73-4103-bdd0-4248fdf693ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2c69217a9c74a53a4287ad6342dee17)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:15.787816 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2dcd3c-9b73-4103-bdd0-4248fdf693ec admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:15.827390 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:15.838702 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6b2dcd3c-9b73-4103-bdd0-4248fdf693ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2c69217a9c74a53a4287ad6342dee17', 'request_id': 'req-6b2dcd3c-9b73-4103-bdd0-4248fdf693ec'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:15.845709 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6b2dcd3c-9b73-4103-bdd0-4248fdf693ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2c69217a9c74a53a4287ad6342dee17', 'request_id': 'req-6b2dcd3c-9b73-4103-bdd0-4248fdf693ec'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:15.852102 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6b2dcd3c-9b73-4103-bdd0-4248fdf693ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2c69217a9c74a53a4287ad6342dee17', 'request_id': 'req-6b2dcd3c-9b73-4103-bdd0-4248fdf693ec'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:15.863249 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6b2dcd3c-9b73-4103-bdd0-4248fdf693ec admin admin] The token cache is being invalidate because project a2c69217a9c74a53a4287ad6342dee17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:41:15.863535 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6b2dcd3c-9b73-4103-bdd0-4248fdf693ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:15.864168 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6b2dcd3c-9b73-4103-bdd0-4248fdf693ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:15.865736 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1013/1996] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:41:15 2022] DELETE /identity/v3/projects/a2c69217a9c74a53a4287ad6342dee17 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:41:15.870539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72822045-1e5d-4bde-ba0b-6edcb0f4a56f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:15.870856 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72822045-1e5d-4bde-ba0b-6edcb0f4a56f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:15.871160 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72822045-1e5d-4bde-ba0b-6edcb0f4a56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:15.889317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-72822045-1e5d-4bde-ba0b-6edcb0f4a56f None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:15.890519 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-72822045-1e5d-4bde-ba0b-6edcb0f4a56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:15.932561 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:15.949289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 984/1997] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:41:15.957364 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55cb6f-8451-4150-a978-7218daf740c3 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:15.957658 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55cb6f-8451-4150-a978-7218daf740c3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:15.957934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55cb6f-8451-4150-a978-7218daf740c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:15.976415 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-4e55cb6f-8451-4150-a978-7218daf740c3 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:15.977658 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4e55cb6f-8451-4150-a978-7218daf740c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:15.986489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1014/1998] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:15.990728 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72822045-1e5d-4bde-ba0b-6edcb0f4a56f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:16.000955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72822045-1e5d-4bde-ba0b-6edcb0f4a56f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:16.005530 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63721b-eba7-4e44-b0b5-0098701a09b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:16.006179 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63721b-eba7-4e44-b0b5-0098701a09b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:16.006575 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63721b-eba7-4e44-b0b5-0098701a09b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:16.006737 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63721b-eba7-4e44-b0b5-0098701a09b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:16.007460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63721b-eba7-4e44-b0b5-0098701a09b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:41:16.007770 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63721b-eba7-4e44-b0b5-0098701a09b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:16.009410 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63721b-eba7-4e44-b0b5-0098701a09b3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:16.021149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 985/1999] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:41:16.025386 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55cb6f-8451-4150-a978-7218daf740c3 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:16.034533 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55cb6f-8451-4150-a978-7218daf740c3 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:16.039230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a478e0a-74f4-4573-a67f-dabc6c75c24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:16.039813 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a478e0a-74f4-4573-a67f-dabc6c75c24e admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:16.040097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a478e0a-74f4-4573-a67f-dabc6c75c24e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:16.040378 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a478e0a-74f4-4573-a67f-dabc6c75c24e admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:16.041097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a478e0a-74f4-4573-a67f-dabc6c75c24e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:16.042997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a478e0a-74f4-4573-a67f-dabc6c75c24e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:16.070982 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1015/2000] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:41:16 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:41:16.075380 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63721b-eba7-4e44-b0b5-0098701a09b3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:16.087930 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63721b-eba7-4e44-b0b5-0098701a09b3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:16.153156 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39163793-7a3f-41d3-81b7-ad5bc5b60d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:16.153830 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39163793-7a3f-41d3-81b7-ad5bc5b60d8d admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:16.154116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39163793-7a3f-41d3-81b7-ad5bc5b60d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:16.154543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39163793-7a3f-41d3-81b7-ad5bc5b60d8d admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:16.155630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39163793-7a3f-41d3-81b7-ad5bc5b60d8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:16.157645 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39163793-7a3f-41d3-81b7-ad5bc5b60d8d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:16.177911 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 986/2001] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:41:16 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:41:16.181996 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a478e0a-74f4-4573-a67f-dabc6c75c24e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:16.193009 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a478e0a-74f4-4573-a67f-dabc6c75c24e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:16.197582 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e73ca6-e892-4dc5-aafe-9f182a4ade91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:16.198240 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e73ca6-e892-4dc5-aafe-9f182a4ade91 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:16.198517 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e73ca6-e892-4dc5-aafe-9f182a4ade91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:16.198788 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e73ca6-e892-4dc5-aafe-9f182a4ade91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:16.199501 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e73ca6-e892-4dc5-aafe-9f182a4ade91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:16.201309 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e73ca6-e892-4dc5-aafe-9f182a4ade91 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:16.214786 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1016/2002] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:41:16.216170 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39163793-7a3f-41d3-81b7-ad5bc5b60d8d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:16.226623 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39163793-7a3f-41d3-81b7-ad5bc5b60d8d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:16.231456 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d5cf1-7b34-4d21-8e3b-219161dfd702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:16.232113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d5cf1-7b34-4d21-8e3b-219161dfd702 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:16.232393 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d5cf1-7b34-4d21-8e3b-219161dfd702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:16.232711 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d5cf1-7b34-4d21-8e3b-219161dfd702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:16.234245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d5cf1-7b34-4d21-8e3b-219161dfd702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:16.235655 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d5cf1-7b34-4d21-8e3b-219161dfd702 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:16.245894 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 987/2003] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:41:16.249837 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e73ca6-e892-4dc5-aafe-9f182a4ade91 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:16.260033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e73ca6-e892-4dc5-aafe-9f182a4ade91 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:16.265520 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfd0f2-06d8-4452-88e4-f6ae754d487c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:16.266419 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfd0f2-06d8-4452-88e4-f6ae754d487c admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:16.266705 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfd0f2-06d8-4452-88e4-f6ae754d487c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:16.266984 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfd0f2-06d8-4452-88e4-f6ae754d487c admin admin] PATH_INFO: `/v3/projects/172f2d2b56044ab8b76a34590fa70d63/users/f6f620e0f3b74a82a8b4d4f6b6ad034e/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:16.282605 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfd0f2-06d8-4452-88e4-f6ae754d487c admin admin] RBAC: Authorizing `identity:create_grant(project_id=172f2d2b56044ab8b76a34590fa70d63, user_id=f6f620e0f3b74a82a8b4d4f6b6ad034e, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:16.285491 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfd0f2-06d8-4452-88e4-f6ae754d487c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:16.318826 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1017/2004] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:41:16 2022] PUT /identity/v3/projects/172f2d2b56044ab8b76a34590fa70d63/users/f6f620e0f3b74a82a8b4d4f6b6ad034e/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:16.330502 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5109cb-0c95-4010-98bc-912092e79690 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:16.330988 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5109cb-0c95-4010-98bc-912092e79690 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:16.331101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5109cb-0c95-4010-98bc-912092e79690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:16.360730 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9b5109cb-0c95-4010-98bc-912092e79690 None None] MFA Rules not processed for user `f6f620e0f3b74a82a8b4d4f6b6ad034e`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:16.362115 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9b5109cb-0c95-4010-98bc-912092e79690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:16.427045 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 988/2005] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:16.431068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfd0f2-06d8-4452-88e4-f6ae754d487c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:16.494444 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfd0f2-06d8-4452-88e4-f6ae754d487c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:16.499022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02668627-53a3-4f2b-9b2c-78458f9b0212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:16.499672 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02668627-53a3-4f2b-9b2c-78458f9b0212 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:16.499957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02668627-53a3-4f2b-9b2c-78458f9b0212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:16.500235 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02668627-53a3-4f2b-9b2c-78458f9b0212 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:16.500964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02668627-53a3-4f2b-9b2c-78458f9b0212 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:16.502874 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02668627-53a3-4f2b-9b2c-78458f9b0212 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:16.527570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1018/2006] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:41:16 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:41:16.532384 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5109cb-0c95-4010-98bc-912092e79690 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:16.543126 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5109cb-0c95-4010-98bc-912092e79690 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:16.584276 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:16.600310 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc4585-6544-4d8a-b71d-a018c1358f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:16.601010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc4585-6544-4d8a-b71d-a018c1358f1f admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:16.601299 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc4585-6544-4d8a-b71d-a018c1358f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:16.601603 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc4585-6544-4d8a-b71d-a018c1358f1f admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:16.602296 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc4585-6544-4d8a-b71d-a018c1358f1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:16.604246 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc4585-6544-4d8a-b71d-a018c1358f1f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:16.628045 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 989/2007] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:41:16 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:41:16.630496 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02668627-53a3-4f2b-9b2c-78458f9b0212 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:16.641496 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02668627-53a3-4f2b-9b2c-78458f9b0212 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:16.646038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c40c18-d9fc-4cd1-8816-a44aaca00d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:16.646686 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c40c18-d9fc-4cd1-8816-a44aaca00d9a admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:16.647006 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c40c18-d9fc-4cd1-8816-a44aaca00d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:16.647281 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c40c18-d9fc-4cd1-8816-a44aaca00d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:16.647990 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c40c18-d9fc-4cd1-8816-a44aaca00d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:16.649597 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c40c18-d9fc-4cd1-8816-a44aaca00d9a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:16.663704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1019/2008] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:41:16.665218 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc4585-6544-4d8a-b71d-a018c1358f1f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:16.675865 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc4585-6544-4d8a-b71d-a018c1358f1f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:16.680630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a49f4-f490-452e-b07b-f14010c969e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:16.681518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a49f4-f490-452e-b07b-f14010c969e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:16.681808 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a49f4-f490-452e-b07b-f14010c969e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:16.682091 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a49f4-f490-452e-b07b-f14010c969e6 admin admin] PATH_INFO: `/v3/projects/81117bb25db8484686b47b5ffbfc22dd/users/9de300446fd044d8a8f63263a4bc5054/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:16.699451 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a49f4-f490-452e-b07b-f14010c969e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81117bb25db8484686b47b5ffbfc22dd, user_id=9de300446fd044d8a8f63263a4bc5054, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:16.702193 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a49f4-f490-452e-b07b-f14010c969e6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:16.720752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 990/2009] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:41:16 2022] PUT /identity/v3/projects/81117bb25db8484686b47b5ffbfc22dd/users/9de300446fd044d8a8f63263a4bc5054/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:16.724375 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c40c18-d9fc-4cd1-8816-a44aaca00d9a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:16.734406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c40c18-d9fc-4cd1-8816-a44aaca00d9a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:16.765383 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:16.794844 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d33230-f97e-4290-9149-d2f6aec13088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:16.795472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d33230-f97e-4290-9149-d2f6aec13088 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:16.795751 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d33230-f97e-4290-9149-d2f6aec13088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:16.796024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d33230-f97e-4290-9149-d2f6aec13088 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:16.796766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d33230-f97e-4290-9149-d2f6aec13088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:16.798352 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d33230-f97e-4290-9149-d2f6aec13088 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:16.808807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1020/2010] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:41:16.813327 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a49f4-f490-452e-b07b-f14010c969e6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:16.824043 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a49f4-f490-452e-b07b-f14010c969e6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:16.829559 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adae67-500c-42df-a7a9-7c8113b98597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:16.830572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adae67-500c-42df-a7a9-7c8113b98597 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:16.830962 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adae67-500c-42df-a7a9-7c8113b98597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:16.831343 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adae67-500c-42df-a7a9-7c8113b98597 admin admin] PATH_INFO: `/v3/projects/81117bb25db8484686b47b5ffbfc22dd/users/9de300446fd044d8a8f63263a4bc5054/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:16.833588 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adae67-500c-42df-a7a9-7c8113b98597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81117bb25db8484686b47b5ffbfc22dd, user_id=9de300446fd044d8a8f63263a4bc5054, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:16.836532 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adae67-500c-42df-a7a9-7c8113b98597 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:16.847843 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 991/2011] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:41:16 2022] PUT /identity/v3/projects/81117bb25db8484686b47b5ffbfc22dd/users/9de300446fd044d8a8f63263a4bc5054/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:41:16.859217 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7b647-c2ea-4cf1-ba3c-ac5b8e3269e1 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:16.859581 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7b647-c2ea-4cf1-ba3c-ac5b8e3269e1 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:16.859929 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7b647-c2ea-4cf1-ba3c-ac5b8e3269e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:16.887283 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-99b7b647-c2ea-4cf1-ba3c-ac5b8e3269e1 None None] MFA Rules not processed for user `9de300446fd044d8a8f63263a4bc5054`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:16.888538 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-99b7b647-c2ea-4cf1-ba3c-ac5b8e3269e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:16.955248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1021/2012] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:16.965646 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adae67-500c-42df-a7a9-7c8113b98597 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:16.967421 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a3adae67-500c-42df-a7a9-7c8113b98597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:17.024852 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adae67-500c-42df-a7a9-7c8113b98597 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:17.028698 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a123c-887f-4cb1-8c86-76b20b77e694 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:17.029338 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a123c-887f-4cb1-8c86-76b20b77e694 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:17.029659 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a123c-887f-4cb1-8c86-76b20b77e694 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:17.029938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a123c-887f-4cb1-8c86-76b20b77e694 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:17.087204 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a123c-887f-4cb1-8c86-76b20b77e694 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:17.088894 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a123c-887f-4cb1-8c86-76b20b77e694 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:17.097746 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 992/2013] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:41:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:41:21.745113 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06f6d5-47c8-4b9e-b848-81f9094f25e2 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:21.746562 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06f6d5-47c8-4b9e-b848-81f9094f25e2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:21.746858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06f6d5-47c8-4b9e-b848-81f9094f25e2 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:21.749701 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1022/2014] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 30 10:41:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:41:21.757945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b648e-c8d0-4460-8d8b-d3db92bd90ec None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:21.758862 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b648e-c8d0-4460-8d8b-d3db92bd90ec None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:21.759352 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b648e-c8d0-4460-8d8b-d3db92bd90ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:21.780677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9f7b648e-c8d0-4460-8d8b-d3db92bd90ec None None] MFA Rules not processed for user `1bfd036d747241d9bc314b60bf8648b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:21.781921 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9f7b648e-c8d0-4460-8d8b-d3db92bd90ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:21.835150 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:21.864668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 993/2015] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 30 10:41:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:41:21.875576 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06f6d5-47c8-4b9e-b848-81f9094f25e2 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:21.877281 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4d06f6d5-47c8-4b9e-b848-81f9094f25e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:21.895412 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06f6d5-47c8-4b9e-b848-81f9094f25e2 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:21.900935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4820bc-fd84-42f9-abb2-bb752eda8de8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:21.901574 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4820bc-fd84-42f9-abb2-bb752eda8de8 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:21.901860 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4820bc-fd84-42f9-abb2-bb752eda8de8 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:21.902260 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4820bc-fd84-42f9-abb2-bb752eda8de8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:21.911809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4820bc-fd84-42f9-abb2-bb752eda8de8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:21.913473 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4820bc-fd84-42f9-abb2-bb752eda8de8 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:21.923898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1023/2016] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:41:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:41:25.934931 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b648e-c8d0-4460-8d8b-d3db92bd90ec None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:26.030921 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b648e-c8d0-4460-8d8b-d3db92bd90ec None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:26.037326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe7a5f-ba0a-43d8-973d-d5cee014cc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:26.038746 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe7a5f-ba0a-43d8-973d-d5cee014cc5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:26.039096 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe7a5f-ba0a-43d8-973d-d5cee014cc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:26.039484 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe7a5f-ba0a-43d8-973d-d5cee014cc5b admin admin] PATH_INFO: `/v3/users/f6f620e0f3b74a82a8b4d4f6b6ad034e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:26.041165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe7a5f-ba0a-43d8-973d-d5cee014cc5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6f620e0f3b74a82a8b4d4f6b6ad034e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:26.045908 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe7a5f-ba0a-43d8-973d-d5cee014cc5b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:26.127364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ddfe7a5f-ba0a-43d8-973d-d5cee014cc5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6f620e0f3b74a82a8b4d4f6b6ad034e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:26.129907 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ddfe7a5f-ba0a-43d8-973d-d5cee014cc5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6f620e0f3b74a82a8b4d4f6b6ad034e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:26.140029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ddfe7a5f-ba0a-43d8-973d-d5cee014cc5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6f620e0f3b74a82a8b4d4f6b6ad034e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:26.140845 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ddfe7a5f-ba0a-43d8-973d-d5cee014cc5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6f620e0f3b74a82a8b4d4f6b6ad034e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:26.150889 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ddfe7a5f-ba0a-43d8-973d-d5cee014cc5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6f620e0f3b74a82a8b4d4f6b6ad034e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:26.177543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 994/2017] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:41:25 2022] DELETE /identity/v3/users/f6f620e0f3b74a82a8b4d4f6b6ad034e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:26.182491 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c49cb6-d80c-44fb-b78d-8a6071e3f229 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:26.183038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c49cb6-d80c-44fb-b78d-8a6071e3f229 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:26.183131 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c49cb6-d80c-44fb-b78d-8a6071e3f229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:26.200985 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-54c49cb6-d80c-44fb-b78d-8a6071e3f229 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:26.202686 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-54c49cb6-d80c-44fb-b78d-8a6071e3f229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:26.273043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1024/2018] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:26.283659 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe7a5f-ba0a-43d8-973d-d5cee014cc5b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:26.285119 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ddfe7a5f-ba0a-43d8-973d-d5cee014cc5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:26.349199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe7a5f-ba0a-43d8-973d-d5cee014cc5b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:26.352987 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d7f8e-505a-4479-b1e8-354f43fb3398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:26.353739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d7f8e-505a-4479-b1e8-354f43fb3398 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:26.354099 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d7f8e-505a-4479-b1e8-354f43fb3398 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:26.354451 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d7f8e-505a-4479-b1e8-354f43fb3398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:26.367847 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d7f8e-505a-4479-b1e8-354f43fb3398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:26.369443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d7f8e-505a-4479-b1e8-354f43fb3398 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:26.382378 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 995/2019] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:41:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:41:26.676384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c49cb6-d80c-44fb-b78d-8a6071e3f229 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:26.678818 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-54c49cb6-d80c-44fb-b78d-8a6071e3f229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:26.696308 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c49cb6-d80c-44fb-b78d-8a6071e3f229 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:26.705201 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7797d-8c0d-44c7-bd59-4f1b3ed7bb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:26.706385 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7797d-8c0d-44c7-bd59-4f1b3ed7bb33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:26.707137 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7797d-8c0d-44c7-bd59-4f1b3ed7bb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:26.707419 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7797d-8c0d-44c7-bd59-4f1b3ed7bb33 admin admin] PATH_INFO: `/v3/projects/172f2d2b56044ab8b76a34590fa70d63` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:26.709792 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7797d-8c0d-44c7-bd59-4f1b3ed7bb33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=172f2d2b56044ab8b76a34590fa70d63)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:26.711492 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7797d-8c0d-44c7-bd59-4f1b3ed7bb33 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:26.761727 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:26.771521 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-aed7797d-8c0d-44c7-bd59-4f1b3ed7bb33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '172f2d2b56044ab8b76a34590fa70d63', 'request_id': 'req-aed7797d-8c0d-44c7-bd59-4f1b3ed7bb33'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:26.780456 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-aed7797d-8c0d-44c7-bd59-4f1b3ed7bb33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '172f2d2b56044ab8b76a34590fa70d63', 'request_id': 'req-aed7797d-8c0d-44c7-bd59-4f1b3ed7bb33'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:26.787283 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-aed7797d-8c0d-44c7-bd59-4f1b3ed7bb33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '172f2d2b56044ab8b76a34590fa70d63', 'request_id': 'req-aed7797d-8c0d-44c7-bd59-4f1b3ed7bb33'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:26.801240 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-aed7797d-8c0d-44c7-bd59-4f1b3ed7bb33 admin admin] The token cache is being invalidate because project 172f2d2b56044ab8b76a34590fa70d63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:41:26.801644 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-aed7797d-8c0d-44c7-bd59-4f1b3ed7bb33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:26.802201 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-aed7797d-8c0d-44c7-bd59-4f1b3ed7bb33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:26.803966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1025/2020] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:41:26 2022] DELETE /identity/v3/projects/172f2d2b56044ab8b76a34590fa70d63 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:26.807789 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d7f8e-505a-4479-b1e8-354f43fb3398 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:26.814873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:26.819915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d7f8e-505a-4479-b1e8-354f43fb3398 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:26.902354 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6553d9-7e59-49f7-a326-fe661fd23a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:26.903231 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6553d9-7e59-49f7-a326-fe661fd23a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:26.903529 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6553d9-7e59-49f7-a326-fe661fd23a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:26.903815 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6553d9-7e59-49f7-a326-fe661fd23a4b admin admin] PATH_INFO: `/v3/users/9de300446fd044d8a8f63263a4bc5054` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:26.905701 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6553d9-7e59-49f7-a326-fe661fd23a4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9de300446fd044d8a8f63263a4bc5054)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:26.907654 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6553d9-7e59-49f7-a326-fe661fd23a4b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:26.978556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2f6553d9-7e59-49f7-a326-fe661fd23a4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9de300446fd044d8a8f63263a4bc5054'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:26.979585 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2f6553d9-7e59-49f7-a326-fe661fd23a4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9de300446fd044d8a8f63263a4bc5054'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:26.989335 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2f6553d9-7e59-49f7-a326-fe661fd23a4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9de300446fd044d8a8f63263a4bc5054'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:26.990238 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2f6553d9-7e59-49f7-a326-fe661fd23a4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9de300446fd044d8a8f63263a4bc5054'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:27.001888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2f6553d9-7e59-49f7-a326-fe661fd23a4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9de300446fd044d8a8f63263a4bc5054'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:27.028862 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 996/2021] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:41:26 2022] DELETE /identity/v3/users/9de300446fd044d8a8f63263a4bc5054 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:27.437616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7797d-8c0d-44c7-bd59-4f1b3ed7bb33 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:27.439524 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-aed7797d-8c0d-44c7-bd59-4f1b3ed7bb33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:27.455182 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7797d-8c0d-44c7-bd59-4f1b3ed7bb33 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:27.515853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f56deb-08a9-4292-9c6f-e8c7fb695dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:27.516860 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f56deb-08a9-4292-9c6f-e8c7fb695dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:27.517201 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f56deb-08a9-4292-9c6f-e8c7fb695dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:27.517539 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f56deb-08a9-4292-9c6f-e8c7fb695dbd admin admin] PATH_INFO: `/v3/projects/81117bb25db8484686b47b5ffbfc22dd` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:27.518781 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f56deb-08a9-4292-9c6f-e8c7fb695dbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=81117bb25db8484686b47b5ffbfc22dd)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:27.520887 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f56deb-08a9-4292-9c6f-e8c7fb695dbd admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:27.566560 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b2f56deb-08a9-4292-9c6f-e8c7fb695dbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81117bb25db8484686b47b5ffbfc22dd', 'request_id': 'req-b2f56deb-08a9-4292-9c6f-e8c7fb695dbd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:27.575210 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b2f56deb-08a9-4292-9c6f-e8c7fb695dbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81117bb25db8484686b47b5ffbfc22dd', 'request_id': 'req-b2f56deb-08a9-4292-9c6f-e8c7fb695dbd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:27.582150 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b2f56deb-08a9-4292-9c6f-e8c7fb695dbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81117bb25db8484686b47b5ffbfc22dd', 'request_id': 'req-b2f56deb-08a9-4292-9c6f-e8c7fb695dbd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:27.592756 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b2f56deb-08a9-4292-9c6f-e8c7fb695dbd admin admin] The token cache is being invalidate because project 81117bb25db8484686b47b5ffbfc22dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:41:27.593053 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b2f56deb-08a9-4292-9c6f-e8c7fb695dbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:27.593723 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b2f56deb-08a9-4292-9c6f-e8c7fb695dbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:27.595308 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1026/2022] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:41:27 2022] DELETE /identity/v3/projects/81117bb25db8484686b47b5ffbfc22dd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:27.600263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd7098-d2cb-4172-8143-76f9e1e1379f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:27.600626 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd7098-d2cb-4172-8143-76f9e1e1379f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:27.600915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd7098-d2cb-4172-8143-76f9e1e1379f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:27.619422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-89fd7098-d2cb-4172-8143-76f9e1e1379f None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:27.620671 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-89fd7098-d2cb-4172-8143-76f9e1e1379f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:27.688247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 997/2023] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:41:27.696210 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3a03d-82de-4123-b959-5299bbff2e74 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:27.696556 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3a03d-82de-4123-b959-5299bbff2e74 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:27.696807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3a03d-82de-4123-b959-5299bbff2e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:27.719546 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c1e3a03d-82de-4123-b959-5299bbff2e74 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:27.721130 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c1e3a03d-82de-4123-b959-5299bbff2e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:27.733676 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1027/2024] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:27.738219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd7098-d2cb-4172-8143-76f9e1e1379f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:27.750752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd7098-d2cb-4172-8143-76f9e1e1379f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:27.756300 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a0ee3-ce9d-4fc0-88c3-fc66b36defa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:27.757070 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a0ee3-ce9d-4fc0-88c3-fc66b36defa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:27.757421 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a0ee3-ce9d-4fc0-88c3-fc66b36defa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:27.757789 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a0ee3-ce9d-4fc0-88c3-fc66b36defa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:27.758926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a0ee3-ce9d-4fc0-88c3-fc66b36defa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:41:27.758926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a0ee3-ce9d-4fc0-88c3-fc66b36defa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:27.761708 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a0ee3-ce9d-4fc0-88c3-fc66b36defa9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:27.773822 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 998/2025] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:41:27.777795 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3a03d-82de-4123-b959-5299bbff2e74 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:27.788959 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3a03d-82de-4123-b959-5299bbff2e74 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:27.794520 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f47bc-ec96-40bd-96a0-7eb1c073b2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:27.795772 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f47bc-ec96-40bd-96a0-7eb1c073b2f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:27.796237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f47bc-ec96-40bd-96a0-7eb1c073b2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:27.796719 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f47bc-ec96-40bd-96a0-7eb1c073b2f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:27.797479 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f47bc-ec96-40bd-96a0-7eb1c073b2f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:27.799452 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f47bc-ec96-40bd-96a0-7eb1c073b2f6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:27.833355 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1028/2026] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:41:27 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:41:27.834503 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a0ee3-ce9d-4fc0-88c3-fc66b36defa9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:27.844776 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a0ee3-ce9d-4fc0-88c3-fc66b36defa9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:27.852486 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:27.906145 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4998ea6-a49b-46d7-b899-8174cbc3c741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:27.906922 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4998ea6-a49b-46d7-b899-8174cbc3c741 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:27.907227 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4998ea6-a49b-46d7-b899-8174cbc3c741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:27.907637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4998ea6-a49b-46d7-b899-8174cbc3c741 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:27.908401 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4998ea6-a49b-46d7-b899-8174cbc3c741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:27.910496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4998ea6-a49b-46d7-b899-8174cbc3c741 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:27.934783 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 999/2027] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:41:27 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:41:27.939422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f47bc-ec96-40bd-96a0-7eb1c073b2f6 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:27.949841 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f47bc-ec96-40bd-96a0-7eb1c073b2f6 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:27.954414 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27beb2da-d4ce-4c9e-a62b-917881d20ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:27.955128 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27beb2da-d4ce-4c9e-a62b-917881d20ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:27.955415 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27beb2da-d4ce-4c9e-a62b-917881d20ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:27.955699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27beb2da-d4ce-4c9e-a62b-917881d20ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:27.956414 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27beb2da-d4ce-4c9e-a62b-917881d20ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:27.958203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27beb2da-d4ce-4c9e-a62b-917881d20ef2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:27.968738 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1029/2028] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:41:27.972450 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4998ea6-a49b-46d7-b899-8174cbc3c741 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:27.984408 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4998ea6-a49b-46d7-b899-8174cbc3c741 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:27.990104 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa1582-813e-4e6b-ad2f-da72c32de6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:27.990690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa1582-813e-4e6b-ad2f-da72c32de6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:27.990979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa1582-813e-4e6b-ad2f-da72c32de6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:27.991261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa1582-813e-4e6b-ad2f-da72c32de6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:27.991991 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa1582-813e-4e6b-ad2f-da72c32de6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:27.993652 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa1582-813e-4e6b-ad2f-da72c32de6f8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:28.005375 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1000/2029] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:41:28.009349 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27beb2da-d4ce-4c9e-a62b-917881d20ef2 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:28.019829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27beb2da-d4ce-4c9e-a62b-917881d20ef2 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:28.024460 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af2014-8fa3-43f1-8cd1-1c46fca303c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:28.025497 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af2014-8fa3-43f1-8cd1-1c46fca303c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:28.025786 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af2014-8fa3-43f1-8cd1-1c46fca303c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:28.026064 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af2014-8fa3-43f1-8cd1-1c46fca303c7 admin admin] PATH_INFO: `/v3/projects/bd7df7b583a4440ebcf76e5cce3dffc3/users/048f9b7d3ad84b439fedd0b80bc6c353/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:28.039007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:28.042318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af2014-8fa3-43f1-8cd1-1c46fca303c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd7df7b583a4440ebcf76e5cce3dffc3, user_id=048f9b7d3ad84b439fedd0b80bc6c353, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:28.046261 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af2014-8fa3-43f1-8cd1-1c46fca303c7 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:28.068851 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1030/2030] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:41:28 2022] PUT /identity/v3/projects/bd7df7b583a4440ebcf76e5cce3dffc3/users/048f9b7d3ad84b439fedd0b80bc6c353/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:41:28.074698 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5a199-44ee-42dc-97dc-c108d3163862 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:28.074698 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5a199-44ee-42dc-97dc-c108d3163862 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:28.074698 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5a199-44ee-42dc-97dc-c108d3163862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:28.096629 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b9f5a199-44ee-42dc-97dc-c108d3163862 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:28.097764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b9f5a199-44ee-42dc-97dc-c108d3163862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:28.165673 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1001/2031] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:28.171777 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af2014-8fa3-43f1-8cd1-1c46fca303c7 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:28.173660 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-90af2014-8fa3-43f1-8cd1-1c46fca303c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:28.240308 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af2014-8fa3-43f1-8cd1-1c46fca303c7 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:28.245133 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b282ed-7e01-4b94-a78b-13552b25a800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:28.245879 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b282ed-7e01-4b94-a78b-13552b25a800 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:28.246236 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b282ed-7e01-4b94-a78b-13552b25a800 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:28.246584 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b282ed-7e01-4b94-a78b-13552b25a800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:28.274834 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b282ed-7e01-4b94-a78b-13552b25a800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:28.274834 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b282ed-7e01-4b94-a78b-13552b25a800 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:28.310680 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1031/2032] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:41:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:41:29.136350 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090b54d-5dbf-4ddc-b2ec-da54fa2ffda9 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:29.136754 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090b54d-5dbf-4ddc-b2ec-da54fa2ffda9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:29.136959 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090b54d-5dbf-4ddc-b2ec-da54fa2ffda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:29.165137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0090b54d-5dbf-4ddc-b2ec-da54fa2ffda9 None None] MFA Rules not processed for user `048f9b7d3ad84b439fedd0b80bc6c353`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:29.166334 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0090b54d-5dbf-4ddc-b2ec-da54fa2ffda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:29.239202 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1002/2033] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:29.250566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b282ed-7e01-4b94-a78b-13552b25a800 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:29.252133 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b9b282ed-7e01-4b94-a78b-13552b25a800 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:29.310185 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b282ed-7e01-4b94-a78b-13552b25a800 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:29.314400 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b383223-955a-4945-b59a-cb4e14d2fbdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:29.315045 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b383223-955a-4945-b59a-cb4e14d2fbdd service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:29.315330 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b383223-955a-4945-b59a-cb4e14d2fbdd service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:29.315621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b383223-955a-4945-b59a-cb4e14d2fbdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:29.325053 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b383223-955a-4945-b59a-cb4e14d2fbdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:29.326554 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b383223-955a-4945-b59a-cb4e14d2fbdd service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:29.335346 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1032/2034] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:41:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:41:35.021101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb0fd9-dd2a-4a19-8fcd-7537b67551b9 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:35.022077 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb0fd9-dd2a-4a19-8fcd-7537b67551b9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:35.022460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb0fd9-dd2a-4a19-8fcd-7537b67551b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:35.041063 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-31cb0fd9-dd2a-4a19-8fcd-7537b67551b9 None None] MFA Rules not processed for user `048f9b7d3ad84b439fedd0b80bc6c353`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:35.042337 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-31cb0fd9-dd2a-4a19-8fcd-7537b67551b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:35.055207 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1003/2035] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:37.653315 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b383223-955a-4945-b59a-cb4e14d2fbdd service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:37.654732 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2b383223-955a-4945-b59a-cb4e14d2fbdd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:37.667932 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b383223-955a-4945-b59a-cb4e14d2fbdd service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:37.672814 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527a0bf-993a-4d6a-a1e2-e5acca05485d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:37.673659 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527a0bf-993a-4d6a-a1e2-e5acca05485d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:37.673936 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527a0bf-993a-4d6a-a1e2-e5acca05485d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:37.674205 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527a0bf-993a-4d6a-a1e2-e5acca05485d admin admin] PATH_INFO: `/v3/users/2f14d07549a44f06b25056254945ca52` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:37.675360 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527a0bf-993a-4d6a-a1e2-e5acca05485d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f14d07549a44f06b25056254945ca52)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:37.677282 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527a0bf-993a-4d6a-a1e2-e5acca05485d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:37.723816 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1527a0bf-993a-4d6a-a1e2-e5acca05485d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f14d07549a44f06b25056254945ca52'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:37.737092 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1527a0bf-993a-4d6a-a1e2-e5acca05485d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f14d07549a44f06b25056254945ca52'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:37.737784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1527a0bf-993a-4d6a-a1e2-e5acca05485d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f14d07549a44f06b25056254945ca52'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:37.745043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1527a0bf-993a-4d6a-a1e2-e5acca05485d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f14d07549a44f06b25056254945ca52'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:37.745717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1527a0bf-993a-4d6a-a1e2-e5acca05485d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f14d07549a44f06b25056254945ca52'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:37.759805 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1033/2036] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:41:37 2022] DELETE /identity/v3/users/2f14d07549a44f06b25056254945ca52 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:37.764375 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3d774-a4cd-424f-96c2-d97a2b64fc2c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:37.764889 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3d774-a4cd-424f-96c2-d97a2b64fc2c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:37.764982 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3d774-a4cd-424f-96c2-d97a2b64fc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:37.782956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0fb3d774-a4cd-424f-96c2-d97a2b64fc2c None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:37.784144 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0fb3d774-a4cd-424f-96c2-d97a2b64fc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:37.792613 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:37.850868 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1004/2037] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:37.861164 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527a0bf-993a-4d6a-a1e2-e5acca05485d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:37.862583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1527a0bf-993a-4d6a-a1e2-e5acca05485d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:37.873733 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:37.921128 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527a0bf-993a-4d6a-a1e2-e5acca05485d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:37.924791 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921b334-1d88-4bf8-961c-df1206aa11c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:37.925431 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921b334-1d88-4bf8-961c-df1206aa11c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:37.925715 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921b334-1d88-4bf8-961c-df1206aa11c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:37.925992 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921b334-1d88-4bf8-961c-df1206aa11c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:37.934959 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921b334-1d88-4bf8-961c-df1206aa11c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:37.936433 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921b334-1d88-4bf8-961c-df1206aa11c4 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:37.945973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1034/2038] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:41:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:41:38.225065 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3d774-a4cd-424f-96c2-d97a2b64fc2c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:38.226514 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0fb3d774-a4cd-424f-96c2-d97a2b64fc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:38.239140 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3d774-a4cd-424f-96c2-d97a2b64fc2c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:38.243853 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2de53-c08a-4cf0-85ed-0f289662f26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:38.244819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2de53-c08a-4cf0-85ed-0f289662f26b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:38.245513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2de53-c08a-4cf0-85ed-0f289662f26b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:38.245513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2de53-c08a-4cf0-85ed-0f289662f26b admin admin] PATH_INFO: `/v3/projects/31f00c3f5e574b949cd18ac2090adf0d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:38.246809 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2de53-c08a-4cf0-85ed-0f289662f26b admin admin] RBAC: Authorizing `identity:delete_project(project_id=31f00c3f5e574b949cd18ac2090adf0d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:38.248801 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2de53-c08a-4cf0-85ed-0f289662f26b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:38.301905 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-45f2de53-c08a-4cf0-85ed-0f289662f26b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31f00c3f5e574b949cd18ac2090adf0d', 'request_id': 'req-45f2de53-c08a-4cf0-85ed-0f289662f26b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:38.308523 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-45f2de53-c08a-4cf0-85ed-0f289662f26b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31f00c3f5e574b949cd18ac2090adf0d', 'request_id': 'req-45f2de53-c08a-4cf0-85ed-0f289662f26b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:38.314116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-45f2de53-c08a-4cf0-85ed-0f289662f26b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31f00c3f5e574b949cd18ac2090adf0d', 'request_id': 'req-45f2de53-c08a-4cf0-85ed-0f289662f26b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:38.325131 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-45f2de53-c08a-4cf0-85ed-0f289662f26b admin admin] The token cache is being invalidate because project 31f00c3f5e574b949cd18ac2090adf0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:41:38.325422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-45f2de53-c08a-4cf0-85ed-0f289662f26b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:38.326586 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-45f2de53-c08a-4cf0-85ed-0f289662f26b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:38.328245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1005/2039] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:41:38 2022] DELETE /identity/v3/projects/31f00c3f5e574b949cd18ac2090adf0d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:38.333301 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91622b60-4d04-40d8-a8c6-a2c12837b0e4 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:38.333700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91622b60-4d04-40d8-a8c6-a2c12837b0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:38.334543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91622b60-4d04-40d8-a8c6-a2c12837b0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:38.353873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-91622b60-4d04-40d8-a8c6-a2c12837b0e4 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:38.355467 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-91622b60-4d04-40d8-a8c6-a2c12837b0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:38.448544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1035/2040] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:38.450611 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86f5f0-1744-4294-84fe-7d91c9fa5a24 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:38.450929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86f5f0-1744-4294-84fe-7d91c9fa5a24 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:38.451748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86f5f0-1744-4294-84fe-7d91c9fa5a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:38.471295 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-dc86f5f0-1744-4294-84fe-7d91c9fa5a24 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:38.472486 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dc86f5f0-1744-4294-84fe-7d91c9fa5a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:38.481155 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1006/2041] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:38.485228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91622b60-4d04-40d8-a8c6-a2c12837b0e4 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:38.495425 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91622b60-4d04-40d8-a8c6-a2c12837b0e4 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:38.500955 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641408ff-e28e-42a6-8ecf-968f3cd1953f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:38.501876 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641408ff-e28e-42a6-8ecf-968f3cd1953f admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:38.502266 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641408ff-e28e-42a6-8ecf-968f3cd1953f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:38.502553 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641408ff-e28e-42a6-8ecf-968f3cd1953f admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:38.503882 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641408ff-e28e-42a6-8ecf-968f3cd1953f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:41:38.504203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641408ff-e28e-42a6-8ecf-968f3cd1953f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:38.506483 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641408ff-e28e-42a6-8ecf-968f3cd1953f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:38.519690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1036/2042] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:41:38.524491 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86f5f0-1744-4294-84fe-7d91c9fa5a24 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:38.534426 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86f5f0-1744-4294-84fe-7d91c9fa5a24 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:38.539086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf08974-de9c-46bc-a618-7c5e7239eff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:38.539736 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf08974-de9c-46bc-a618-7c5e7239eff8 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:38.540023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf08974-de9c-46bc-a618-7c5e7239eff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:38.540301 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf08974-de9c-46bc-a618-7c5e7239eff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:38.541029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf08974-de9c-46bc-a618-7c5e7239eff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:38.542956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf08974-de9c-46bc-a618-7c5e7239eff8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:38.573428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1007/2043] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:41:38 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:41:38.581953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641408ff-e28e-42a6-8ecf-968f3cd1953f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:38.597453 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641408ff-e28e-42a6-8ecf-968f3cd1953f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:38.692201 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7f120-0303-42b7-9072-df5c6a9d6dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:38.693034 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7f120-0303-42b7-9072-df5c6a9d6dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:38.693326 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7f120-0303-42b7-9072-df5c6a9d6dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:38.693739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7f120-0303-42b7-9072-df5c6a9d6dd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:38.694499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7f120-0303-42b7-9072-df5c6a9d6dd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:38.696426 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7f120-0303-42b7-9072-df5c6a9d6dd5 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:38.738594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1037/2044] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:41:38 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:41:38.739853 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf08974-de9c-46bc-a618-7c5e7239eff8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:38.752865 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf08974-de9c-46bc-a618-7c5e7239eff8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:38.758306 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4b356-b841-49c6-8f2e-8e129de85687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:38.759163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4b356-b841-49c6-8f2e-8e129de85687 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:38.759414 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4b356-b841-49c6-8f2e-8e129de85687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:38.759819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4b356-b841-49c6-8f2e-8e129de85687 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:38.760791 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4b356-b841-49c6-8f2e-8e129de85687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:38.762396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4b356-b841-49c6-8f2e-8e129de85687 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:38.775306 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1008/2045] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:41:38.779206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7f120-0303-42b7-9072-df5c6a9d6dd5 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:38.790099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7f120-0303-42b7-9072-df5c6a9d6dd5 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:38.794826 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68716cc-4661-43aa-8fee-153d84f8d563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:38.795547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68716cc-4661-43aa-8fee-153d84f8d563 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:38.795899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68716cc-4661-43aa-8fee-153d84f8d563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:38.796248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68716cc-4661-43aa-8fee-153d84f8d563 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:38.797088 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68716cc-4661-43aa-8fee-153d84f8d563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:38.798745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68716cc-4661-43aa-8fee-153d84f8d563 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:38.811358 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1038/2046] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:41:38.815350 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4b356-b841-49c6-8f2e-8e129de85687 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:38.825571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4b356-b841-49c6-8f2e-8e129de85687 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:38.831108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacf013-ba4a-49f8-a90c-aca7bf60be6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:38.832066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacf013-ba4a-49f8-a90c-aca7bf60be6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:38.832358 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacf013-ba4a-49f8-a90c-aca7bf60be6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:38.832671 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacf013-ba4a-49f8-a90c-aca7bf60be6e admin admin] PATH_INFO: `/v3/projects/eaa65f4ae69e4f8fa5ae5d125b2861ea/users/7904fd469a51437cb39051848214d82e/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:38.847954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeacf013-ba4a-49f8-a90c-aca7bf60be6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaa65f4ae69e4f8fa5ae5d125b2861ea, user_id=7904fd469a51437cb39051848214d82e, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:38.850852 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeacf013-ba4a-49f8-a90c-aca7bf60be6e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:38.864221 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1009/2047] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:41:38 2022] PUT /identity/v3/projects/eaa65f4ae69e4f8fa5ae5d125b2861ea/users/7904fd469a51437cb39051848214d82e/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:38.875269 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67cd7e-ca18-4c09-9122-94aa3ffa7713 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:38.875591 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67cd7e-ca18-4c09-9122-94aa3ffa7713 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:38.875968 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67cd7e-ca18-4c09-9122-94aa3ffa7713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:38.905090 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ed67cd7e-ca18-4c09-9122-94aa3ffa7713 None None] MFA Rules not processed for user `7904fd469a51437cb39051848214d82e`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:38.906360 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ed67cd7e-ca18-4c09-9122-94aa3ffa7713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:38.911394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:38.978790 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1039/2048] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:38.990254 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacf013-ba4a-49f8-a90c-aca7bf60be6e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:38.992029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-aeacf013-ba4a-49f8-a90c-aca7bf60be6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:39.030374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:39.059385 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacf013-ba4a-49f8-a90c-aca7bf60be6e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:39.064426 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a716cd6-5b81-4e7c-ae9d-e122e800612c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:39.065180 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a716cd6-5b81-4e7c-ae9d-e122e800612c service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:39.065561 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a716cd6-5b81-4e7c-ae9d-e122e800612c service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:39.066215 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a716cd6-5b81-4e7c-ae9d-e122e800612c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:39.076189 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a716cd6-5b81-4e7c-ae9d-e122e800612c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:39.078124 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a716cd6-5b81-4e7c-ae9d-e122e800612c service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:39.094332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1010/2049] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:41:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:41:43.235154 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67cd7e-ca18-4c09-9122-94aa3ffa7713 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:43.298036 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67cd7e-ca18-4c09-9122-94aa3ffa7713 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:43.302591 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e43d8e-7800-4bac-8559-7d6407f6705c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:43.303454 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e43d8e-7800-4bac-8559-7d6407f6705c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:43.303734 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e43d8e-7800-4bac-8559-7d6407f6705c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:43.304007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e43d8e-7800-4bac-8559-7d6407f6705c admin admin] PATH_INFO: `/v3/users/7904fd469a51437cb39051848214d82e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:43.305207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e43d8e-7800-4bac-8559-7d6407f6705c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7904fd469a51437cb39051848214d82e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:43.307128 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e43d8e-7800-4bac-8559-7d6407f6705c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:43.356564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-85e43d8e-7800-4bac-8559-7d6407f6705c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7904fd469a51437cb39051848214d82e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:43.369124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-85e43d8e-7800-4bac-8559-7d6407f6705c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7904fd469a51437cb39051848214d82e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:43.369877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-85e43d8e-7800-4bac-8559-7d6407f6705c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7904fd469a51437cb39051848214d82e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:43.377752 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-85e43d8e-7800-4bac-8559-7d6407f6705c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7904fd469a51437cb39051848214d82e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:43.378519 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-85e43d8e-7800-4bac-8559-7d6407f6705c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7904fd469a51437cb39051848214d82e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:43.393645 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1040/2050] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:41:43 2022] DELETE /identity/v3/users/7904fd469a51437cb39051848214d82e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:43.398231 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fc7b8-1562-481d-85f2-202024678870 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:43.398793 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fc7b8-1562-481d-85f2-202024678870 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:43.398793 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fc7b8-1562-481d-85f2-202024678870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:43.416215 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-520fc7b8-1562-481d-85f2-202024678870 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:43.417457 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-520fc7b8-1562-481d-85f2-202024678870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:43.475944 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1011/2051] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:43.486167 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e43d8e-7800-4bac-8559-7d6407f6705c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:43.487552 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-85e43d8e-7800-4bac-8559-7d6407f6705c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:43.519060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:43.547297 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e43d8e-7800-4bac-8559-7d6407f6705c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:43.550895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c227583-4d01-4e91-b0ff-43be4e16a2e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:43.551563 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c227583-4d01-4e91-b0ff-43be4e16a2e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:43.551842 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c227583-4d01-4e91-b0ff-43be4e16a2e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:43.552116 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c227583-4d01-4e91-b0ff-43be4e16a2e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:43.561330 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c227583-4d01-4e91-b0ff-43be4e16a2e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:43.563705 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c227583-4d01-4e91-b0ff-43be4e16a2e1 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:43.573898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1041/2052] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:41:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:41:43.989431 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fc7b8-1562-481d-85f2-202024678870 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:44.001517 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-520fc7b8-1562-481d-85f2-202024678870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:44.015154 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fc7b8-1562-481d-85f2-202024678870 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:44.020196 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6b899-349b-4ea1-b715-1d04ce18477d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:44.021133 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6b899-349b-4ea1-b715-1d04ce18477d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:44.021426 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6b899-349b-4ea1-b715-1d04ce18477d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:44.021702 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6b899-349b-4ea1-b715-1d04ce18477d admin admin] PATH_INFO: `/v3/projects/eaa65f4ae69e4f8fa5ae5d125b2861ea` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:44.023065 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e6b899-349b-4ea1-b715-1d04ce18477d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaa65f4ae69e4f8fa5ae5d125b2861ea)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:44.025050 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e6b899-349b-4ea1-b715-1d04ce18477d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:44.077161 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-42e6b899-349b-4ea1-b715-1d04ce18477d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaa65f4ae69e4f8fa5ae5d125b2861ea', 'request_id': 'req-42e6b899-349b-4ea1-b715-1d04ce18477d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:44.084802 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-42e6b899-349b-4ea1-b715-1d04ce18477d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaa65f4ae69e4f8fa5ae5d125b2861ea', 'request_id': 'req-42e6b899-349b-4ea1-b715-1d04ce18477d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:44.093051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-42e6b899-349b-4ea1-b715-1d04ce18477d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaa65f4ae69e4f8fa5ae5d125b2861ea', 'request_id': 'req-42e6b899-349b-4ea1-b715-1d04ce18477d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:44.106854 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-42e6b899-349b-4ea1-b715-1d04ce18477d admin admin] The token cache is being invalidate because project eaa65f4ae69e4f8fa5ae5d125b2861ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:41:44.107131 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-42e6b899-349b-4ea1-b715-1d04ce18477d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:44.107820 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-42e6b899-349b-4ea1-b715-1d04ce18477d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:41:44.110015 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1012/2053] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:41:43 2022] DELETE /identity/v3/projects/eaa65f4ae69e4f8fa5ae5d125b2861ea => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:41:44.114872 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025f18a-1b08-4374-8f4e-3dee755a8d72 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:44.115232 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025f18a-1b08-4374-8f4e-3dee755a8d72 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:44.115588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025f18a-1b08-4374-8f4e-3dee755a8d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:44.137205 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f025f18a-1b08-4374-8f4e-3dee755a8d72 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:44.138410 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f025f18a-1b08-4374-8f4e-3dee755a8d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:44.197330 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1042/2054] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:44.206483 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f62ad8-3510-47b0-9d9a-eb94e6a4d1be None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:44.206773 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f62ad8-3510-47b0-9d9a-eb94e6a4d1be None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:44.207049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f62ad8-3510-47b0-9d9a-eb94e6a4d1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:44.225667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-86f62ad8-3510-47b0-9d9a-eb94e6a4d1be None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:44.226859 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-86f62ad8-3510-47b0-9d9a-eb94e6a4d1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:44.236369 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1013/2055] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:41:44.241136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025f18a-1b08-4374-8f4e-3dee755a8d72 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:44.251435 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025f18a-1b08-4374-8f4e-3dee755a8d72 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:44.257546 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13abf9b1-5e16-4910-81bf-d4ba3a2b1537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:44.258224 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abf9b1-5e16-4910-81bf-d4ba3a2b1537 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:44.258880 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abf9b1-5e16-4910-81bf-d4ba3a2b1537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:44.258880 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abf9b1-5e16-4910-81bf-d4ba3a2b1537 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:44.259505 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13abf9b1-5e16-4910-81bf-d4ba3a2b1537 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:41:44.259821 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13abf9b1-5e16-4910-81bf-d4ba3a2b1537 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:44.261491 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13abf9b1-5e16-4910-81bf-d4ba3a2b1537 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:44.274970 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1043/2056] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:41:44.279593 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f62ad8-3510-47b0-9d9a-eb94e6a4d1be None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:44.289322 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f62ad8-3510-47b0-9d9a-eb94e6a4d1be None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:44.293988 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef472c4-2810-4cb0-96cd-8e586cdeec4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:44.294699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef472c4-2810-4cb0-96cd-8e586cdeec4c admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:44.294982 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef472c4-2810-4cb0-96cd-8e586cdeec4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:44.295260 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef472c4-2810-4cb0-96cd-8e586cdeec4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:44.295937 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef472c4-2810-4cb0-96cd-8e586cdeec4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:44.297900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef472c4-2810-4cb0-96cd-8e586cdeec4c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:44.322374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1014/2057] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:41:44 2022] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:41:44.326358 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13abf9b1-5e16-4910-81bf-d4ba3a2b1537 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:44.336872 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13abf9b1-5e16-4910-81bf-d4ba3a2b1537 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:44.393220 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685fe41-b048-4148-bb74-a3555e5973c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:44.393883 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685fe41-b048-4148-bb74-a3555e5973c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:44.394170 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685fe41-b048-4148-bb74-a3555e5973c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:44.394448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685fe41-b048-4148-bb74-a3555e5973c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:44.395139 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685fe41-b048-4148-bb74-a3555e5973c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:44.397094 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685fe41-b048-4148-bb74-a3555e5973c2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:44.419276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1044/2058] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:41:44 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:41:44.420701 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef472c4-2810-4cb0-96cd-8e586cdeec4c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:44.430749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef472c4-2810-4cb0-96cd-8e586cdeec4c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:44.435319 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922550cd-7c4d-44c9-b5b6-6634d8b0f9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:44.435962 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922550cd-7c4d-44c9-b5b6-6634d8b0f9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:44.436242 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922550cd-7c4d-44c9-b5b6-6634d8b0f9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:44.436537 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922550cd-7c4d-44c9-b5b6-6634d8b0f9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:44.437251 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922550cd-7c4d-44c9-b5b6-6634d8b0f9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:44.438849 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922550cd-7c4d-44c9-b5b6-6634d8b0f9e9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:44.452445 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1015/2059] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:41:44.452802 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685fe41-b048-4148-bb74-a3555e5973c2 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:44.463532 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685fe41-b048-4148-bb74-a3555e5973c2 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:44.469849 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9283a54-6c1f-4581-bb9f-428f067718cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:44.470520 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9283a54-6c1f-4581-bb9f-428f067718cd admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:44.470847 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9283a54-6c1f-4581-bb9f-428f067718cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:44.471179 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9283a54-6c1f-4581-bb9f-428f067718cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:44.472030 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9283a54-6c1f-4581-bb9f-428f067718cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:44.474230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9283a54-6c1f-4581-bb9f-428f067718cd admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:44.487905 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1045/2060] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:41:44.492810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922550cd-7c4d-44c9-b5b6-6634d8b0f9e9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:44.503785 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922550cd-7c4d-44c9-b5b6-6634d8b0f9e9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:44.508412 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d697d-54fd-4e25-8441-62d480a21cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:44.509309 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d697d-54fd-4e25-8441-62d480a21cae admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:44.509592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d697d-54fd-4e25-8441-62d480a21cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:44.509866 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d697d-54fd-4e25-8441-62d480a21cae admin admin] PATH_INFO: `/v3/projects/66ee626eceec40e5b38901629c0de5e1/users/2b2609031db4421bb6311065138b25b3/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:44.526847 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d697d-54fd-4e25-8441-62d480a21cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ee626eceec40e5b38901629c0de5e1, user_id=2b2609031db4421bb6311065138b25b3, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:44.529681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d697d-54fd-4e25-8441-62d480a21cae admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:44.532949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:44.545382 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1016/2061] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:41:44 2022] PUT /identity/v3/projects/66ee626eceec40e5b38901629c0de5e1/users/2b2609031db4421bb6311065138b25b3/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:41:44.555497 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62c916-6aba-43b0-a25d-9e22cd502c70 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:44.555788 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62c916-6aba-43b0-a25d-9e22cd502c70 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:44.556320 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62c916-6aba-43b0-a25d-9e22cd502c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:44.583880 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-3f62c916-6aba-43b0-a25d-9e22cd502c70 None None] MFA Rules not processed for user `2b2609031db4421bb6311065138b25b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:44.585115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3f62c916-6aba-43b0-a25d-9e22cd502c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:44.609450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:44.654487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1046/2062] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:41:44.666214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d697d-54fd-4e25-8441-62d480a21cae admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:41:44.667890 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-725d697d-54fd-4e25-8441-62d480a21cae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:44.723052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d697d-54fd-4e25-8441-62d480a21cae admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:41:44.726569 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a962bae-8a9a-40a4-be94-f58f79e5b731 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2522b8560d224aa1a973207a79ce6a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:41:44.727192 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a962bae-8a9a-40a4-be94-f58f79e5b731 service glance] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:44.727473 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a962bae-8a9a-40a4-be94-f58f79e5b731 service glance] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:44.727776 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a962bae-8a9a-40a4-be94-f58f79e5b731 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:44.736748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a962bae-8a9a-40a4-be94-f58f79e5b731 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:41:44.738169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a962bae-8a9a-40a4-be94-f58f79e5b731 service glance] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:41:44.746808 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1017/2063] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:41:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:41:54.651512 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=16 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:54.743017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=28 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:41:57.393003 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ced3c-0b6f-49a1-a4a8-e6bd617b1f04 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:41:57.393566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ced3c-0b6f-49a1-a4a8-e6bd617b1f04 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:41:57.393566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ced3c-0b6f-49a1-a4a8-e6bd617b1f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:41:57.412883 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b48ced3c-0b6f-49a1-a4a8-e6bd617b1f04 None None] MFA Rules not processed for user `f5c0ccbf16fe4a399945aa5ad34754b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:41:57.414393 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b48ced3c-0b6f-49a1-a4a8-e6bd617b1f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:41:57.480544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1047/2064] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:41:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:42:03.510616 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59343ab8-127e-430d-8a76-aab67327cd74 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:03.511184 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59343ab8-127e-430d-8a76-aab67327cd74 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:03.511279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59343ab8-127e-430d-8a76-aab67327cd74 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:03.512695 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1018/2065] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 30 10:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:42:03.519696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab5919-dd82-49b5-b003-a091dcb8c75a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:03.520162 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab5919-dd82-49b5-b003-a091dcb8c75a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:03.520245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab5919-dd82-49b5-b003-a091dcb8c75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:03.538343 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e8ab5919-dd82-49b5-b003-a091dcb8c75a None None] MFA Rules not processed for user `48709a771ab64ed38018873313f37c84`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:03.539654 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e8ab5919-dd82-49b5-b003-a091dcb8c75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:03.587051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59343ab8-127e-430d-8a76-aab67327cd74 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:03.588953 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-59343ab8-127e-430d-8a76-aab67327cd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:03.609614 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1048/2066] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 30 10:42:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:42:03.621971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab5919-dd82-49b5-b003-a091dcb8c75a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:03.623362 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e8ab5919-dd82-49b5-b003-a091dcb8c75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:03.636856 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab5919-dd82-49b5-b003-a091dcb8c75a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:03.642235 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc4d4c-4da6-473f-90ee-4a990d708bf5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48709a771ab64ed38018873313f37c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:03.642878 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc4d4c-4da6-473f-90ee-4a990d708bf5 service placement] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:03.643190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc4d4c-4da6-473f-90ee-4a990d708bf5 service placement] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:03.643469 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc4d4c-4da6-473f-90ee-4a990d708bf5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:03.652097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc4d4c-4da6-473f-90ee-4a990d708bf5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:03.653766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc4d4c-4da6-473f-90ee-4a990d708bf5 service placement] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:03.661149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59343ab8-127e-430d-8a76-aab67327cd74 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:03.664668 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1049/2067] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:42:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:42:03.667446 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc856dc-57e5-495c-8746-046bcbd6cfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:03.668329 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc856dc-57e5-495c-8746-046bcbd6cfa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:03.668650 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc856dc-57e5-495c-8746-046bcbd6cfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:03.668932 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc856dc-57e5-495c-8746-046bcbd6cfa3 admin admin] PATH_INFO: `/v3/users/9ad75a8b887a4a40accb49603f03c8ee` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:03.670241 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc856dc-57e5-495c-8746-046bcbd6cfa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ad75a8b887a4a40accb49603f03c8ee)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:03.672190 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc856dc-57e5-495c-8746-046bcbd6cfa3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:03.722801 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dcc856dc-57e5-495c-8746-046bcbd6cfa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ad75a8b887a4a40accb49603f03c8ee'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:03.723544 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dcc856dc-57e5-495c-8746-046bcbd6cfa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ad75a8b887a4a40accb49603f03c8ee'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:03.730932 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dcc856dc-57e5-495c-8746-046bcbd6cfa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ad75a8b887a4a40accb49603f03c8ee'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:03.731578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dcc856dc-57e5-495c-8746-046bcbd6cfa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ad75a8b887a4a40accb49603f03c8ee'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:03.740369 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dcc856dc-57e5-495c-8746-046bcbd6cfa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ad75a8b887a4a40accb49603f03c8ee'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:03.758538 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1019/2068] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:42:03 2022] DELETE /identity/v3/users/9ad75a8b887a4a40accb49603f03c8ee => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:42:03.934776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc4d4c-4da6-473f-90ee-4a990d708bf5 service placement] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:03.945378 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc4d4c-4da6-473f-90ee-4a990d708bf5 service placement] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:04.003383 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1775f3-4a88-44e1-a2ef-78328921b8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:04.004231 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1775f3-4a88-44e1-a2ef-78328921b8a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:04.004526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1775f3-4a88-44e1-a2ef-78328921b8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:04.004809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1775f3-4a88-44e1-a2ef-78328921b8a2 admin admin] PATH_INFO: `/v3/projects/ff16d27fbbe7475782fe2202e34aec7f` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:04.005977 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1775f3-4a88-44e1-a2ef-78328921b8a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff16d27fbbe7475782fe2202e34aec7f)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:04.007870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1775f3-4a88-44e1-a2ef-78328921b8a2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:04.045231 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:04.060088 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0c1775f3-4a88-44e1-a2ef-78328921b8a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff16d27fbbe7475782fe2202e34aec7f', 'request_id': 'req-0c1775f3-4a88-44e1-a2ef-78328921b8a2'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:04.067157 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0c1775f3-4a88-44e1-a2ef-78328921b8a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff16d27fbbe7475782fe2202e34aec7f', 'request_id': 'req-0c1775f3-4a88-44e1-a2ef-78328921b8a2'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:04.078200 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0c1775f3-4a88-44e1-a2ef-78328921b8a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff16d27fbbe7475782fe2202e34aec7f', 'request_id': 'req-0c1775f3-4a88-44e1-a2ef-78328921b8a2'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:04.089102 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0c1775f3-4a88-44e1-a2ef-78328921b8a2 admin admin] The token cache is being invalidate because project ff16d27fbbe7475782fe2202e34aec7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:42:04.089415 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0c1775f3-4a88-44e1-a2ef-78328921b8a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:04.090118 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0c1775f3-4a88-44e1-a2ef-78328921b8a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:04.091645 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1050/2069] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:42:03 2022] DELETE /identity/v3/projects/ff16d27fbbe7475782fe2202e34aec7f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:42:04.096771 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd13aea-2e3a-476a-b11b-47a29dff8b7a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:04.097727 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd13aea-2e3a-476a-b11b-47a29dff8b7a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:04.098128 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd13aea-2e3a-476a-b11b-47a29dff8b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:04.117712 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7cd13aea-2e3a-476a-b11b-47a29dff8b7a None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:04.121901 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7cd13aea-2e3a-476a-b11b-47a29dff8b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:04.192671 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1020/2070] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:42:04.194759 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab437195-f840-46c1-9771-085a72ed2f27 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:04.195158 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab437195-f840-46c1-9771-085a72ed2f27 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:04.195564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab437195-f840-46c1-9771-085a72ed2f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:04.215234 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ab437195-f840-46c1-9771-085a72ed2f27 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:04.217275 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ab437195-f840-46c1-9771-085a72ed2f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:04.226323 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1051/2071] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:42:04.230711 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd13aea-2e3a-476a-b11b-47a29dff8b7a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:04.241007 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd13aea-2e3a-476a-b11b-47a29dff8b7a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:04.245599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38059c9c-b282-44dc-8466-9850222a90ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:04.246718 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38059c9c-b282-44dc-8466-9850222a90ef admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:04.247027 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38059c9c-b282-44dc-8466-9850222a90ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:04.247304 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38059c9c-b282-44dc-8466-9850222a90ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:04.248022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38059c9c-b282-44dc-8466-9850222a90ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:42:04.248329 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38059c9c-b282-44dc-8466-9850222a90ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:04.250043 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38059c9c-b282-44dc-8466-9850222a90ef admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:04.262278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1021/2072] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:42:04.266561 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab437195-f840-46c1-9771-085a72ed2f27 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:04.276126 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab437195-f840-46c1-9771-085a72ed2f27 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:04.280781 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc37eab-2d3b-436e-bc90-d84b43ecf630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:04.281429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc37eab-2d3b-436e-bc90-d84b43ecf630 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:04.281712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc37eab-2d3b-436e-bc90-d84b43ecf630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:04.282017 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc37eab-2d3b-436e-bc90-d84b43ecf630 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:04.282710 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc37eab-2d3b-436e-bc90-d84b43ecf630 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:04.285196 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc37eab-2d3b-436e-bc90-d84b43ecf630 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:04.310104 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1052/2073] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:42:04 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:42:04.314214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38059c9c-b282-44dc-8466-9850222a90ef admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:04.324364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38059c9c-b282-44dc-8466-9850222a90ef admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:04.328235 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:04.384062 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea123d1-02a5-49bc-8a78-515829e1188f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:04.384762 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea123d1-02a5-49bc-8a78-515829e1188f admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:04.385050 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea123d1-02a5-49bc-8a78-515829e1188f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:04.385328 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea123d1-02a5-49bc-8a78-515829e1188f admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:04.386024 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea123d1-02a5-49bc-8a78-515829e1188f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:04.387985 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea123d1-02a5-49bc-8a78-515829e1188f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:04.410725 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1022/2074] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:42:04 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:42:04.414730 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc37eab-2d3b-436e-bc90-d84b43ecf630 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:04.425127 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc37eab-2d3b-436e-bc90-d84b43ecf630 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:04.430723 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc5ed1-dc48-45df-b077-659d974abaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:04.431324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc5ed1-dc48-45df-b077-659d974abaab admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:04.431598 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc5ed1-dc48-45df-b077-659d974abaab admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:04.431866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc5ed1-dc48-45df-b077-659d974abaab admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:04.432623 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc5ed1-dc48-45df-b077-659d974abaab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:04.434392 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc5ed1-dc48-45df-b077-659d974abaab admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:04.445193 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1053/2075] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:42:04.449485 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea123d1-02a5-49bc-8a78-515829e1188f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:04.459965 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea123d1-02a5-49bc-8a78-515829e1188f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:04.464620 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061bec21-05e7-4ac4-871b-68903a2beaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:04.465287 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bec21-05e7-4ac4-871b-68903a2beaf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:04.465578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bec21-05e7-4ac4-871b-68903a2beaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:04.465859 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bec21-05e7-4ac4-871b-68903a2beaf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:04.466732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061bec21-05e7-4ac4-871b-68903a2beaf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:04.470797 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061bec21-05e7-4ac4-871b-68903a2beaf9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:04.482719 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1023/2076] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:42:04.484121 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc5ed1-dc48-45df-b077-659d974abaab admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:04.494168 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc5ed1-dc48-45df-b077-659d974abaab admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:04.498891 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cc983-42e0-4ba9-a8a9-396460cf0727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:04.499819 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cc983-42e0-4ba9-a8a9-396460cf0727 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:04.500101 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cc983-42e0-4ba9-a8a9-396460cf0727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:04.500373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cc983-42e0-4ba9-a8a9-396460cf0727 admin admin] PATH_INFO: `/v3/projects/0a7b215295b34e978e885df5e134ea59/users/10d7e0c60787486182a0def2ff291883/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:04.515589 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501cc983-42e0-4ba9-a8a9-396460cf0727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a7b215295b34e978e885df5e134ea59, user_id=10d7e0c60787486182a0def2ff291883, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:04.518323 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501cc983-42e0-4ba9-a8a9-396460cf0727 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:04.533373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1054/2077] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:42:04 2022] PUT /identity/v3/projects/0a7b215295b34e978e885df5e134ea59/users/10d7e0c60787486182a0def2ff291883/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:42:04.544121 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf036cd-3d3e-42ee-b81f-84458764adfc None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:04.544588 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf036cd-3d3e-42ee-b81f-84458764adfc None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:04.544731 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf036cd-3d3e-42ee-b81f-84458764adfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:04.571512 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ddf036cd-3d3e-42ee-b81f-84458764adfc None None] MFA Rules not processed for user `10d7e0c60787486182a0def2ff291883`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:04.572841 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ddf036cd-3d3e-42ee-b81f-84458764adfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:04.640199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1024/2078] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:42:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:42:04.651618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cc983-42e0-4ba9-a8a9-396460cf0727 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:04.653338 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-501cc983-42e0-4ba9-a8a9-396460cf0727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:04.712555 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cc983-42e0-4ba9-a8a9-396460cf0727 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:04.716094 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0107e7-6c2d-4e77-a3db-918f8d03e663 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:04.716769 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0107e7-6c2d-4e77-a3db-918f8d03e663 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:04.717055 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0107e7-6c2d-4e77-a3db-918f8d03e663 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:04.717364 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0107e7-6c2d-4e77-a3db-918f8d03e663 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:04.725694 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0107e7-6c2d-4e77-a3db-918f8d03e663 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:04.727129 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0107e7-6c2d-4e77-a3db-918f8d03e663 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:04.736180 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1055/2079] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:42:04 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:42:14.636948 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=63,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:14.732300 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=66,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:17.513492 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf036cd-3d3e-42ee-b81f-84458764adfc None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:17.583881 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf036cd-3d3e-42ee-b81f-84458764adfc None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:17.588852 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0dd17-e57d-4e92-83ae-94e794f3b8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:17.589869 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0dd17-e57d-4e92-83ae-94e794f3b8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:17.590223 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0dd17-e57d-4e92-83ae-94e794f3b8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:17.590574 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0dd17-e57d-4e92-83ae-94e794f3b8b3 admin admin] PATH_INFO: `/v3/users/10d7e0c60787486182a0def2ff291883` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:17.591860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0dd17-e57d-4e92-83ae-94e794f3b8b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10d7e0c60787486182a0def2ff291883)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:17.593932 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0dd17-e57d-4e92-83ae-94e794f3b8b3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:17.674755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-08e0dd17-e57d-4e92-83ae-94e794f3b8b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10d7e0c60787486182a0def2ff291883'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:17.675544 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-08e0dd17-e57d-4e92-83ae-94e794f3b8b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10d7e0c60787486182a0def2ff291883'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:17.685268 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-08e0dd17-e57d-4e92-83ae-94e794f3b8b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10d7e0c60787486182a0def2ff291883'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:17.686079 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-08e0dd17-e57d-4e92-83ae-94e794f3b8b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10d7e0c60787486182a0def2ff291883'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:17.695872 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-08e0dd17-e57d-4e92-83ae-94e794f3b8b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10d7e0c60787486182a0def2ff291883'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:17.716401 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1025/2080] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:42:17 2022] DELETE /identity/v3/users/10d7e0c60787486182a0def2ff291883 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:42:17.720695 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97128a-d16a-4b0b-b355-1e76b0affa95 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:17.721164 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97128a-d16a-4b0b-b355-1e76b0affa95 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:17.721390 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97128a-d16a-4b0b-b355-1e76b0affa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:17.739896 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0d97128a-d16a-4b0b-b355-1e76b0affa95 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:17.741268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0d97128a-d16a-4b0b-b355-1e76b0affa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:17.806834 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1056/2081] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:42:17.818757 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0dd17-e57d-4e92-83ae-94e794f3b8b3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:17.820277 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-08e0dd17-e57d-4e92-83ae-94e794f3b8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:17.916027 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0dd17-e57d-4e92-83ae-94e794f3b8b3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:17.920119 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84781cc7-6a4f-43d6-a70b-6e93b18fe691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:17.921215 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84781cc7-6a4f-43d6-a70b-6e93b18fe691 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:17.921481 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84781cc7-6a4f-43d6-a70b-6e93b18fe691 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:17.921756 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84781cc7-6a4f-43d6-a70b-6e93b18fe691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:17.933993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84781cc7-6a4f-43d6-a70b-6e93b18fe691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:17.935538 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84781cc7-6a4f-43d6-a70b-6e93b18fe691 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:17.949303 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1026/2082] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:42:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:42:18.222852 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97128a-d16a-4b0b-b355-1e76b0affa95 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:18.224303 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0d97128a-d16a-4b0b-b355-1e76b0affa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:18.236709 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97128a-d16a-4b0b-b355-1e76b0affa95 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:18.241955 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2f96d-80c7-4634-9891-c1ffde18e1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:18.242818 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2f96d-80c7-4634-9891-c1ffde18e1da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:18.243101 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2f96d-80c7-4634-9891-c1ffde18e1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:18.243377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2f96d-80c7-4634-9891-c1ffde18e1da admin admin] PATH_INFO: `/v3/projects/0a7b215295b34e978e885df5e134ea59` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:18.244768 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2f96d-80c7-4634-9891-c1ffde18e1da admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a7b215295b34e978e885df5e134ea59)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:18.247946 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2f96d-80c7-4634-9891-c1ffde18e1da admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:18.295956 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c9c2f96d-80c7-4634-9891-c1ffde18e1da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a7b215295b34e978e885df5e134ea59', 'request_id': 'req-c9c2f96d-80c7-4634-9891-c1ffde18e1da'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:18.303665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c9c2f96d-80c7-4634-9891-c1ffde18e1da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a7b215295b34e978e885df5e134ea59', 'request_id': 'req-c9c2f96d-80c7-4634-9891-c1ffde18e1da'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:18.309953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c9c2f96d-80c7-4634-9891-c1ffde18e1da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a7b215295b34e978e885df5e134ea59', 'request_id': 'req-c9c2f96d-80c7-4634-9891-c1ffde18e1da'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:18.320656 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c9c2f96d-80c7-4634-9891-c1ffde18e1da admin admin] The token cache is being invalidate because project 0a7b215295b34e978e885df5e134ea59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:42:18.320936 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c9c2f96d-80c7-4634-9891-c1ffde18e1da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:18.321560 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c9c2f96d-80c7-4634-9891-c1ffde18e1da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:18.323097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1057/2083] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:42:18 2022] DELETE /identity/v3/projects/0a7b215295b34e978e885df5e134ea59 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:42:18.328072 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f248447-f243-488b-9f43-8cebd35eef6e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:18.328368 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f248447-f243-488b-9f43-8cebd35eef6e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:18.328680 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f248447-f243-488b-9f43-8cebd35eef6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:18.347318 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9f248447-f243-488b-9f43-8cebd35eef6e None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:18.348522 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9f248447-f243-488b-9f43-8cebd35eef6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:18.365339 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:18.410655 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1027/2084] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:42:18.419644 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0482f45-773b-424a-a51b-7401bbb56f8b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:18.419939 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0482f45-773b-424a-a51b-7401bbb56f8b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:18.420223 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0482f45-773b-424a-a51b-7401bbb56f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:18.438217 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c0482f45-773b-424a-a51b-7401bbb56f8b None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:18.439417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c0482f45-773b-424a-a51b-7401bbb56f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:18.447979 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1058/2085] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:42:18.452285 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f248447-f243-488b-9f43-8cebd35eef6e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:18.462689 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f248447-f243-488b-9f43-8cebd35eef6e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:18.467272 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a5f1a-e762-46c0-b05d-4e5662b751ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:18.467914 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a5f1a-e762-46c0-b05d-4e5662b751ed admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:18.468199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a5f1a-e762-46c0-b05d-4e5662b751ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:18.468476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a5f1a-e762-46c0-b05d-4e5662b751ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:18.469240 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a5f1a-e762-46c0-b05d-4e5662b751ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:42:18.469553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a5f1a-e762-46c0-b05d-4e5662b751ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:18.471163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a5f1a-e762-46c0-b05d-4e5662b751ed admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:18.483013 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1028/2086] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:42:18.487128 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0482f45-773b-424a-a51b-7401bbb56f8b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:18.496179 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0482f45-773b-424a-a51b-7401bbb56f8b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:18.500880 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604ddd9-e6cc-4962-ba60-4392fea45ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:18.501513 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604ddd9-e6cc-4962-ba60-4392fea45ec4 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:18.501792 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604ddd9-e6cc-4962-ba60-4392fea45ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:18.502064 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604ddd9-e6cc-4962-ba60-4392fea45ec4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:18.503277 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604ddd9-e6cc-4962-ba60-4392fea45ec4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:18.505227 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604ddd9-e6cc-4962-ba60-4392fea45ec4 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:18.530986 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1059/2087] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:42:18 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:42:18.535073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a5f1a-e762-46c0-b05d-4e5662b751ed admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:18.545057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a5f1a-e762-46c0-b05d-4e5662b751ed admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:18.600228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32039da-00eb-4bfe-bcc6-ffa67486a917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:18.600840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32039da-00eb-4bfe-bcc6-ffa67486a917 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:18.601119 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32039da-00eb-4bfe-bcc6-ffa67486a917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:18.601393 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32039da-00eb-4bfe-bcc6-ffa67486a917 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:18.602060 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32039da-00eb-4bfe-bcc6-ffa67486a917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:18.603981 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32039da-00eb-4bfe-bcc6-ffa67486a917 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:18.624979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1029/2088] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:42:18 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:42:18.629799 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604ddd9-e6cc-4962-ba60-4392fea45ec4 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:18.640052 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604ddd9-e6cc-4962-ba60-4392fea45ec4 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:18.644698 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1d008-8870-4ed2-8ffa-018c9274cdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:18.645349 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1d008-8870-4ed2-8ffa-018c9274cdf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:18.645636 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1d008-8870-4ed2-8ffa-018c9274cdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:18.645914 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1d008-8870-4ed2-8ffa-018c9274cdf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:18.646635 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1d008-8870-4ed2-8ffa-018c9274cdf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:18.648230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1d008-8870-4ed2-8ffa-018c9274cdf5 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:18.658967 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1060/2089] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:42:18.663303 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32039da-00eb-4bfe-bcc6-ffa67486a917 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:18.673709 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32039da-00eb-4bfe-bcc6-ffa67486a917 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:18.678825 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a20fae-12b6-4806-a53b-5bdfce4ca734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:18.679466 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a20fae-12b6-4806-a53b-5bdfce4ca734 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:18.679749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a20fae-12b6-4806-a53b-5bdfce4ca734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:18.680025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a20fae-12b6-4806-a53b-5bdfce4ca734 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:18.680771 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a20fae-12b6-4806-a53b-5bdfce4ca734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:18.682373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a20fae-12b6-4806-a53b-5bdfce4ca734 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:18.692899 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1030/2090] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:42:18.697028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1d008-8870-4ed2-8ffa-018c9274cdf5 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:18.706860 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1d008-8870-4ed2-8ffa-018c9274cdf5 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:18.711335 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8342fe-2869-43ae-a696-4bc04c3bcbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:18.712198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8342fe-2869-43ae-a696-4bc04c3bcbd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:18.712480 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8342fe-2869-43ae-a696-4bc04c3bcbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:18.712779 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8342fe-2869-43ae-a696-4bc04c3bcbd8 admin admin] PATH_INFO: `/v3/projects/0a693b8fd45d4dc29dfbcaa8271c7c5b/users/eac04c7b191d4b8ab13506bab8022cf2/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:18.726941 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8342fe-2869-43ae-a696-4bc04c3bcbd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a693b8fd45d4dc29dfbcaa8271c7c5b, user_id=eac04c7b191d4b8ab13506bab8022cf2, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:18.729747 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8342fe-2869-43ae-a696-4bc04c3bcbd8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:18.743161 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1061/2091] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:42:18 2022] PUT /identity/v3/projects/0a693b8fd45d4dc29dfbcaa8271c7c5b/users/eac04c7b191d4b8ab13506bab8022cf2/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:42:18.753828 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdbcf6-5f0e-4736-b2e3-e7a658aef953 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:18.754122 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdbcf6-5f0e-4736-b2e3-e7a658aef953 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:18.754408 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdbcf6-5f0e-4736-b2e3-e7a658aef953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:18.780600 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-99cdbcf6-5f0e-4736-b2e3-e7a658aef953 None None] MFA Rules not processed for user `eac04c7b191d4b8ab13506bab8022cf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:18.781809 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-99cdbcf6-5f0e-4736-b2e3-e7a658aef953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:18.845829 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1031/2092] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:42:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:42:18.850529 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8342fe-2869-43ae-a696-4bc04c3bcbd8 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:18.873074 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:18.928536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8342fe-2869-43ae-a696-4bc04c3bcbd8 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:18.934866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b7385-e504-43e2-9186-3b02c1763c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:18.935976 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b7385-e504-43e2-9186-3b02c1763c25 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:18.936453 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b7385-e504-43e2-9186-3b02c1763c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:18.936820 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b7385-e504-43e2-9186-3b02c1763c25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:18.937633 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b7385-e504-43e2-9186-3b02c1763c25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:18.939643 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b7385-e504-43e2-9186-3b02c1763c25 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:18.984564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1062/2093] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:42:18 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:42:18.988604 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdbcf6-5f0e-4736-b2e3-e7a658aef953 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:18.999689 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdbcf6-5f0e-4736-b2e3-e7a658aef953 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:19.015178 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:19.068352 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec37b87-2e74-40e2-a6ef-37d78105869a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:19.069055 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec37b87-2e74-40e2-a6ef-37d78105869a admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:19.069371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec37b87-2e74-40e2-a6ef-37d78105869a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:19.069655 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec37b87-2e74-40e2-a6ef-37d78105869a admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:19.070352 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec37b87-2e74-40e2-a6ef-37d78105869a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:19.072324 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec37b87-2e74-40e2-a6ef-37d78105869a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:19.095671 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1032/2094] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:42:18 2022] POST /identity/v3/users => generated 297 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:42:19.097487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b7385-e504-43e2-9186-3b02c1763c25 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:19.107907 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b7385-e504-43e2-9186-3b02c1763c25 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:19.113111 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a83e9-ca65-4cbb-8a66-4bf18f7d00d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:19.113856 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a83e9-ca65-4cbb-8a66-4bf18f7d00d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:19.114155 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a83e9-ca65-4cbb-8a66-4bf18f7d00d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:19.114437 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a83e9-ca65-4cbb-8a66-4bf18f7d00d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:19.115148 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a83e9-ca65-4cbb-8a66-4bf18f7d00d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:19.116764 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a83e9-ca65-4cbb-8a66-4bf18f7d00d2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:19.128286 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1063/2095] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:42:19.132218 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec37b87-2e74-40e2-a6ef-37d78105869a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:19.142193 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec37b87-2e74-40e2-a6ef-37d78105869a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:19.146810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc2391-602c-45a1-bc23-ef38583ed337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:19.147781 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc2391-602c-45a1-bc23-ef38583ed337 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:19.148073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc2391-602c-45a1-bc23-ef38583ed337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:19.148357 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc2391-602c-45a1-bc23-ef38583ed337 admin admin] PATH_INFO: `/v3/projects/3242edb05ca04ae699f320925ec8595a/users/3893cbc80600467a938466fa860aeeac/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:19.163397 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc2391-602c-45a1-bc23-ef38583ed337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3242edb05ca04ae699f320925ec8595a, user_id=3893cbc80600467a938466fa860aeeac, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:19.166109 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc2391-602c-45a1-bc23-ef38583ed337 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:19.180359 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1033/2096] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:42:19 2022] PUT /identity/v3/projects/3242edb05ca04ae699f320925ec8595a/users/3893cbc80600467a938466fa860aeeac/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:42:19.184359 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a83e9-ca65-4cbb-8a66-4bf18f7d00d2 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:19.194212 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a83e9-ca65-4cbb-8a66-4bf18f7d00d2 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:19.250191 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d274b-6087-48f7-a185-e9dea2a99794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:19.250888 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d274b-6087-48f7-a185-e9dea2a99794 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:19.251169 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d274b-6087-48f7-a185-e9dea2a99794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:19.251471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d274b-6087-48f7-a185-e9dea2a99794 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:19.252191 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d274b-6087-48f7-a185-e9dea2a99794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:19.253966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d274b-6087-48f7-a185-e9dea2a99794 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:19.267722 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1064/2097] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:42:19.271951 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc2391-602c-45a1-bc23-ef38583ed337 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:19.282484 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc2391-602c-45a1-bc23-ef38583ed337 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:19.287656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be354f-0e6d-45fe-a4d9-7dd7eea8c238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:19.288535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be354f-0e6d-45fe-a4d9-7dd7eea8c238 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:19.288833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be354f-0e6d-45fe-a4d9-7dd7eea8c238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:19.289110 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be354f-0e6d-45fe-a4d9-7dd7eea8c238 admin admin] PATH_INFO: `/v3/projects/3242edb05ca04ae699f320925ec8595a/users/3893cbc80600467a938466fa860aeeac/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:19.291087 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be354f-0e6d-45fe-a4d9-7dd7eea8c238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3242edb05ca04ae699f320925ec8595a, user_id=3893cbc80600467a938466fa860aeeac, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:19.293817 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be354f-0e6d-45fe-a4d9-7dd7eea8c238 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:19.304577 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1034/2098] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:42:19 2022] PUT /identity/v3/projects/3242edb05ca04ae699f320925ec8595a/users/3893cbc80600467a938466fa860aeeac/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:42:19.314464 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693af79-8272-4d45-96f9-c02fbc20b930 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:19.314756 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693af79-8272-4d45-96f9-c02fbc20b930 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:19.315038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693af79-8272-4d45-96f9-c02fbc20b930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:19.340960 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-6693af79-8272-4d45-96f9-c02fbc20b930 None None] MFA Rules not processed for user `3893cbc80600467a938466fa860aeeac`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:19.342149 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6693af79-8272-4d45-96f9-c02fbc20b930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:19.409644 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1065/2099] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:42:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:42:19.421025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be354f-0e6d-45fe-a4d9-7dd7eea8c238 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:19.422704 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-36be354f-0e6d-45fe-a4d9-7dd7eea8c238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:19.479913 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be354f-0e6d-45fe-a4d9-7dd7eea8c238 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:19.483751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28942f28-cb1e-413f-a0ab-3e2c0202e184 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:19.484383 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28942f28-cb1e-413f-a0ab-3e2c0202e184 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:19.484706 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28942f28-cb1e-413f-a0ab-3e2c0202e184 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:19.484985 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28942f28-cb1e-413f-a0ab-3e2c0202e184 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:19.493882 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28942f28-cb1e-413f-a0ab-3e2c0202e184 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:19.495336 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28942f28-cb1e-413f-a0ab-3e2c0202e184 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:19.504659 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1035/2100] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:42:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:42:19.566497 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693af79-8272-4d45-96f9-c02fbc20b930 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:19.584342 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:19.632759 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693af79-8272-4d45-96f9-c02fbc20b930 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:19.637402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7b834-295b-4411-92b5-59e1a119c50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:19.638268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7b834-295b-4411-92b5-59e1a119c50c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:19.638553 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7b834-295b-4411-92b5-59e1a119c50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:19.638983 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7b834-295b-4411-92b5-59e1a119c50c admin admin] PATH_INFO: `/v3/users/eac04c7b191d4b8ab13506bab8022cf2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:19.640233 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7b834-295b-4411-92b5-59e1a119c50c admin admin] RBAC: Authorizing `identity:delete_user(user_id=eac04c7b191d4b8ab13506bab8022cf2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:19.642444 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7b834-295b-4411-92b5-59e1a119c50c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:19.689792 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-70b7b834-295b-4411-92b5-59e1a119c50c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eac04c7b191d4b8ab13506bab8022cf2'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:19.701970 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-70b7b834-295b-4411-92b5-59e1a119c50c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eac04c7b191d4b8ab13506bab8022cf2'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:19.702675 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-70b7b834-295b-4411-92b5-59e1a119c50c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eac04c7b191d4b8ab13506bab8022cf2'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:19.710008 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-70b7b834-295b-4411-92b5-59e1a119c50c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eac04c7b191d4b8ab13506bab8022cf2'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:19.710652 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-70b7b834-295b-4411-92b5-59e1a119c50c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eac04c7b191d4b8ab13506bab8022cf2'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:19.723155 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1066/2101] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:42:19 2022] DELETE /identity/v3/users/eac04c7b191d4b8ab13506bab8022cf2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:42:19.727726 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fe5af-df56-4adf-8c73-92e3e116a3ed None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:19.728176 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fe5af-df56-4adf-8c73-92e3e116a3ed None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:19.728266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fe5af-df56-4adf-8c73-92e3e116a3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:19.746767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-dc2fe5af-df56-4adf-8c73-92e3e116a3ed None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:19.747948 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dc2fe5af-df56-4adf-8c73-92e3e116a3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:19.809875 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1036/2102] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:42:19.820118 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7b834-295b-4411-92b5-59e1a119c50c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:19.821543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-70b7b834-295b-4411-92b5-59e1a119c50c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:19.881240 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7b834-295b-4411-92b5-59e1a119c50c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:19.885590 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d5d41-7ba7-4382-a940-292fd668153c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:19.886241 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d5d41-7ba7-4382-a940-292fd668153c service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:19.886524 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d5d41-7ba7-4382-a940-292fd668153c service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:19.886802 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d5d41-7ba7-4382-a940-292fd668153c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:19.896947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d5d41-7ba7-4382-a940-292fd668153c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:19.898492 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d5d41-7ba7-4382-a940-292fd668153c service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:19.908430 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1067/2103] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:42:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:42:20.333621 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fe5af-df56-4adf-8c73-92e3e116a3ed None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:20.335325 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dc2fe5af-df56-4adf-8c73-92e3e116a3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:20.386324 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fe5af-df56-4adf-8c73-92e3e116a3ed None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:20.401159 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2ad6c-3bb2-42af-a847-ae8394930b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:20.402274 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2ad6c-3bb2-42af-a847-ae8394930b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:20.402919 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2ad6c-3bb2-42af-a847-ae8394930b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:20.403698 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2ad6c-3bb2-42af-a847-ae8394930b5f admin admin] PATH_INFO: `/v3/projects/0a693b8fd45d4dc29dfbcaa8271c7c5b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:20.408236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2ad6c-3bb2-42af-a847-ae8394930b5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a693b8fd45d4dc29dfbcaa8271c7c5b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:20.416750 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2ad6c-3bb2-42af-a847-ae8394930b5f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:20.427597 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:20.494469 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bbb2ad6c-3bb2-42af-a847-ae8394930b5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a693b8fd45d4dc29dfbcaa8271c7c5b', 'request_id': 'req-bbb2ad6c-3bb2-42af-a847-ae8394930b5f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:20.506731 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bbb2ad6c-3bb2-42af-a847-ae8394930b5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a693b8fd45d4dc29dfbcaa8271c7c5b', 'request_id': 'req-bbb2ad6c-3bb2-42af-a847-ae8394930b5f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:20.514629 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bbb2ad6c-3bb2-42af-a847-ae8394930b5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a693b8fd45d4dc29dfbcaa8271c7c5b', 'request_id': 'req-bbb2ad6c-3bb2-42af-a847-ae8394930b5f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:20.526681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bbb2ad6c-3bb2-42af-a847-ae8394930b5f admin admin] The token cache is being invalidate because project 0a693b8fd45d4dc29dfbcaa8271c7c5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:42:20.526966 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bbb2ad6c-3bb2-42af-a847-ae8394930b5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:20.527675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bbb2ad6c-3bb2-42af-a847-ae8394930b5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:20.529266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1037/2104] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:42:20 2022] DELETE /identity/v3/projects/0a693b8fd45d4dc29dfbcaa8271c7c5b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:42:20.533359 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d5d41-7ba7-4382-a940-292fd668153c service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:20.546198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d5d41-7ba7-4382-a940-292fd668153c service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:20.586619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:20.614159 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0c669-63cb-494b-aa63-d6dddc92365e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:20.615053 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0c669-63cb-494b-aa63-d6dddc92365e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:20.615363 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0c669-63cb-494b-aa63-d6dddc92365e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:20.616103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0c669-63cb-494b-aa63-d6dddc92365e admin admin] PATH_INFO: `/v3/users/3893cbc80600467a938466fa860aeeac` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:20.616964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0c669-63cb-494b-aa63-d6dddc92365e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3893cbc80600467a938466fa860aeeac)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:20.618882 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0c669-63cb-494b-aa63-d6dddc92365e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:20.666131 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-68e0c669-63cb-494b-aa63-d6dddc92365e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3893cbc80600467a938466fa860aeeac'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:20.678399 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-68e0c669-63cb-494b-aa63-d6dddc92365e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3893cbc80600467a938466fa860aeeac'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:20.679072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-68e0c669-63cb-494b-aa63-d6dddc92365e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3893cbc80600467a938466fa860aeeac'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:20.685886 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-68e0c669-63cb-494b-aa63-d6dddc92365e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3893cbc80600467a938466fa860aeeac'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:20.686514 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-68e0c669-63cb-494b-aa63-d6dddc92365e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3893cbc80600467a938466fa860aeeac'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:20.698666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1068/2105] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:42:20 2022] DELETE /identity/v3/users/3893cbc80600467a938466fa860aeeac => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:42:20.999334 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2ad6c-3bb2-42af-a847-ae8394930b5f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:21.000928 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-bbb2ad6c-3bb2-42af-a847-ae8394930b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:21.017441 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2ad6c-3bb2-42af-a847-ae8394930b5f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:21.084546 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5727e-6b8f-491d-bf31-f315505ca92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:21.085570 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5727e-6b8f-491d-bf31-f315505ca92f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:21.085918 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5727e-6b8f-491d-bf31-f315505ca92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:21.086199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5727e-6b8f-491d-bf31-f315505ca92f admin admin] PATH_INFO: `/v3/projects/3242edb05ca04ae699f320925ec8595a` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:21.087367 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5727e-6b8f-491d-bf31-f315505ca92f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3242edb05ca04ae699f320925ec8595a)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:21.089366 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5727e-6b8f-491d-bf31-f315505ca92f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:21.136811 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-66b5727e-6b8f-491d-bf31-f315505ca92f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3242edb05ca04ae699f320925ec8595a', 'request_id': 'req-66b5727e-6b8f-491d-bf31-f315505ca92f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:21.146918 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-66b5727e-6b8f-491d-bf31-f315505ca92f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3242edb05ca04ae699f320925ec8595a', 'request_id': 'req-66b5727e-6b8f-491d-bf31-f315505ca92f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:21.153368 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-66b5727e-6b8f-491d-bf31-f315505ca92f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3242edb05ca04ae699f320925ec8595a', 'request_id': 'req-66b5727e-6b8f-491d-bf31-f315505ca92f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:21.166072 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-66b5727e-6b8f-491d-bf31-f315505ca92f admin admin] The token cache is being invalidate because project 3242edb05ca04ae699f320925ec8595a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:42:21.166363 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-66b5727e-6b8f-491d-bf31-f315505ca92f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:21.167035 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-66b5727e-6b8f-491d-bf31-f315505ca92f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:21.168602 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1038/2106] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:42:20 2022] DELETE /identity/v3/projects/3242edb05ca04ae699f320925ec8595a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:42:21.173552 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985b454-4252-4922-b92c-87c0feb4a8b7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:21.174051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985b454-4252-4922-b92c-87c0feb4a8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:21.174153 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985b454-4252-4922-b92c-87c0feb4a8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:21.193516 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b985b454-4252-4922-b92c-87c0feb4a8b7 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:21.194761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b985b454-4252-4922-b92c-87c0feb4a8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:21.270214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1069/2107] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:42:21.279109 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a66f8e-7ba3-4f33-a230-8f34c02a7c1e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:21.279470 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a66f8e-7ba3-4f33-a230-8f34c02a7c1e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:21.279755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a66f8e-7ba3-4f33-a230-8f34c02a7c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:21.302157 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-42a66f8e-7ba3-4f33-a230-8f34c02a7c1e None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:21.303362 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-42a66f8e-7ba3-4f33-a230-8f34c02a7c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:21.311372 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1039/2108] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:42:21.315543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985b454-4252-4922-b92c-87c0feb4a8b7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:21.325160 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985b454-4252-4922-b92c-87c0feb4a8b7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:21.329617 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58bf36-5e14-41ee-b5c7-6138b5b1f285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:21.330267 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58bf36-5e14-41ee-b5c7-6138b5b1f285 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:21.330546 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58bf36-5e14-41ee-b5c7-6138b5b1f285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:21.330853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58bf36-5e14-41ee-b5c7-6138b5b1f285 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:21.331562 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58bf36-5e14-41ee-b5c7-6138b5b1f285 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:42:21.331868 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58bf36-5e14-41ee-b5c7-6138b5b1f285 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:21.333560 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58bf36-5e14-41ee-b5c7-6138b5b1f285 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:21.349494 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1070/2109] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:42:21.354276 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a66f8e-7ba3-4f33-a230-8f34c02a7c1e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:21.364334 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a66f8e-7ba3-4f33-a230-8f34c02a7c1e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:21.369097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cc68e-1df9-43d7-b213-e92f3d8661b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:21.369747 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cc68e-1df9-43d7-b213-e92f3d8661b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:21.370035 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cc68e-1df9-43d7-b213-e92f3d8661b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:21.370345 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cc68e-1df9-43d7-b213-e92f3d8661b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:21.371032 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cc68e-1df9-43d7-b213-e92f3d8661b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:21.372969 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cc68e-1df9-43d7-b213-e92f3d8661b3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:21.392888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:21.401493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1040/2110] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:42:21 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:42:21.406017 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58bf36-5e14-41ee-b5c7-6138b5b1f285 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:21.418591 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58bf36-5e14-41ee-b5c7-6138b5b1f285 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:21.468185 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:21.491952 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c013d8b-f79f-4e12-ac4b-dd3bf3c9ac64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:21.491952 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c013d8b-f79f-4e12-ac4b-dd3bf3c9ac64 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:21.491952 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c013d8b-f79f-4e12-ac4b-dd3bf3c9ac64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:21.491952 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c013d8b-f79f-4e12-ac4b-dd3bf3c9ac64 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:21.492405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c013d8b-f79f-4e12-ac4b-dd3bf3c9ac64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:21.492915 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c013d8b-f79f-4e12-ac4b-dd3bf3c9ac64 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:21.515943 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1071/2111] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:42:21 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:42:21.519969 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cc68e-1df9-43d7-b213-e92f3d8661b3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:21.532878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cc68e-1df9-43d7-b213-e92f3d8661b3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:21.539295 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67579b8-1851-4577-99b2-8bc0d6586d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:21.539954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67579b8-1851-4577-99b2-8bc0d6586d1e admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:21.540240 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67579b8-1851-4577-99b2-8bc0d6586d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:21.540545 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67579b8-1851-4577-99b2-8bc0d6586d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:21.541282 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67579b8-1851-4577-99b2-8bc0d6586d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:21.544698 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67579b8-1851-4577-99b2-8bc0d6586d1e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:21.561539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1041/2112] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:42:21.563072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c013d8b-f79f-4e12-ac4b-dd3bf3c9ac64 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:21.574808 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c013d8b-f79f-4e12-ac4b-dd3bf3c9ac64 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:21.580355 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583875c7-a70b-40eb-9c93-962c514702f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:21.581744 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583875c7-a70b-40eb-9c93-962c514702f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:21.582029 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583875c7-a70b-40eb-9c93-962c514702f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:21.582460 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583875c7-a70b-40eb-9c93-962c514702f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:21.583252 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583875c7-a70b-40eb-9c93-962c514702f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:21.585097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583875c7-a70b-40eb-9c93-962c514702f4 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:21.601097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1072/2113] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:42:21.605680 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67579b8-1851-4577-99b2-8bc0d6586d1e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:21.617511 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67579b8-1851-4577-99b2-8bc0d6586d1e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:21.624131 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f35a4-998d-4a54-aa64-4f86a77dbb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:21.625180 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f35a4-998d-4a54-aa64-4f86a77dbb09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:21.625535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f35a4-998d-4a54-aa64-4f86a77dbb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:21.625887 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f35a4-998d-4a54-aa64-4f86a77dbb09 admin admin] PATH_INFO: `/v3/projects/09289fb74fcd4c64bcf2675c99c55ab3/users/c4b585b343f3473980407e4946053f9e/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:21.642208 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f35a4-998d-4a54-aa64-4f86a77dbb09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09289fb74fcd4c64bcf2675c99c55ab3, user_id=c4b585b343f3473980407e4946053f9e, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:21.645879 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f35a4-998d-4a54-aa64-4f86a77dbb09 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:21.669677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1042/2114] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:42:21 2022] PUT /identity/v3/projects/09289fb74fcd4c64bcf2675c99c55ab3/users/c4b585b343f3473980407e4946053f9e/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:42:21.683410 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83004d98-e964-4c5b-a4dd-020aeb066b40 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:21.683778 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83004d98-e964-4c5b-a4dd-020aeb066b40 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:21.683971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83004d98-e964-4c5b-a4dd-020aeb066b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:21.719496 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-83004d98-e964-4c5b-a4dd-020aeb066b40 None None] MFA Rules not processed for user `c4b585b343f3473980407e4946053f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:21.722512 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-83004d98-e964-4c5b-a4dd-020aeb066b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:21.822602 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1073/2115] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:42:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:42:21.828531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f35a4-998d-4a54-aa64-4f86a77dbb09 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:21.926797 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f35a4-998d-4a54-aa64-4f86a77dbb09 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:21.931986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f3df3-4120-4024-962d-fdfbefe8a560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:21.934138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f3df3-4120-4024-962d-fdfbefe8a560 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:21.934422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f3df3-4120-4024-962d-fdfbefe8a560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:21.934698 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f3df3-4120-4024-962d-fdfbefe8a560 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:21.935392 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f3df3-4120-4024-962d-fdfbefe8a560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:21.937390 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f3df3-4120-4024-962d-fdfbefe8a560 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:21.968175 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1043/2116] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:42:21 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:42:21.969369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83004d98-e964-4c5b-a4dd-020aeb066b40 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:21.981795 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83004d98-e964-4c5b-a4dd-020aeb066b40 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:22.040546 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5141289-3b7f-45aa-bb77-26081afa9ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:22.041213 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5141289-3b7f-45aa-bb77-26081afa9ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:22.041495 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5141289-3b7f-45aa-bb77-26081afa9ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:22.041768 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5141289-3b7f-45aa-bb77-26081afa9ce8 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:22.042443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5141289-3b7f-45aa-bb77-26081afa9ce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:22.044353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5141289-3b7f-45aa-bb77-26081afa9ce8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:22.068899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1074/2117] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:42:21 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:42:22.070094 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f3df3-4120-4024-962d-fdfbefe8a560 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:22.080816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f3df3-4120-4024-962d-fdfbefe8a560 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:22.085629 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38080e6d-a440-4470-b29f-6d74909ae5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:22.086289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38080e6d-a440-4470-b29f-6d74909ae5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:22.086577 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38080e6d-a440-4470-b29f-6d74909ae5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:22.086864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38080e6d-a440-4470-b29f-6d74909ae5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:22.087585 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38080e6d-a440-4470-b29f-6d74909ae5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:22.089365 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38080e6d-a440-4470-b29f-6d74909ae5d1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:22.103997 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1044/2118] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:42:22.108683 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5141289-3b7f-45aa-bb77-26081afa9ce8 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:22.120357 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5141289-3b7f-45aa-bb77-26081afa9ce8 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:22.125244 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12a310-2383-46b6-9a36-d09f920bbec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:22.126154 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12a310-2383-46b6-9a36-d09f920bbec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:22.126438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12a310-2383-46b6-9a36-d09f920bbec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:22.126718 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12a310-2383-46b6-9a36-d09f920bbec2 admin admin] PATH_INFO: `/v3/projects/d5af4fe224a44ab3a8c1be7c797d3869/users/b32cf3ad1bff4e598c21c3dc6562d739/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:22.142309 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12a310-2383-46b6-9a36-d09f920bbec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5af4fe224a44ab3a8c1be7c797d3869, user_id=b32cf3ad1bff4e598c21c3dc6562d739, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:22.145090 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12a310-2383-46b6-9a36-d09f920bbec2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:22.163759 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1075/2119] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:42:22 2022] PUT /identity/v3/projects/d5af4fe224a44ab3a8c1be7c797d3869/users/b32cf3ad1bff4e598c21c3dc6562d739/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:42:22.164466 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38080e6d-a440-4470-b29f-6d74909ae5d1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:22.176314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38080e6d-a440-4470-b29f-6d74909ae5d1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:22.231954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d16092-646c-4929-9272-361a6054c501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:22.232666 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d16092-646c-4929-9272-361a6054c501 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:22.232957 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d16092-646c-4929-9272-361a6054c501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:22.233249 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d16092-646c-4929-9272-361a6054c501 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:22.234040 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d16092-646c-4929-9272-361a6054c501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:22.235670 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d16092-646c-4929-9272-361a6054c501 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:22.245865 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1045/2120] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:42:22.250284 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12a310-2383-46b6-9a36-d09f920bbec2 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:22.260585 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12a310-2383-46b6-9a36-d09f920bbec2 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:22.265230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0ad57-4117-4387-8a7d-7347f87a273d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:22.266106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0ad57-4117-4387-8a7d-7347f87a273d admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:22.266382 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0ad57-4117-4387-8a7d-7347f87a273d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:22.266651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0ad57-4117-4387-8a7d-7347f87a273d admin admin] PATH_INFO: `/v3/projects/d5af4fe224a44ab3a8c1be7c797d3869/users/b32cf3ad1bff4e598c21c3dc6562d739/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:22.268610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0ad57-4117-4387-8a7d-7347f87a273d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5af4fe224a44ab3a8c1be7c797d3869, user_id=b32cf3ad1bff4e598c21c3dc6562d739, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:22.271283 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0ad57-4117-4387-8a7d-7347f87a273d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:22.281422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1076/2121] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:42:22 2022] PUT /identity/v3/projects/d5af4fe224a44ab3a8c1be7c797d3869/users/b32cf3ad1bff4e598c21c3dc6562d739/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:42:22.292025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79f196-0b2d-4785-a911-d56c51d90494 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:22.292316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79f196-0b2d-4785-a911-d56c51d90494 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:22.292636 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79f196-0b2d-4785-a911-d56c51d90494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:22.318764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8b79f196-0b2d-4785-a911-d56c51d90494 None None] MFA Rules not processed for user `b32cf3ad1bff4e598c21c3dc6562d739`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:22.319949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8b79f196-0b2d-4785-a911-d56c51d90494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:22.340030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:22.390277 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1046/2122] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:42:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:42:22.402411 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0ad57-4117-4387-8a7d-7347f87a273d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:22.404069 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1ea0ad57-4117-4387-8a7d-7347f87a273d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:22.411214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:22.462267 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0ad57-4117-4387-8a7d-7347f87a273d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:22.465811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120f26e-07af-401e-b3c9-5fffb3da7df2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:22.466461 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120f26e-07af-401e-b3c9-5fffb3da7df2 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:22.466739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120f26e-07af-401e-b3c9-5fffb3da7df2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:22.467012 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120f26e-07af-401e-b3c9-5fffb3da7df2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:22.476293 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120f26e-07af-401e-b3c9-5fffb3da7df2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:22.477770 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120f26e-07af-401e-b3c9-5fffb3da7df2 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:22.487230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1077/2123] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:42:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:42:22.554256 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79f196-0b2d-4785-a911-d56c51d90494 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:22.563641 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79f196-0b2d-4785-a911-d56c51d90494 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:22.567209 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1a605-e9ca-4bde-81a1-94ad02c17041 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:22.567836 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1a605-e9ca-4bde-81a1-94ad02c17041 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:22.568118 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1a605-e9ca-4bde-81a1-94ad02c17041 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:22.568391 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1a605-e9ca-4bde-81a1-94ad02c17041 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:22.623181 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1a605-e9ca-4bde-81a1-94ad02c17041 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:22.624642 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1a605-e9ca-4bde-81a1-94ad02c17041 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:22.633378 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1047/2124] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:42:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:42:22.890161 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120f26e-07af-401e-b3c9-5fffb3da7df2 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:22.970639 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120f26e-07af-401e-b3c9-5fffb3da7df2 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:22.976861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa01af-1ff5-48d4-b69e-d225c6e01482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:22.977848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa01af-1ff5-48d4-b69e-d225c6e01482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:22.978135 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa01af-1ff5-48d4-b69e-d225c6e01482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:22.978414 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa01af-1ff5-48d4-b69e-d225c6e01482 admin admin] PATH_INFO: `/v3/users/c4b585b343f3473980407e4946053f9e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:22.979843 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa01af-1ff5-48d4-b69e-d225c6e01482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4b585b343f3473980407e4946053f9e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:22.982056 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa01af-1ff5-48d4-b69e-d225c6e01482 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:23.032856 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-98fa01af-1ff5-48d4-b69e-d225c6e01482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4b585b343f3473980407e4946053f9e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:23.045959 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-98fa01af-1ff5-48d4-b69e-d225c6e01482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4b585b343f3473980407e4946053f9e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:23.046823 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-98fa01af-1ff5-48d4-b69e-d225c6e01482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4b585b343f3473980407e4946053f9e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:23.054704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-98fa01af-1ff5-48d4-b69e-d225c6e01482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4b585b343f3473980407e4946053f9e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:23.055297 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-98fa01af-1ff5-48d4-b69e-d225c6e01482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4b585b343f3473980407e4946053f9e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:23.068543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1078/2125] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:42:22 2022] DELETE /identity/v3/users/c4b585b343f3473980407e4946053f9e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:42:23.073285 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207e3ac-4d4f-47ba-889d-e076205b7391 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:23.073793 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207e3ac-4d4f-47ba-889d-e076205b7391 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:23.074039 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207e3ac-4d4f-47ba-889d-e076205b7391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:23.094502 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3207e3ac-4d4f-47ba-889d-e076205b7391 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:23.095709 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3207e3ac-4d4f-47ba-889d-e076205b7391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:23.162110 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1048/2126] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:42:23.171677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa01af-1ff5-48d4-b69e-d225c6e01482 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:23.173166 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-98fa01af-1ff5-48d4-b69e-d225c6e01482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:23.205211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:23.233268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa01af-1ff5-48d4-b69e-d225c6e01482 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:23.237486 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8ec99-7f08-48f3-89d9-413ff9f07ca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:23.238206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8ec99-7f08-48f3-89d9-413ff9f07ca1 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:23.238495 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8ec99-7f08-48f3-89d9-413ff9f07ca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:23.238773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8ec99-7f08-48f3-89d9-413ff9f07ca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:23.247930 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8ec99-7f08-48f3-89d9-413ff9f07ca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:23.249411 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8ec99-7f08-48f3-89d9-413ff9f07ca1 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:23.261382 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1079/2127] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:42:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:42:23.521176 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207e3ac-4d4f-47ba-889d-e076205b7391 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:23.522678 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3207e3ac-4d4f-47ba-889d-e076205b7391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:23.535191 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207e3ac-4d4f-47ba-889d-e076205b7391 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:23.539725 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e9ec6-1b83-4e9e-91cc-d631b6a421cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:23.540718 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e9ec6-1b83-4e9e-91cc-d631b6a421cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:23.541015 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e9ec6-1b83-4e9e-91cc-d631b6a421cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:23.541289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e9ec6-1b83-4e9e-91cc-d631b6a421cd admin admin] PATH_INFO: `/v3/projects/09289fb74fcd4c64bcf2675c99c55ab3` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:23.542459 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e9ec6-1b83-4e9e-91cc-d631b6a421cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=09289fb74fcd4c64bcf2675c99c55ab3)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:23.544370 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e9ec6-1b83-4e9e-91cc-d631b6a421cd admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:23.590726 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-963e9ec6-1b83-4e9e-91cc-d631b6a421cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09289fb74fcd4c64bcf2675c99c55ab3', 'request_id': 'req-963e9ec6-1b83-4e9e-91cc-d631b6a421cd'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:23.593168 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:23.599502 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-963e9ec6-1b83-4e9e-91cc-d631b6a421cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09289fb74fcd4c64bcf2675c99c55ab3', 'request_id': 'req-963e9ec6-1b83-4e9e-91cc-d631b6a421cd'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:23.606777 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-963e9ec6-1b83-4e9e-91cc-d631b6a421cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09289fb74fcd4c64bcf2675c99c55ab3', 'request_id': 'req-963e9ec6-1b83-4e9e-91cc-d631b6a421cd'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:23.618146 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-963e9ec6-1b83-4e9e-91cc-d631b6a421cd admin admin] The token cache is being invalidate because project 09289fb74fcd4c64bcf2675c99c55ab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:42:23.618431 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-963e9ec6-1b83-4e9e-91cc-d631b6a421cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:23.619049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-963e9ec6-1b83-4e9e-91cc-d631b6a421cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:23.620600 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1049/2128] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:42:23 2022] DELETE /identity/v3/projects/09289fb74fcd4c64bcf2675c99c55ab3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:42:23.624518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8ec99-7f08-48f3-89d9-413ff9f07ca1 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:23.633847 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8ec99-7f08-48f3-89d9-413ff9f07ca1 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:23.689087 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ef525-b455-48e6-8f86-e41610ae8409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:23.689950 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ef525-b455-48e6-8f86-e41610ae8409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:23.690231 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ef525-b455-48e6-8f86-e41610ae8409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:23.690506 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ef525-b455-48e6-8f86-e41610ae8409 admin admin] PATH_INFO: `/v3/users/b32cf3ad1bff4e598c21c3dc6562d739` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:23.691675 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ef525-b455-48e6-8f86-e41610ae8409 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b32cf3ad1bff4e598c21c3dc6562d739)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:23.693629 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ef525-b455-48e6-8f86-e41610ae8409 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:23.738286 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a27ef525-b455-48e6-8f86-e41610ae8409 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b32cf3ad1bff4e598c21c3dc6562d739'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:23.750104 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a27ef525-b455-48e6-8f86-e41610ae8409 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b32cf3ad1bff4e598c21c3dc6562d739'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:23.750754 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a27ef525-b455-48e6-8f86-e41610ae8409 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b32cf3ad1bff4e598c21c3dc6562d739'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:23.757459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a27ef525-b455-48e6-8f86-e41610ae8409 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b32cf3ad1bff4e598c21c3dc6562d739'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:23.758096 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a27ef525-b455-48e6-8f86-e41610ae8409 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b32cf3ad1bff4e598c21c3dc6562d739'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:23.770206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1080/2129] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:42:23 2022] DELETE /identity/v3/users/b32cf3ad1bff4e598c21c3dc6562d739 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:42:24.043272 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e9ec6-1b83-4e9e-91cc-d631b6a421cd admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:24.045745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-963e9ec6-1b83-4e9e-91cc-d631b6a421cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:24.068398 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e9ec6-1b83-4e9e-91cc-d631b6a421cd admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:24.146671 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb7fcf-ca10-4c19-9932-4aa4e26c8581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:24.147620 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb7fcf-ca10-4c19-9932-4aa4e26c8581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:24.147905 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb7fcf-ca10-4c19-9932-4aa4e26c8581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:24.148189 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb7fcf-ca10-4c19-9932-4aa4e26c8581 admin admin] PATH_INFO: `/v3/projects/d5af4fe224a44ab3a8c1be7c797d3869` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:24.149439 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb7fcf-ca10-4c19-9932-4aa4e26c8581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5af4fe224a44ab3a8c1be7c797d3869)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:24.151363 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb7fcf-ca10-4c19-9932-4aa4e26c8581 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:24.204497 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e4bb7fcf-ca10-4c19-9932-4aa4e26c8581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5af4fe224a44ab3a8c1be7c797d3869', 'request_id': 'req-e4bb7fcf-ca10-4c19-9932-4aa4e26c8581'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:24.213945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e4bb7fcf-ca10-4c19-9932-4aa4e26c8581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5af4fe224a44ab3a8c1be7c797d3869', 'request_id': 'req-e4bb7fcf-ca10-4c19-9932-4aa4e26c8581'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:24.230561 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e4bb7fcf-ca10-4c19-9932-4aa4e26c8581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5af4fe224a44ab3a8c1be7c797d3869', 'request_id': 'req-e4bb7fcf-ca10-4c19-9932-4aa4e26c8581'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:24.241887 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e4bb7fcf-ca10-4c19-9932-4aa4e26c8581 admin admin] The token cache is being invalidate because project d5af4fe224a44ab3a8c1be7c797d3869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:42:24.242174 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e4bb7fcf-ca10-4c19-9932-4aa4e26c8581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:24.242823 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e4bb7fcf-ca10-4c19-9932-4aa4e26c8581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:24.244361 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1050/2130] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:42:24 2022] DELETE /identity/v3/projects/d5af4fe224a44ab3a8c1be7c797d3869 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:42:24.249418 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714554c-0cd8-4fb9-9af0-f3385c930615 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:24.249706 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714554c-0cd8-4fb9-9af0-f3385c930615 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:24.250009 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714554c-0cd8-4fb9-9af0-f3385c930615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:24.270785 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-4714554c-0cd8-4fb9-9af0-f3385c930615 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:24.271975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4714554c-0cd8-4fb9-9af0-f3385c930615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:24.313463 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:24.329805 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1081/2131] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:42:24.338545 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe34d2-1abc-4e65-aac2-8060af071c53 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:24.338767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe34d2-1abc-4e65-aac2-8060af071c53 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:24.339044 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe34d2-1abc-4e65-aac2-8060af071c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:24.357185 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d6fe34d2-1abc-4e65-aac2-8060af071c53 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:24.358362 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d6fe34d2-1abc-4e65-aac2-8060af071c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:24.366211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1051/2132] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:42:24.370293 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714554c-0cd8-4fb9-9af0-f3385c930615 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:24.380461 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714554c-0cd8-4fb9-9af0-f3385c930615 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:24.385034 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a61d4-6f9d-431a-a2f3-14cb366808cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:24.385689 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a61d4-6f9d-431a-a2f3-14cb366808cc admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:24.385963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a61d4-6f9d-431a-a2f3-14cb366808cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:24.386242 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a61d4-6f9d-431a-a2f3-14cb366808cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:24.386961 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a61d4-6f9d-431a-a2f3-14cb366808cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:42:24.387272 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a61d4-6f9d-431a-a2f3-14cb366808cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:24.388915 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a61d4-6f9d-431a-a2f3-14cb366808cc admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:24.401184 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1082/2133] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:42:24.405424 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe34d2-1abc-4e65-aac2-8060af071c53 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:24.414617 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe34d2-1abc-4e65-aac2-8060af071c53 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:24.419284 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c75d98-4fbc-407a-857d-1d10b3e2e227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:24.419922 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c75d98-4fbc-407a-857d-1d10b3e2e227 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:24.420207 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c75d98-4fbc-407a-857d-1d10b3e2e227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:24.420484 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c75d98-4fbc-407a-857d-1d10b3e2e227 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:24.421195 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c75d98-4fbc-407a-857d-1d10b3e2e227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:24.423105 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c75d98-4fbc-407a-857d-1d10b3e2e227 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:24.449704 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1052/2134] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:42:24 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:42:24.453839 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a61d4-6f9d-431a-a2f3-14cb366808cc admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:24.464288 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a61d4-6f9d-431a-a2f3-14cb366808cc admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:24.519953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968a289-3398-42ed-a9a3-1f465573fe9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:24.520637 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968a289-3398-42ed-a9a3-1f465573fe9c admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:24.520917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968a289-3398-42ed-a9a3-1f465573fe9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:24.521188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968a289-3398-42ed-a9a3-1f465573fe9c admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:24.521855 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968a289-3398-42ed-a9a3-1f465573fe9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:24.523759 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968a289-3398-42ed-a9a3-1f465573fe9c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:24.542779 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1083/2135] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:42:24 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:42:24.546872 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c75d98-4fbc-407a-857d-1d10b3e2e227 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:24.557892 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c75d98-4fbc-407a-857d-1d10b3e2e227 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:24.562771 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58192c-2027-4136-8130-11ec80ed5b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:24.563423 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58192c-2027-4136-8130-11ec80ed5b1d admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:24.563712 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58192c-2027-4136-8130-11ec80ed5b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:24.563992 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58192c-2027-4136-8130-11ec80ed5b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:24.564821 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58192c-2027-4136-8130-11ec80ed5b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:24.567051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58192c-2027-4136-8130-11ec80ed5b1d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:24.577389 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1053/2136] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:42:24.581456 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968a289-3398-42ed-a9a3-1f465573fe9c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:24.591154 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968a289-3398-42ed-a9a3-1f465573fe9c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:24.595737 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9037d-c463-47a7-ad90-f42ce8f9bcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:24.596418 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9037d-c463-47a7-ad90-f42ce8f9bcf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:24.596727 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9037d-c463-47a7-ad90-f42ce8f9bcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:24.597001 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9037d-c463-47a7-ad90-f42ce8f9bcf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:24.597712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9037d-c463-47a7-ad90-f42ce8f9bcf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:24.599277 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9037d-c463-47a7-ad90-f42ce8f9bcf2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:24.609195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1084/2137] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:42:24.613640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58192c-2027-4136-8130-11ec80ed5b1d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:24.623564 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58192c-2027-4136-8130-11ec80ed5b1d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:24.628774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565ee1b-67d5-43a9-8fa3-26fa07cd5f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:24.629631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565ee1b-67d5-43a9-8fa3-26fa07cd5f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:24.629913 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565ee1b-67d5-43a9-8fa3-26fa07cd5f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:24.630191 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565ee1b-67d5-43a9-8fa3-26fa07cd5f32 admin admin] PATH_INFO: `/v3/projects/7b8b2c4c87f74ba49bd59d96908f0f2c/users/0e1a4f561fd8492bbf82c97c3ec85cad/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:24.644321 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565ee1b-67d5-43a9-8fa3-26fa07cd5f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b8b2c4c87f74ba49bd59d96908f0f2c, user_id=0e1a4f561fd8492bbf82c97c3ec85cad, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:24.647046 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565ee1b-67d5-43a9-8fa3-26fa07cd5f32 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:24.659660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1054/2138] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:42:24 2022] PUT /identity/v3/projects/7b8b2c4c87f74ba49bd59d96908f0f2c/users/0e1a4f561fd8492bbf82c97c3ec85cad/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:42:24.669892 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87d87d-0bf4-44a7-ada6-70877fb5ef67 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:24.670180 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87d87d-0bf4-44a7-ada6-70877fb5ef67 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:24.670484 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87d87d-0bf4-44a7-ada6-70877fb5ef67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:24.697066 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-7b87d87d-0bf4-44a7-ada6-70877fb5ef67 None None] MFA Rules not processed for user `0e1a4f561fd8492bbf82c97c3ec85cad`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:24.698240 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7b87d87d-0bf4-44a7-ada6-70877fb5ef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:24.759788 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1085/2139] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:42:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:42:24.770878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565ee1b-67d5-43a9-8fa3-26fa07cd5f32 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:24.772638 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2565ee1b-67d5-43a9-8fa3-26fa07cd5f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:24.782257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:24.830651 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565ee1b-67d5-43a9-8fa3-26fa07cd5f32 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:24.834263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd944a-02a2-44b9-b7da-22f6bd92738a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2522b8560d224aa1a973207a79ce6a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:24.834891 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd944a-02a2-44b9-b7da-22f6bd92738a service glance] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:24.835176 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd944a-02a2-44b9-b7da-22f6bd92738a service glance] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:24.835452 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd944a-02a2-44b9-b7da-22f6bd92738a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:24.843553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd944a-02a2-44b9-b7da-22f6bd92738a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:24.845021 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd944a-02a2-44b9-b7da-22f6bd92738a service glance] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:24.853776 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1055/2140] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:42:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:42:34.756913 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=77,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:34.849709 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=23 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:38.973812 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f5968-a41b-4cc2-a581-8d4846c3b3be None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:38.974254 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f5968-a41b-4cc2-a581-8d4846c3b3be None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:38.974373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f5968-a41b-4cc2-a581-8d4846c3b3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:39.002731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-956f5968-a41b-4cc2-a581-8d4846c3b3be None None] MFA Rules not processed for user `a2bd48e6390241448fe2cf098ab64df3`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:39.003942 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-956f5968-a41b-4cc2-a581-8d4846c3b3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:39.078481 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1086/2141] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 30 10:42:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:42:39.121381 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd944a-02a2-44b9-b7da-22f6bd92738a service glance] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:39.122790 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e4fd944a-02a2-44b9-b7da-22f6bd92738a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:39.233629 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd944a-02a2-44b9-b7da-22f6bd92738a service glance] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:39.238727 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6cbd6-902b-4b24-b225-8abd9926ec90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c15327c36c8c49ac87a3b3e9ab49eea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:39.239596 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6cbd6-902b-4b24-b225-8abd9926ec90 service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:39.240027 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6cbd6-902b-4b24-b225-8abd9926ec90 service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:39.240848 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6cbd6-902b-4b24-b225-8abd9926ec90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:39.249591 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6cbd6-902b-4b24-b225-8abd9926ec90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:39.252385 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6cbd6-902b-4b24-b225-8abd9926ec90 service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:39.266757 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1056/2142] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 30 10:42:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:42:44.224398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f5968-a41b-4cc2-a581-8d4846c3b3be None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:44.226421 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-956f5968-a41b-4cc2-a581-8d4846c3b3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:44.353381 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f5968-a41b-4cc2-a581-8d4846c3b3be None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:44.361383 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0adc410-d31a-454f-b604-4e3fd373ed25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:44.362691 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adc410-d31a-454f-b604-4e3fd373ed25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:44.363327 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adc410-d31a-454f-b604-4e3fd373ed25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:44.363759 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adc410-d31a-454f-b604-4e3fd373ed25 admin admin] PATH_INFO: `/v3/users/2b2609031db4421bb6311065138b25b3` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:44.365346 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0adc410-d31a-454f-b604-4e3fd373ed25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b2609031db4421bb6311065138b25b3)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:44.367894 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0adc410-d31a-454f-b604-4e3fd373ed25 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:44.442464 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e0adc410-d31a-454f-b604-4e3fd373ed25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b2609031db4421bb6311065138b25b3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:44.445038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:44.451040 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e0adc410-d31a-454f-b604-4e3fd373ed25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b2609031db4421bb6311065138b25b3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:44.451993 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e0adc410-d31a-454f-b604-4e3fd373ed25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b2609031db4421bb6311065138b25b3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:44.461610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e0adc410-d31a-454f-b604-4e3fd373ed25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b2609031db4421bb6311065138b25b3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:44.461610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e0adc410-d31a-454f-b604-4e3fd373ed25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b2609031db4421bb6311065138b25b3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:44.488854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1087/2143] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:42:44 2022] DELETE /identity/v3/users/2b2609031db4421bb6311065138b25b3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:42:44.493596 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301e327-15f8-46af-b1f6-b376a76dc59b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:44.494219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301e327-15f8-46af-b1f6-b376a76dc59b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:44.494469 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301e327-15f8-46af-b1f6-b376a76dc59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:44.538045 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4301e327-15f8-46af-b1f6-b376a76dc59b None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:44.539333 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4301e327-15f8-46af-b1f6-b376a76dc59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:44.620726 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1057/2144] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:42:44.631010 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0adc410-d31a-454f-b604-4e3fd373ed25 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:44.632800 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e0adc410-d31a-454f-b604-4e3fd373ed25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:44.742307 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0adc410-d31a-454f-b604-4e3fd373ed25 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:44.746321 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43cf7f-ee2e-4ef0-b7a8-24942be439fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:44.747132 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43cf7f-ee2e-4ef0-b7a8-24942be439fd service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:44.747502 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43cf7f-ee2e-4ef0-b7a8-24942be439fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:44.747795 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43cf7f-ee2e-4ef0-b7a8-24942be439fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:44.759957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43cf7f-ee2e-4ef0-b7a8-24942be439fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:44.761754 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43cf7f-ee2e-4ef0-b7a8-24942be439fd service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:44.774561 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1088/2145] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:42:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:42:45.395037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301e327-15f8-46af-b1f6-b376a76dc59b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:45.397550 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4301e327-15f8-46af-b1f6-b376a76dc59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:45.414110 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301e327-15f8-46af-b1f6-b376a76dc59b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:45.420061 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eed8c9-b052-44ee-a39a-183e5f082bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:45.421418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eed8c9-b052-44ee-a39a-183e5f082bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:45.421712 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eed8c9-b052-44ee-a39a-183e5f082bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:45.422121 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eed8c9-b052-44ee-a39a-183e5f082bea admin admin] PATH_INFO: `/v3/projects/66ee626eceec40e5b38901629c0de5e1` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:45.424124 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eed8c9-b052-44ee-a39a-183e5f082bea admin admin] RBAC: Authorizing `identity:delete_project(project_id=66ee626eceec40e5b38901629c0de5e1)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:45.427600 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eed8c9-b052-44ee-a39a-183e5f082bea admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:45.485422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:45.487106 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-39eed8c9-b052-44ee-a39a-183e5f082bea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66ee626eceec40e5b38901629c0de5e1', 'request_id': 'req-39eed8c9-b052-44ee-a39a-183e5f082bea'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:45.496212 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-39eed8c9-b052-44ee-a39a-183e5f082bea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66ee626eceec40e5b38901629c0de5e1', 'request_id': 'req-39eed8c9-b052-44ee-a39a-183e5f082bea'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:45.504815 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-39eed8c9-b052-44ee-a39a-183e5f082bea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66ee626eceec40e5b38901629c0de5e1', 'request_id': 'req-39eed8c9-b052-44ee-a39a-183e5f082bea'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:45.522183 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-39eed8c9-b052-44ee-a39a-183e5f082bea admin admin] The token cache is being invalidate because project 66ee626eceec40e5b38901629c0de5e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:42:45.522475 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-39eed8c9-b052-44ee-a39a-183e5f082bea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:45.523145 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-39eed8c9-b052-44ee-a39a-183e5f082bea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:42:45.524825 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1058/2146] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:42:45 2022] DELETE /identity/v3/projects/66ee626eceec40e5b38901629c0de5e1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:42:45.530315 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f7352-d635-4380-be30-7549bf196faf None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:45.531087 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f7352-d635-4380-be30-7549bf196faf None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:45.531485 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f7352-d635-4380-be30-7549bf196faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:45.574416 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-fa6f7352-d635-4380-be30-7549bf196faf None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:45.575740 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-fa6f7352-d635-4380-be30-7549bf196faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:45.652615 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1089/2147] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:42:45.657098 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff9a4d-2c65-490a-b356-de90a485ec74 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:45.657608 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff9a4d-2c65-490a-b356-de90a485ec74 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:45.657995 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff9a4d-2c65-490a-b356-de90a485ec74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:45.677930 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-84ff9a4d-2c65-490a-b356-de90a485ec74 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:45.679689 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-84ff9a4d-2c65-490a-b356-de90a485ec74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:45.691582 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1059/2148] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:42:45.692473 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f7352-d635-4380-be30-7549bf196faf None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:45.702402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f7352-d635-4380-be30-7549bf196faf None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:45.709332 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756749d-ea73-43a1-af4c-fdec31aba232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:45.710011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756749d-ea73-43a1-af4c-fdec31aba232 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:45.710291 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756749d-ea73-43a1-af4c-fdec31aba232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:45.710569 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756749d-ea73-43a1-af4c-fdec31aba232 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:45.711342 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756749d-ea73-43a1-af4c-fdec31aba232 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:42:45.711645 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756749d-ea73-43a1-af4c-fdec31aba232 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:45.713318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756749d-ea73-43a1-af4c-fdec31aba232 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:45.738534 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1090/2149] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:42:45.742778 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff9a4d-2c65-490a-b356-de90a485ec74 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:45.752195 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff9a4d-2c65-490a-b356-de90a485ec74 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:45.757170 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aee30f-f167-4142-8593-76a8d33e3cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:45.757912 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aee30f-f167-4142-8593-76a8d33e3cde admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:45.758099 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aee30f-f167-4142-8593-76a8d33e3cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:45.758377 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aee30f-f167-4142-8593-76a8d33e3cde admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:45.768656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aee30f-f167-4142-8593-76a8d33e3cde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:45.768656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aee30f-f167-4142-8593-76a8d33e3cde admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:45.792110 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1060/2150] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:42:45 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:42:45.796533 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756749d-ea73-43a1-af4c-fdec31aba232 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:45.809255 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756749d-ea73-43a1-af4c-fdec31aba232 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:45.834481 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:45.879390 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fa598-7a26-466c-a942-1d8398a43377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:45.880149 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fa598-7a26-466c-a942-1d8398a43377 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:45.881073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fa598-7a26-466c-a942-1d8398a43377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:45.881417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fa598-7a26-466c-a942-1d8398a43377 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:45.882231 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fa598-7a26-466c-a942-1d8398a43377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:45.884408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fa598-7a26-466c-a942-1d8398a43377 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:45.906742 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1091/2151] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:42:45 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:42:45.910692 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aee30f-f167-4142-8593-76a8d33e3cde admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:45.922260 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aee30f-f167-4142-8593-76a8d33e3cde admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:45.927047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d916d54-8540-442f-8fa1-169396ae28cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:45.928293 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d916d54-8540-442f-8fa1-169396ae28cf admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:45.928842 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d916d54-8540-442f-8fa1-169396ae28cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:45.928948 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d916d54-8540-442f-8fa1-169396ae28cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:45.929629 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d916d54-8540-442f-8fa1-169396ae28cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:45.931268 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d916d54-8540-442f-8fa1-169396ae28cf admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:45.945317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1061/2152] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:42:45.946788 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fa598-7a26-466c-a942-1d8398a43377 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:45.957029 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fa598-7a26-466c-a942-1d8398a43377 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:45.962326 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987930d-045c-4d2f-ab4f-1319c546ea27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:45.962987 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987930d-045c-4d2f-ab4f-1319c546ea27 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:45.963271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987930d-045c-4d2f-ab4f-1319c546ea27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:45.963685 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987930d-045c-4d2f-ab4f-1319c546ea27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:45.964399 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987930d-045c-4d2f-ab4f-1319c546ea27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:45.966045 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987930d-045c-4d2f-ab4f-1319c546ea27 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:45.981235 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1092/2153] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:42:45.982767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d916d54-8540-442f-8fa1-169396ae28cf admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:45.994113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d916d54-8540-442f-8fa1-169396ae28cf admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:45.999037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552c015-32b6-437a-857f-860742f4b11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:45.999925 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552c015-32b6-437a-857f-860742f4b11a admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:46.000210 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552c015-32b6-437a-857f-860742f4b11a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:46.000899 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552c015-32b6-437a-857f-860742f4b11a admin admin] PATH_INFO: `/v3/projects/c1086b3da7ca49b08bf5a6b0e1b5b7b5/users/38a5e7b9a0f2493692077a15b3c059e5/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:46.015803 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552c015-32b6-437a-857f-860742f4b11a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1086b3da7ca49b08bf5a6b0e1b5b7b5, user_id=38a5e7b9a0f2493692077a15b3c059e5, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:46.018532 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552c015-32b6-437a-857f-860742f4b11a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:46.039184 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1062/2154] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:42:45 2022] PUT /identity/v3/projects/c1086b3da7ca49b08bf5a6b0e1b5b7b5/users/38a5e7b9a0f2493692077a15b3c059e5/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:42:46.050440 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d1b5f-9395-494b-b79f-931f06c87593 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:46.050736 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d1b5f-9395-494b-b79f-931f06c87593 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:46.051139 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d1b5f-9395-494b-b79f-931f06c87593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:46.097564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-789d1b5f-9395-494b-b79f-931f06c87593 None None] MFA Rules not processed for user `38a5e7b9a0f2493692077a15b3c059e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:42:46.098854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-789d1b5f-9395-494b-b79f-931f06c87593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:46.174259 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1093/2155] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:42:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:42:46.185514 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552c015-32b6-437a-857f-860742f4b11a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:42:46.187397 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1552c015-32b6-437a-857f-860742f4b11a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:42:46.253355 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552c015-32b6-437a-857f-860742f4b11a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:42:46.258460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7774c9-907a-4c42-84b4-18e1bdc434a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:42:46.259185 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7774c9-907a-4c42-84b4-18e1bdc434a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:42:46.262968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7774c9-907a-4c42-84b4-18e1bdc434a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:42:46.262968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7774c9-907a-4c42-84b4-18e1bdc434a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:42:46.273281 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7774c9-907a-4c42-84b4-18e1bdc434a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:42:46.275352 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7774c9-907a-4c42-84b4-18e1bdc434a5 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:42:46.285360 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1063/2156] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:42:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:42:56.171004 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=56,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:42:56.280387 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=60,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:04.508230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73b190-6317-4708-bf9e-a2857611fff7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:04.508729 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73b190-6317-4708-bf9e-a2857611fff7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:04.508828 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73b190-6317-4708-bf9e-a2857611fff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:04.538024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-3c73b190-6317-4708-bf9e-a2857611fff7 None None] MFA Rules not processed for user `a2bd48e6390241448fe2cf098ab64df3`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:04.539235 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3c73b190-6317-4708-bf9e-a2857611fff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:04.599528 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1094/2157] 10.222.0.59 () {58 vars in 967 bytes} [Thu Jun 30 10:43:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:04.612245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7774c9-907a-4c42-84b4-18e1bdc434a5 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:04.613685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9a7774c9-907a-4c42-84b4-18e1bdc434a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:04.681169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7774c9-907a-4c42-84b4-18e1bdc434a5 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:04.685988 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59de2a-d67d-433e-9c1f-513a2c1e3894 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c15327c36c8c49ac87a3b3e9ab49eea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:04.686616 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59de2a-d67d-433e-9c1f-513a2c1e3894 service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:04.686896 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59de2a-d67d-433e-9c1f-513a2c1e3894 service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:04.687170 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59de2a-d67d-433e-9c1f-513a2c1e3894 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:04.695504 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59de2a-d67d-433e-9c1f-513a2c1e3894 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:04.697134 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59de2a-d67d-433e-9c1f-513a2c1e3894 service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:04.704975 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1064/2158] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 30 10:43:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:43:14.592064 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=32 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:14.701799 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=32 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:16.432702 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73b190-6317-4708-bf9e-a2857611fff7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:16.434646 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3c73b190-6317-4708-bf9e-a2857611fff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:16.542820 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73b190-6317-4708-bf9e-a2857611fff7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:16.548786 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd72cb-91f9-4339-a476-3dd518d2b1e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48709a771ab64ed38018873313f37c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:16.549586 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd72cb-91f9-4339-a476-3dd518d2b1e5 service placement] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:16.550060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd72cb-91f9-4339-a476-3dd518d2b1e5 service placement] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:16.550298 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd72cb-91f9-4339-a476-3dd518d2b1e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:16.553066 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-79dd72cb-91f9-4339-a476-3dd518d2b1e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:16.566663 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd72cb-91f9-4339-a476-3dd518d2b1e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:16.570610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd72cb-91f9-4339-a476-3dd518d2b1e5 service placement] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:16.581070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1095/2159] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:43:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:43:18.185961 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59de2a-d67d-433e-9c1f-513a2c1e3894 service swift] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:18.187936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fa59de2a-d67d-433e-9c1f-513a2c1e3894 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:18.259210 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59de2a-d67d-433e-9c1f-513a2c1e3894 service swift] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:18.263759 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504b625-af3d-4ff7-9403-84c199c339d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:18.264644 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504b625-af3d-4ff7-9403-84c199c339d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:18.264927 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504b625-af3d-4ff7-9403-84c199c339d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:18.265204 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504b625-af3d-4ff7-9403-84c199c339d4 admin admin] PATH_INFO: `/v3/users/f5c0ccbf16fe4a399945aa5ad34754b5` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:18.266389 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504b625-af3d-4ff7-9403-84c199c339d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5c0ccbf16fe4a399945aa5ad34754b5)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:18.268291 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504b625-af3d-4ff7-9403-84c199c339d4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:18.315452 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2504b625-af3d-4ff7-9403-84c199c339d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5c0ccbf16fe4a399945aa5ad34754b5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:18.316129 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2504b625-af3d-4ff7-9403-84c199c339d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5c0ccbf16fe4a399945aa5ad34754b5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:18.323725 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2504b625-af3d-4ff7-9403-84c199c339d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5c0ccbf16fe4a399945aa5ad34754b5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:18.324421 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2504b625-af3d-4ff7-9403-84c199c339d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5c0ccbf16fe4a399945aa5ad34754b5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:18.331500 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2504b625-af3d-4ff7-9403-84c199c339d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5c0ccbf16fe4a399945aa5ad34754b5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:18.349325 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1065/2160] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:43:18 2022] DELETE /identity/v3/users/f5c0ccbf16fe4a399945aa5ad34754b5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:43:18.535971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd72cb-91f9-4339-a476-3dd518d2b1e5 service placement] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:18.548861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd72cb-91f9-4339-a476-3dd518d2b1e5 service placement] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:18.609250 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9a152-c3c2-45ab-a058-b23c399f8575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:18.610161 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9a152-c3c2-45ab-a058-b23c399f8575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:18.610482 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9a152-c3c2-45ab-a058-b23c399f8575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:18.610763 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9a152-c3c2-45ab-a058-b23c399f8575 admin admin] PATH_INFO: `/v3/projects/d60ed6f6064a4cd88a03cf97ab7abeae` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:18.611988 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9a152-c3c2-45ab-a058-b23c399f8575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d60ed6f6064a4cd88a03cf97ab7abeae)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:18.614016 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9a152-c3c2-45ab-a058-b23c399f8575 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:18.661184 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8df9a152-c3c2-45ab-a058-b23c399f8575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'request_id': 'req-8df9a152-c3c2-45ab-a058-b23c399f8575'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:18.668215 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8df9a152-c3c2-45ab-a058-b23c399f8575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'request_id': 'req-8df9a152-c3c2-45ab-a058-b23c399f8575'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:18.674287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8df9a152-c3c2-45ab-a058-b23c399f8575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd60ed6f6064a4cd88a03cf97ab7abeae', 'request_id': 'req-8df9a152-c3c2-45ab-a058-b23c399f8575'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:18.681522 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:18.685583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8df9a152-c3c2-45ab-a058-b23c399f8575 admin admin] The token cache is being invalidate because project d60ed6f6064a4cd88a03cf97ab7abeae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:43:18.685873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8df9a152-c3c2-45ab-a058-b23c399f8575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:18.686543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8df9a152-c3c2-45ab-a058-b23c399f8575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:18.688247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1096/2161] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:43:18 2022] DELETE /identity/v3/projects/d60ed6f6064a4cd88a03cf97ab7abeae => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:43:18.694196 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac94161-5ca9-4383-b1bb-b2ced6a1bb6d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:18.694486 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac94161-5ca9-4383-b1bb-b2ced6a1bb6d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:18.694764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac94161-5ca9-4383-b1bb-b2ced6a1bb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:18.723078 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-dac94161-5ca9-4383-b1bb-b2ced6a1bb6d None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:18.724199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dac94161-5ca9-4383-b1bb-b2ced6a1bb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:18.785096 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1066/2162] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:18.792773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f44170-67c2-4b55-89e9-e091c0b3d868 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:18.793065 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f44170-67c2-4b55-89e9-e091c0b3d868 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:18.793343 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f44170-67c2-4b55-89e9-e091c0b3d868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:18.812286 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-02f44170-67c2-4b55-89e9-e091c0b3d868 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:18.813530 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-02f44170-67c2-4b55-89e9-e091c0b3d868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:18.822178 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1097/2163] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:18.826281 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac94161-5ca9-4383-b1bb-b2ced6a1bb6d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:18.835923 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac94161-5ca9-4383-b1bb-b2ced6a1bb6d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:18.841146 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037570b0-ad0f-4afa-947d-40790f87f13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:18.841783 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037570b0-ad0f-4afa-947d-40790f87f13f admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:18.842075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037570b0-ad0f-4afa-947d-40790f87f13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:18.842337 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037570b0-ad0f-4afa-947d-40790f87f13f admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:18.843047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037570b0-ad0f-4afa-947d-40790f87f13f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:43:18.843352 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037570b0-ad0f-4afa-947d-40790f87f13f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:18.844982 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037570b0-ad0f-4afa-947d-40790f87f13f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:18.852073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:18.859189 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1067/2164] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:43:18.863000 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f44170-67c2-4b55-89e9-e091c0b3d868 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:18.872773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f44170-67c2-4b55-89e9-e091c0b3d868 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:18.877411 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048742ba-e1fd-405c-ab92-8ef357a1fe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:18.878073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048742ba-e1fd-405c-ab92-8ef357a1fe3d admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:18.878359 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048742ba-e1fd-405c-ab92-8ef357a1fe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:18.878631 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048742ba-e1fd-405c-ab92-8ef357a1fe3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:18.879322 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048742ba-e1fd-405c-ab92-8ef357a1fe3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:18.881277 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048742ba-e1fd-405c-ab92-8ef357a1fe3d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:18.906325 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1098/2165] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:43:18 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:43:18.912622 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037570b0-ad0f-4afa-947d-40790f87f13f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:18.922385 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037570b0-ad0f-4afa-947d-40790f87f13f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:18.980989 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578ac6a-c62c-4fa0-a2cd-b47d62537185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:18.981600 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578ac6a-c62c-4fa0-a2cd-b47d62537185 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:18.981888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578ac6a-c62c-4fa0-a2cd-b47d62537185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:18.982170 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578ac6a-c62c-4fa0-a2cd-b47d62537185 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:18.982849 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578ac6a-c62c-4fa0-a2cd-b47d62537185 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:18.984833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578ac6a-c62c-4fa0-a2cd-b47d62537185 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:19.004822 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1068/2166] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:43:18 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:43:19.008907 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048742ba-e1fd-405c-ab92-8ef357a1fe3d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:19.019110 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048742ba-e1fd-405c-ab92-8ef357a1fe3d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:19.023701 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c40089-8bde-4f3a-b42d-07991d0df5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:19.024352 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c40089-8bde-4f3a-b42d-07991d0df5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:19.024673 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c40089-8bde-4f3a-b42d-07991d0df5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:19.024955 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c40089-8bde-4f3a-b42d-07991d0df5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:19.025705 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c40089-8bde-4f3a-b42d-07991d0df5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:19.027318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c40089-8bde-4f3a-b42d-07991d0df5f7 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:19.038000 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1099/2167] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:43:19.041840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578ac6a-c62c-4fa0-a2cd-b47d62537185 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:19.051570 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578ac6a-c62c-4fa0-a2cd-b47d62537185 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:19.057161 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198c3d9-b1e8-4d64-86fe-99dd252070fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:19.057816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198c3d9-b1e8-4d64-86fe-99dd252070fd admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:19.058103 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198c3d9-b1e8-4d64-86fe-99dd252070fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:19.058692 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198c3d9-b1e8-4d64-86fe-99dd252070fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:19.059107 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198c3d9-b1e8-4d64-86fe-99dd252070fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:19.061315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198c3d9-b1e8-4d64-86fe-99dd252070fd admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:19.072174 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1069/2168] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:43:19.076387 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c40089-8bde-4f3a-b42d-07991d0df5f7 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:19.086210 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c40089-8bde-4f3a-b42d-07991d0df5f7 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:19.090788 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475c720-b40b-4c22-8dac-d9fc33dde331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:19.091652 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475c720-b40b-4c22-8dac-d9fc33dde331 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:19.091946 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475c720-b40b-4c22-8dac-d9fc33dde331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:19.092206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475c720-b40b-4c22-8dac-d9fc33dde331 admin admin] PATH_INFO: `/v3/projects/e28fbc37e2b14b33a57326a3e5479116/users/716ffb4a5c674d28a595ac3a75a1f993/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:19.108962 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475c720-b40b-4c22-8dac-d9fc33dde331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e28fbc37e2b14b33a57326a3e5479116, user_id=716ffb4a5c674d28a595ac3a75a1f993, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:19.111698 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475c720-b40b-4c22-8dac-d9fc33dde331 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:19.125651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1100/2169] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:43:19 2022] PUT /identity/v3/projects/e28fbc37e2b14b33a57326a3e5479116/users/716ffb4a5c674d28a595ac3a75a1f993/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:43:19.135129 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bfcfe-022f-4ee8-8304-9d06b599be2c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:19.135422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bfcfe-022f-4ee8-8304-9d06b599be2c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:19.135702 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bfcfe-022f-4ee8-8304-9d06b599be2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:19.161189 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ff4bfcfe-022f-4ee8-8304-9d06b599be2c None None] MFA Rules not processed for user `716ffb4a5c674d28a595ac3a75a1f993`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:19.162911 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ff4bfcfe-022f-4ee8-8304-9d06b599be2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:19.226401 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1070/2170] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:43:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:19.237537 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475c720-b40b-4c22-8dac-d9fc33dde331 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:19.239217 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-5475c720-b40b-4c22-8dac-d9fc33dde331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:19.316596 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475c720-b40b-4c22-8dac-d9fc33dde331 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:19.320880 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54ec6f-5633-42d1-ac71-aa28db7ac6da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:19.321550 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54ec6f-5633-42d1-ac71-aa28db7ac6da service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:19.321835 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54ec6f-5633-42d1-ac71-aa28db7ac6da service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:19.322114 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54ec6f-5633-42d1-ac71-aa28db7ac6da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:19.330305 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54ec6f-5633-42d1-ac71-aa28db7ac6da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:19.331726 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54ec6f-5633-42d1-ac71-aa28db7ac6da service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:19.340773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1101/2171] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:43:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:43:19.366113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bfcfe-022f-4ee8-8304-9d06b599be2c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:19.426312 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bfcfe-022f-4ee8-8304-9d06b599be2c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:19.431374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271974c-985b-4087-ae20-27bc8e31dad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:19.432221 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271974c-985b-4087-ae20-27bc8e31dad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:19.432522 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271974c-985b-4087-ae20-27bc8e31dad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:19.432820 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271974c-985b-4087-ae20-27bc8e31dad5 admin admin] PATH_INFO: `/v3/users/716ffb4a5c674d28a595ac3a75a1f993` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:19.434002 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c271974c-985b-4087-ae20-27bc8e31dad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=716ffb4a5c674d28a595ac3a75a1f993)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:19.435930 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c271974c-985b-4087-ae20-27bc8e31dad5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:19.441163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:19.482317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c271974c-985b-4087-ae20-27bc8e31dad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '716ffb4a5c674d28a595ac3a75a1f993'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:19.482911 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c271974c-985b-4087-ae20-27bc8e31dad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '716ffb4a5c674d28a595ac3a75a1f993'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:19.490354 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c271974c-985b-4087-ae20-27bc8e31dad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '716ffb4a5c674d28a595ac3a75a1f993'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:19.490976 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c271974c-985b-4087-ae20-27bc8e31dad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '716ffb4a5c674d28a595ac3a75a1f993'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:19.498386 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c271974c-985b-4087-ae20-27bc8e31dad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '716ffb4a5c674d28a595ac3a75a1f993'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:19.517429 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1071/2172] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:43:19 2022] DELETE /identity/v3/users/716ffb4a5c674d28a595ac3a75a1f993 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:43:19.522025 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0161db2-5ec2-4e2e-b38b-4b580060e930 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:19.522345 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0161db2-5ec2-4e2e-b38b-4b580060e930 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:19.522624 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0161db2-5ec2-4e2e-b38b-4b580060e930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:19.539774 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b0161db2-5ec2-4e2e-b38b-4b580060e930 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:19.541006 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b0161db2-5ec2-4e2e-b38b-4b580060e930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:19.598278 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1102/2173] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:19.608398 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271974c-985b-4087-ae20-27bc8e31dad5 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:19.609829 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c271974c-985b-4087-ae20-27bc8e31dad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:19.667493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271974c-985b-4087-ae20-27bc8e31dad5 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:19.671341 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748008a9-eb87-494a-83dd-19f67c954ca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:19.671984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748008a9-eb87-494a-83dd-19f67c954ca8 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:19.672435 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748008a9-eb87-494a-83dd-19f67c954ca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:19.672746 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748008a9-eb87-494a-83dd-19f67c954ca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:19.682671 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748008a9-eb87-494a-83dd-19f67c954ca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:19.684144 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748008a9-eb87-494a-83dd-19f67c954ca8 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:19.694366 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1072/2174] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:43:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:43:19.970699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0161db2-5ec2-4e2e-b38b-4b580060e930 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:19.972306 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b0161db2-5ec2-4e2e-b38b-4b580060e930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:19.992455 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0161db2-5ec2-4e2e-b38b-4b580060e930 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:19.998067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f762d59-82bf-4e8d-adc1-d2fe468acce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:20.003923 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f762d59-82bf-4e8d-adc1-d2fe468acce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:20.004226 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f762d59-82bf-4e8d-adc1-d2fe468acce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:20.004578 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f762d59-82bf-4e8d-adc1-d2fe468acce0 admin admin] PATH_INFO: `/v3/projects/e28fbc37e2b14b33a57326a3e5479116` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:20.006039 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f762d59-82bf-4e8d-adc1-d2fe468acce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e28fbc37e2b14b33a57326a3e5479116)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:20.008660 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f762d59-82bf-4e8d-adc1-d2fe468acce0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:20.025768 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:20.057072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6f762d59-82bf-4e8d-adc1-d2fe468acce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e28fbc37e2b14b33a57326a3e5479116', 'request_id': 'req-6f762d59-82bf-4e8d-adc1-d2fe468acce0'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:20.064131 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6f762d59-82bf-4e8d-adc1-d2fe468acce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e28fbc37e2b14b33a57326a3e5479116', 'request_id': 'req-6f762d59-82bf-4e8d-adc1-d2fe468acce0'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:20.070944 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6f762d59-82bf-4e8d-adc1-d2fe468acce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e28fbc37e2b14b33a57326a3e5479116', 'request_id': 'req-6f762d59-82bf-4e8d-adc1-d2fe468acce0'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:20.081309 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6f762d59-82bf-4e8d-adc1-d2fe468acce0 admin admin] The token cache is being invalidate because project e28fbc37e2b14b33a57326a3e5479116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:43:20.081600 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6f762d59-82bf-4e8d-adc1-d2fe468acce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:20.082223 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6f762d59-82bf-4e8d-adc1-d2fe468acce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:20.083745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1103/2175] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:43:19 2022] DELETE /identity/v3/projects/e28fbc37e2b14b33a57326a3e5479116 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:43:29.403755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748008a9-eb87-494a-83dd-19f67c954ca8 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:29.405186 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-748008a9-eb87-494a-83dd-19f67c954ca8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:29.418162 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748008a9-eb87-494a-83dd-19f67c954ca8 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:29.477651 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90995630-0ee7-41d2-8db3-b9e7bdc9cef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:29.478649 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90995630-0ee7-41d2-8db3-b9e7bdc9cef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:29.478864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90995630-0ee7-41d2-8db3-b9e7bdc9cef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:29.479164 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90995630-0ee7-41d2-8db3-b9e7bdc9cef0 admin admin] PATH_INFO: `/v3/users/38a5e7b9a0f2493692077a15b3c059e5` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:29.480461 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90995630-0ee7-41d2-8db3-b9e7bdc9cef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a5e7b9a0f2493692077a15b3c059e5)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:29.482733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90995630-0ee7-41d2-8db3-b9e7bdc9cef0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:29.518372 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:29.534736 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-90995630-0ee7-41d2-8db3-b9e7bdc9cef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a5e7b9a0f2493692077a15b3c059e5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:29.535503 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-90995630-0ee7-41d2-8db3-b9e7bdc9cef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a5e7b9a0f2493692077a15b3c059e5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:29.543278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-90995630-0ee7-41d2-8db3-b9e7bdc9cef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a5e7b9a0f2493692077a15b3c059e5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:29.543932 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-90995630-0ee7-41d2-8db3-b9e7bdc9cef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a5e7b9a0f2493692077a15b3c059e5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:29.550693 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-90995630-0ee7-41d2-8db3-b9e7bdc9cef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a5e7b9a0f2493692077a15b3c059e5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:29.569114 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1073/2176] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:43:29 2022] DELETE /identity/v3/users/38a5e7b9a0f2493692077a15b3c059e5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:43:29.573526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5cf0c-6629-4bbd-8e7e-b1d68535cd50 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:29.574017 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5cf0c-6629-4bbd-8e7e-b1d68535cd50 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:29.574282 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5cf0c-6629-4bbd-8e7e-b1d68535cd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:29.591996 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-fbb5cf0c-6629-4bbd-8e7e-b1d68535cd50 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:29.593232 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-fbb5cf0c-6629-4bbd-8e7e-b1d68535cd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:29.651968 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1104/2177] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:29.661402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90995630-0ee7-41d2-8db3-b9e7bdc9cef0 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:29.663339 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-90995630-0ee7-41d2-8db3-b9e7bdc9cef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:29.719538 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90995630-0ee7-41d2-8db3-b9e7bdc9cef0 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:29.723127 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85592c4-446e-437c-bd10-cf406ca6539e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:29.723752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85592c4-446e-437c-bd10-cf406ca6539e service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:29.724031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85592c4-446e-437c-bd10-cf406ca6539e service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:29.724302 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85592c4-446e-437c-bd10-cf406ca6539e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:29.734146 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85592c4-446e-437c-bd10-cf406ca6539e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:29.735575 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85592c4-446e-437c-bd10-cf406ca6539e service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:29.745132 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1074/2178] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:43:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:43:29.753415 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5cf0c-6629-4bbd-8e7e-b1d68535cd50 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:29.754859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-fbb5cf0c-6629-4bbd-8e7e-b1d68535cd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:29.766636 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5cf0c-6629-4bbd-8e7e-b1d68535cd50 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:29.771330 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1794aac-2b19-4462-9923-98584da7808a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:29.772672 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1794aac-2b19-4462-9923-98584da7808a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:29.772962 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1794aac-2b19-4462-9923-98584da7808a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:29.773241 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1794aac-2b19-4462-9923-98584da7808a admin admin] PATH_INFO: `/v3/users/0e1a4f561fd8492bbf82c97c3ec85cad` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:29.774450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1794aac-2b19-4462-9923-98584da7808a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e1a4f561fd8492bbf82c97c3ec85cad)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:29.776373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1794aac-2b19-4462-9923-98584da7808a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:29.826970 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d1794aac-2b19-4462-9923-98584da7808a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e1a4f561fd8492bbf82c97c3ec85cad'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:29.840076 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d1794aac-2b19-4462-9923-98584da7808a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e1a4f561fd8492bbf82c97c3ec85cad'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:29.840888 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d1794aac-2b19-4462-9923-98584da7808a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e1a4f561fd8492bbf82c97c3ec85cad'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:29.850433 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d1794aac-2b19-4462-9923-98584da7808a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e1a4f561fd8492bbf82c97c3ec85cad'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:29.851275 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d1794aac-2b19-4462-9923-98584da7808a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e1a4f561fd8492bbf82c97c3ec85cad'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:29.864674 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1105/2179] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:43:29 2022] DELETE /identity/v3/users/0e1a4f561fd8492bbf82c97c3ec85cad => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:43:29.869186 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d6703-9751-4a5b-8fe0-77f1f0c2a167 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:29.869551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d6703-9751-4a5b-8fe0-77f1f0c2a167 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:29.869928 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d6703-9751-4a5b-8fe0-77f1f0c2a167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:29.887322 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-730d6703-9751-4a5b-8fe0-77f1f0c2a167 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:29.888598 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-730d6703-9751-4a5b-8fe0-77f1f0c2a167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:29.953786 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1075/2180] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:29.964024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1794aac-2b19-4462-9923-98584da7808a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:29.965470 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d1794aac-2b19-4462-9923-98584da7808a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:29.984742 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:30.025489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d6703-9751-4a5b-8fe0-77f1f0c2a167 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:30.027196 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-730d6703-9751-4a5b-8fe0-77f1f0c2a167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:30.030928 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1794aac-2b19-4462-9923-98584da7808a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:30.035946 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c2ddb-bada-47cd-b85f-def8a4140b74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:30.036642 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c2ddb-bada-47cd-b85f-def8a4140b74 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:30.036925 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c2ddb-bada-47cd-b85f-def8a4140b74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:30.037760 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c2ddb-bada-47cd-b85f-def8a4140b74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:30.047580 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c2ddb-bada-47cd-b85f-def8a4140b74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:30.049088 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c2ddb-bada-47cd-b85f-def8a4140b74 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:30.051496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d6703-9751-4a5b-8fe0-77f1f0c2a167 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:30.056927 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce13738-926d-4c70-87b9-401bcf8f080f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:30.057825 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce13738-926d-4c70-87b9-401bcf8f080f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:30.058033 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce13738-926d-4c70-87b9-401bcf8f080f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:30.058418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce13738-926d-4c70-87b9-401bcf8f080f admin admin] PATH_INFO: `/v3/projects/c1086b3da7ca49b08bf5a6b0e1b5b7b5` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:30.059435 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1106/2181] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:43:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:43:30.059552 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce13738-926d-4c70-87b9-401bcf8f080f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1086b3da7ca49b08bf5a6b0e1b5b7b5)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:30.061658 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce13738-926d-4c70-87b9-401bcf8f080f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:30.112027 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:30.115808 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fce13738-926d-4c70-87b9-401bcf8f080f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1086b3da7ca49b08bf5a6b0e1b5b7b5', 'request_id': 'req-fce13738-926d-4c70-87b9-401bcf8f080f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:30.126562 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fce13738-926d-4c70-87b9-401bcf8f080f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1086b3da7ca49b08bf5a6b0e1b5b7b5', 'request_id': 'req-fce13738-926d-4c70-87b9-401bcf8f080f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:30.134387 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fce13738-926d-4c70-87b9-401bcf8f080f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1086b3da7ca49b08bf5a6b0e1b5b7b5', 'request_id': 'req-fce13738-926d-4c70-87b9-401bcf8f080f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:30.149666 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fce13738-926d-4c70-87b9-401bcf8f080f admin admin] The token cache is being invalidate because project c1086b3da7ca49b08bf5a6b0e1b5b7b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:43:30.149974 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fce13738-926d-4c70-87b9-401bcf8f080f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:30.150633 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fce13738-926d-4c70-87b9-401bcf8f080f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:30.153957 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1076/2182] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:43:30 2022] DELETE /identity/v3/projects/c1086b3da7ca49b08bf5a6b0e1b5b7b5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:43:30.458248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c2ddb-bada-47cd-b85f-def8a4140b74 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:30.460024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-567c2ddb-bada-47cd-b85f-def8a4140b74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:30.486953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c2ddb-bada-47cd-b85f-def8a4140b74 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:30.549630 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953c347-c859-47ff-9633-4580964c9287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:30.550487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953c347-c859-47ff-9633-4580964c9287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:30.550773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953c347-c859-47ff-9633-4580964c9287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:30.551045 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953c347-c859-47ff-9633-4580964c9287 admin admin] PATH_INFO: `/v3/projects/7b8b2c4c87f74ba49bd59d96908f0f2c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:30.552219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953c347-c859-47ff-9633-4580964c9287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b8b2c4c87f74ba49bd59d96908f0f2c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:30.554875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953c347-c859-47ff-9633-4580964c9287 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:30.603964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0953c347-c859-47ff-9633-4580964c9287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b8b2c4c87f74ba49bd59d96908f0f2c', 'request_id': 'req-0953c347-c859-47ff-9633-4580964c9287'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:30.613003 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0953c347-c859-47ff-9633-4580964c9287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b8b2c4c87f74ba49bd59d96908f0f2c', 'request_id': 'req-0953c347-c859-47ff-9633-4580964c9287'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:30.621449 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0953c347-c859-47ff-9633-4580964c9287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b8b2c4c87f74ba49bd59d96908f0f2c', 'request_id': 'req-0953c347-c859-47ff-9633-4580964c9287'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:30.643912 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0953c347-c859-47ff-9633-4580964c9287 admin admin] The token cache is being invalidate because project 7b8b2c4c87f74ba49bd59d96908f0f2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:43:30.644298 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0953c347-c859-47ff-9633-4580964c9287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:30.645228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0953c347-c859-47ff-9633-4580964c9287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:30.647966 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1107/2183] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:43:30 2022] DELETE /identity/v3/projects/7b8b2c4c87f74ba49bd59d96908f0f2c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:43:30.652602 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d401c-6af5-4888-97c4-0846a06241da None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:30.653984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d401c-6af5-4888-97c4-0846a06241da None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:30.654273 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d401c-6af5-4888-97c4-0846a06241da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:30.675358 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-081d401c-6af5-4888-97c4-0846a06241da None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:30.676391 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-081d401c-6af5-4888-97c4-0846a06241da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:30.744789 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1077/2184] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:30.752571 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc0fc8-9e0a-492c-b168-0a3b9fcdbc7d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:30.752861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc0fc8-9e0a-492c-b168-0a3b9fcdbc7d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:30.753140 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc0fc8-9e0a-492c-b168-0a3b9fcdbc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:30.773036 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-91bc0fc8-9e0a-492c-b168-0a3b9fcdbc7d None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:30.774243 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-91bc0fc8-9e0a-492c-b168-0a3b9fcdbc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:30.782137 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1108/2185] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:30.786230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d401c-6af5-4888-97c4-0846a06241da None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:30.796586 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d401c-6af5-4888-97c4-0846a06241da None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:30.801217 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a9eb0-8792-4554-a218-0fdf14b60f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:30.801865 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a9eb0-8792-4554-a218-0fdf14b60f81 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:30.802152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a9eb0-8792-4554-a218-0fdf14b60f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:30.802430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a9eb0-8792-4554-a218-0fdf14b60f81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:30.803835 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a9eb0-8792-4554-a218-0fdf14b60f81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:43:30.804149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a9eb0-8792-4554-a218-0fdf14b60f81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:30.805856 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a9eb0-8792-4554-a218-0fdf14b60f81 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:30.817291 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1078/2186] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:43:30.821408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc0fc8-9e0a-492c-b168-0a3b9fcdbc7d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:30.830815 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc0fc8-9e0a-492c-b168-0a3b9fcdbc7d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:30.835849 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab05c8-ede6-4c55-8759-53ce1021212a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:30.836486 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab05c8-ede6-4c55-8759-53ce1021212a admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:30.836802 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab05c8-ede6-4c55-8759-53ce1021212a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:30.837079 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab05c8-ede6-4c55-8759-53ce1021212a admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:30.837758 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab05c8-ede6-4c55-8759-53ce1021212a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:30.839672 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab05c8-ede6-4c55-8759-53ce1021212a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:30.866369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1109/2187] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:43:30 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:43:30.870589 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a9eb0-8792-4554-a218-0fdf14b60f81 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:30.881038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a9eb0-8792-4554-a218-0fdf14b60f81 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:30.940545 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1cb5fe-edd6-407d-9fb7-87c953100b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:30.941211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cb5fe-edd6-407d-9fb7-87c953100b45 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:30.941501 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cb5fe-edd6-407d-9fb7-87c953100b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:30.941782 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cb5fe-edd6-407d-9fb7-87c953100b45 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:30.942475 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1cb5fe-edd6-407d-9fb7-87c953100b45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:30.944450 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1cb5fe-edd6-407d-9fb7-87c953100b45 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:30.964459 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1079/2188] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:43:30 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:43:30.968560 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab05c8-ede6-4c55-8759-53ce1021212a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:30.979133 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab05c8-ede6-4c55-8759-53ce1021212a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:30.983887 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2fb57-47e8-4b14-9bfa-6f55a7bf31d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:30.984569 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2fb57-47e8-4b14-9bfa-6f55a7bf31d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:30.984854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2fb57-47e8-4b14-9bfa-6f55a7bf31d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:30.985128 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2fb57-47e8-4b14-9bfa-6f55a7bf31d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:30.985869 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2fb57-47e8-4b14-9bfa-6f55a7bf31d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:30.987450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2fb57-47e8-4b14-9bfa-6f55a7bf31d8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:30.999279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1110/2189] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:43:31.003101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1cb5fe-edd6-407d-9fb7-87c953100b45 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:31.013069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1cb5fe-edd6-407d-9fb7-87c953100b45 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:31.017696 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06901c78-8350-4f6a-9c9a-fede2a234d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:31.018407 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06901c78-8350-4f6a-9c9a-fede2a234d89 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:31.018723 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06901c78-8350-4f6a-9c9a-fede2a234d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:31.019079 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06901c78-8350-4f6a-9c9a-fede2a234d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:31.019966 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06901c78-8350-4f6a-9c9a-fede2a234d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:31.021683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06901c78-8350-4f6a-9c9a-fede2a234d89 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:31.031508 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1080/2190] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:43:31.035446 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2fb57-47e8-4b14-9bfa-6f55a7bf31d8 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:31.045887 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2fb57-47e8-4b14-9bfa-6f55a7bf31d8 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:31.050466 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6b683-a52a-4035-a874-462664fc86b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:31.051272 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6b683-a52a-4035-a874-462664fc86b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:31.051551 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6b683-a52a-4035-a874-462664fc86b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:31.051826 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6b683-a52a-4035-a874-462664fc86b5 admin admin] PATH_INFO: `/v3/projects/c0b8db9b92dd415e8ae399df1d70ddaa/users/3fb2f20226874c2a8320e4c4f0ffda4f/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:31.055328 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:31.069318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6b683-a52a-4035-a874-462664fc86b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0b8db9b92dd415e8ae399df1d70ddaa, user_id=3fb2f20226874c2a8320e4c4f0ffda4f, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:31.071977 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6b683-a52a-4035-a874-462664fc86b5 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:31.084370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1111/2191] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:43:31 2022] PUT /identity/v3/projects/c0b8db9b92dd415e8ae399df1d70ddaa/users/3fb2f20226874c2a8320e4c4f0ffda4f/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:43:31.094656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a65b7d-54a7-48e7-b091-57d15a4e2e7a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:31.095046 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a65b7d-54a7-48e7-b091-57d15a4e2e7a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:31.095633 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a65b7d-54a7-48e7-b091-57d15a4e2e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:31.124050 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-77a65b7d-54a7-48e7-b091-57d15a4e2e7a None None] MFA Rules not processed for user `3fb2f20226874c2a8320e4c4f0ffda4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:31.125264 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-77a65b7d-54a7-48e7-b091-57d15a4e2e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:31.156211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:31.197605 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1081/2192] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:43:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:31.208704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6b683-a52a-4035-a874-462664fc86b5 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:31.210925 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-15a6b683-a52a-4035-a874-462664fc86b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:31.267290 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6b683-a52a-4035-a874-462664fc86b5 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:31.270949 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de575771-7a59-441d-a5a3-9fac5dcdaa92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:31.272122 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de575771-7a59-441d-a5a3-9fac5dcdaa92 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:31.272407 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de575771-7a59-441d-a5a3-9fac5dcdaa92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:31.272717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de575771-7a59-441d-a5a3-9fac5dcdaa92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:31.281063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de575771-7a59-441d-a5a3-9fac5dcdaa92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:31.282489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de575771-7a59-441d-a5a3-9fac5dcdaa92 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:31.292281 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1112/2193] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:43:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:43:34.087865 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97d5f0-a74b-43f5-8e5e-5c71c153b6d7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:34.088337 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97d5f0-a74b-43f5-8e5e-5c71c153b6d7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:34.088430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97d5f0-a74b-43f5-8e5e-5c71c153b6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:34.108492 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7c97d5f0-a74b-43f5-8e5e-5c71c153b6d7 None None] MFA Rules not processed for user `6c963986b46d4d148fc843b0a1183d69`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:34.109720 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7c97d5f0-a74b-43f5-8e5e-5c71c153b6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:34.163385 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1082/2194] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:43:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:40.797006 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de575771-7a59-441d-a5a3-9fac5dcdaa92 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:40.858199 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de575771-7a59-441d-a5a3-9fac5dcdaa92 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:40.862683 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5eed0-3e6e-4ca7-a9a2-d1921c00531a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:40.863540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5eed0-3e6e-4ca7-a9a2-d1921c00531a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:40.863823 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5eed0-3e6e-4ca7-a9a2-d1921c00531a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:40.864103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5eed0-3e6e-4ca7-a9a2-d1921c00531a admin admin] PATH_INFO: `/v3/users/3fb2f20226874c2a8320e4c4f0ffda4f` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:40.865928 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff5eed0-3e6e-4ca7-a9a2-d1921c00531a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb2f20226874c2a8320e4c4f0ffda4f)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:40.867857 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff5eed0-3e6e-4ca7-a9a2-d1921c00531a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:40.912220 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1ff5eed0-3e6e-4ca7-a9a2-d1921c00531a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb2f20226874c2a8320e4c4f0ffda4f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:40.923550 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1ff5eed0-3e6e-4ca7-a9a2-d1921c00531a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb2f20226874c2a8320e4c4f0ffda4f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:40.924193 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1ff5eed0-3e6e-4ca7-a9a2-d1921c00531a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb2f20226874c2a8320e4c4f0ffda4f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:40.931669 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1ff5eed0-3e6e-4ca7-a9a2-d1921c00531a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb2f20226874c2a8320e4c4f0ffda4f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:40.932286 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1ff5eed0-3e6e-4ca7-a9a2-d1921c00531a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb2f20226874c2a8320e4c4f0ffda4f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:40.943915 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1113/2195] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:43:40 2022] DELETE /identity/v3/users/3fb2f20226874c2a8320e4c4f0ffda4f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:43:40.948395 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddf492-2a23-4857-9c3c-6e4e5ebec660 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:40.948943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddf492-2a23-4857-9c3c-6e4e5ebec660 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:40.949222 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddf492-2a23-4857-9c3c-6e4e5ebec660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:40.967840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-eeddf492-2a23-4857-9c3c-6e4e5ebec660 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:40.969056 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-eeddf492-2a23-4857-9c3c-6e4e5ebec660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:41.027238 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1083/2196] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:41.037673 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5eed0-3e6e-4ca7-a9a2-d1921c00531a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:41.039061 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1ff5eed0-3e6e-4ca7-a9a2-d1921c00531a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:41.048702 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:41.095609 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5eed0-3e6e-4ca7-a9a2-d1921c00531a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:41.100607 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f8c92-c761-48dd-94ca-b5459c1eb636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:41.101534 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f8c92-c761-48dd-94ca-b5459c1eb636 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:41.101947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f8c92-c761-48dd-94ca-b5459c1eb636 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:41.102230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f8c92-c761-48dd-94ca-b5459c1eb636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:41.111648 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f8c92-c761-48dd-94ca-b5459c1eb636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:41.113118 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f8c92-c761-48dd-94ca-b5459c1eb636 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:41.122765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1114/2197] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:43:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:43:41.392848 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddf492-2a23-4857-9c3c-6e4e5ebec660 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:41.394308 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-eeddf492-2a23-4857-9c3c-6e4e5ebec660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:41.408429 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddf492-2a23-4857-9c3c-6e4e5ebec660 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:41.413584 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7dbe26-1f06-4ed7-97f5-891b12df3a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:41.414437 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7dbe26-1f06-4ed7-97f5-891b12df3a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:41.414717 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7dbe26-1f06-4ed7-97f5-891b12df3a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:41.414991 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7dbe26-1f06-4ed7-97f5-891b12df3a4b admin admin] PATH_INFO: `/v3/projects/c0b8db9b92dd415e8ae399df1d70ddaa` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:41.416860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7dbe26-1f06-4ed7-97f5-891b12df3a4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0b8db9b92dd415e8ae399df1d70ddaa)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:41.418777 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7dbe26-1f06-4ed7-97f5-891b12df3a4b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:41.465127 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ae7dbe26-1f06-4ed7-97f5-891b12df3a4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0b8db9b92dd415e8ae399df1d70ddaa', 'request_id': 'req-ae7dbe26-1f06-4ed7-97f5-891b12df3a4b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:41.475816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ae7dbe26-1f06-4ed7-97f5-891b12df3a4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0b8db9b92dd415e8ae399df1d70ddaa', 'request_id': 'req-ae7dbe26-1f06-4ed7-97f5-891b12df3a4b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:41.482863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ae7dbe26-1f06-4ed7-97f5-891b12df3a4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0b8db9b92dd415e8ae399df1d70ddaa', 'request_id': 'req-ae7dbe26-1f06-4ed7-97f5-891b12df3a4b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:41.490831 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:41.497388 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ae7dbe26-1f06-4ed7-97f5-891b12df3a4b admin admin] The token cache is being invalidate because project c0b8db9b92dd415e8ae399df1d70ddaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:43:41.497867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ae7dbe26-1f06-4ed7-97f5-891b12df3a4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:41.498746 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ae7dbe26-1f06-4ed7-97f5-891b12df3a4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:43:41.500306 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1084/2198] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:43:41 2022] DELETE /identity/v3/projects/c0b8db9b92dd415e8ae399df1d70ddaa => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:43:41.505092 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd07c0f-4837-4090-a63c-08b13c2eda3d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:41.505385 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd07c0f-4837-4090-a63c-08b13c2eda3d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:41.505662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd07c0f-4837-4090-a63c-08b13c2eda3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:41.522743 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-bcd07c0f-4837-4090-a63c-08b13c2eda3d None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:41.523941 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-bcd07c0f-4837-4090-a63c-08b13c2eda3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:41.583665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1115/2199] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:43:41.592592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0351c5-08b7-4b8f-94dd-11d4a7cb5292 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:41.592968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0351c5-08b7-4b8f-94dd-11d4a7cb5292 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:41.593324 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0351c5-08b7-4b8f-94dd-11d4a7cb5292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:41.612651 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3c0351c5-08b7-4b8f-94dd-11d4a7cb5292 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:41.613921 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3c0351c5-08b7-4b8f-94dd-11d4a7cb5292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:41.622593 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1085/2200] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:43:41.626802 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd07c0f-4837-4090-a63c-08b13c2eda3d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:41.636960 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd07c0f-4837-4090-a63c-08b13c2eda3d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:41.641629 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71af895-acd4-425b-831d-54bb34670d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:41.642358 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71af895-acd4-425b-831d-54bb34670d4c admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:41.642647 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71af895-acd4-425b-831d-54bb34670d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:41.642925 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71af895-acd4-425b-831d-54bb34670d4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:41.643644 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71af895-acd4-425b-831d-54bb34670d4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:43:41.643952 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71af895-acd4-425b-831d-54bb34670d4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:41.645573 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71af895-acd4-425b-831d-54bb34670d4c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:41.660817 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1116/2201] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:43:41.662439 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0351c5-08b7-4b8f-94dd-11d4a7cb5292 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:41.671644 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0351c5-08b7-4b8f-94dd-11d4a7cb5292 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:41.676431 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414919c6-1619-4bd9-95dd-4f75bdfa0eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:41.677197 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414919c6-1619-4bd9-95dd-4f75bdfa0eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:41.678134 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414919c6-1619-4bd9-95dd-4f75bdfa0eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:41.678420 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414919c6-1619-4bd9-95dd-4f75bdfa0eb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:41.679121 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414919c6-1619-4bd9-95dd-4f75bdfa0eb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:41.681143 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414919c6-1619-4bd9-95dd-4f75bdfa0eb9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:41.706441 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1086/2202] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:43:41 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:43:41.710989 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71af895-acd4-425b-831d-54bb34670d4c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:41.720808 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71af895-acd4-425b-831d-54bb34670d4c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:41.775930 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f11f1-54f9-48b4-86d5-08a370a0a10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:41.776623 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f11f1-54f9-48b4-86d5-08a370a0a10f admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:41.776913 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f11f1-54f9-48b4-86d5-08a370a0a10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:41.777188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f11f1-54f9-48b4-86d5-08a370a0a10f admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:41.777860 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f11f1-54f9-48b4-86d5-08a370a0a10f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:41.779772 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f11f1-54f9-48b4-86d5-08a370a0a10f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:41.799331 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1117/2203] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:43:41 2022] POST /identity/v3/users => generated 282 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:43:41.803317 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414919c6-1619-4bd9-95dd-4f75bdfa0eb9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:41.813545 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414919c6-1619-4bd9-95dd-4f75bdfa0eb9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:41.818131 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d121db-3859-46d5-80cc-4011c5d0e5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:41.818779 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d121db-3859-46d5-80cc-4011c5d0e5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:41.819070 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d121db-3859-46d5-80cc-4011c5d0e5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:41.819354 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d121db-3859-46d5-80cc-4011c5d0e5b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:41.820077 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d121db-3859-46d5-80cc-4011c5d0e5b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:41.821732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d121db-3859-46d5-80cc-4011c5d0e5b1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:41.833292 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1087/2204] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:43:41.837735 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f11f1-54f9-48b4-86d5-08a370a0a10f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:41.847410 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f11f1-54f9-48b4-86d5-08a370a0a10f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:41.852537 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379dc08-0889-46f6-a76b-20bc566908b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:41.853177 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379dc08-0889-46f6-a76b-20bc566908b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:41.853461 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379dc08-0889-46f6-a76b-20bc566908b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:41.853733 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379dc08-0889-46f6-a76b-20bc566908b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:41.854445 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379dc08-0889-46f6-a76b-20bc566908b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:41.856280 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379dc08-0889-46f6-a76b-20bc566908b2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:41.865971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1118/2205] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:43:41.869754 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d121db-3859-46d5-80cc-4011c5d0e5b1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:41.879495 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d121db-3859-46d5-80cc-4011c5d0e5b1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:41.884102 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96f2a8-0c75-45d2-946f-9eecd977be1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:41.884984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96f2a8-0c75-45d2-946f-9eecd977be1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:41.885270 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96f2a8-0c75-45d2-946f-9eecd977be1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:41.885546 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96f2a8-0c75-45d2-946f-9eecd977be1b admin admin] PATH_INFO: `/v3/projects/18d24b04491a49178ebd4f99e7d0dce0/users/6a1fb651503546cd89461a63add2c8b9/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:41.900365 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96f2a8-0c75-45d2-946f-9eecd977be1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=18d24b04491a49178ebd4f99e7d0dce0, user_id=6a1fb651503546cd89461a63add2c8b9, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:41.903078 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96f2a8-0c75-45d2-946f-9eecd977be1b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:41.916381 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1088/2206] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:43:41 2022] PUT /identity/v3/projects/18d24b04491a49178ebd4f99e7d0dce0/users/6a1fb651503546cd89461a63add2c8b9/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:43:41.926479 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bff63-1d41-4040-88f5-5755488072e8 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:41.926767 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bff63-1d41-4040-88f5-5755488072e8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:41.927069 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bff63-1d41-4040-88f5-5755488072e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:41.953951 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-031bff63-1d41-4040-88f5-5755488072e8 None None] MFA Rules not processed for user `6a1fb651503546cd89461a63add2c8b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:41.955154 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-031bff63-1d41-4040-88f5-5755488072e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:41.959640 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:43:42.019154 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1119/2207] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:43:41 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:42.030899 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96f2a8-0c75-45d2-946f-9eecd977be1b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:43:42.032725 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5b96f2a8-0c75-45d2-946f-9eecd977be1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:42.092282 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96f2a8-0c75-45d2-946f-9eecd977be1b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:43:42.096236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e90b0-5c21-454a-9d09-8f8ec8a84c9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:43:42.097126 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e90b0-5c21-454a-9d09-8f8ec8a84c9c service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:42.097572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e90b0-5c21-454a-9d09-8f8ec8a84c9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:42.097902 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e90b0-5c21-454a-9d09-8f8ec8a84c9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:42.108066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e90b0-5c21-454a-9d09-8f8ec8a84c9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:43:42.109545 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e90b0-5c21-454a-9d09-8f8ec8a84c9c service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:43:42.118340 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1089/2208] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:43:42 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:43:52.001771 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153f520-2c3b-462b-a910-43ecbb10a51d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:43:52.002265 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153f520-2c3b-462b-a910-43ecbb10a51d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:43:52.002365 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153f520-2c3b-462b-a910-43ecbb10a51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:43:52.019853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0153f520-2c3b-462b-a910-43ecbb10a51d None None] MFA Rules not processed for user `048f9b7d3ad84b439fedd0b80bc6c353`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:43:52.021735 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0153f520-2c3b-462b-a910-43ecbb10a51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:43:52.073656 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1120/2209] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:43:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:43:52.114310 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:44:02.066643 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=50 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:44:46.321560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e90b0-5c21-454a-9d09-8f8ec8a84c9c service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:44:46.383541 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e90b0-5c21-454a-9d09-8f8ec8a84c9c service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:44:46.388070 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5df000-88c1-410c-afa0-2ee71b7065ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:44:46.388954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5df000-88c1-410c-afa0-2ee71b7065ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:46.389241 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5df000-88c1-410c-afa0-2ee71b7065ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:46.389519 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5df000-88c1-410c-afa0-2ee71b7065ff admin admin] PATH_INFO: `/v3/users/6a1fb651503546cd89461a63add2c8b9` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:46.390701 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5df000-88c1-410c-afa0-2ee71b7065ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a1fb651503546cd89461a63add2c8b9)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:44:46.392668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5df000-88c1-410c-afa0-2ee71b7065ff admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:44:46.438418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3f5df000-88c1-410c-afa0-2ee71b7065ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a1fb651503546cd89461a63add2c8b9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:44:46.438995 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3f5df000-88c1-410c-afa0-2ee71b7065ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a1fb651503546cd89461a63add2c8b9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:44:46.445896 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3f5df000-88c1-410c-afa0-2ee71b7065ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a1fb651503546cd89461a63add2c8b9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:44:46.446522 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3f5df000-88c1-410c-afa0-2ee71b7065ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a1fb651503546cd89461a63add2c8b9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:44:46.453733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3f5df000-88c1-410c-afa0-2ee71b7065ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a1fb651503546cd89461a63add2c8b9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:44:46.472709 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1090/2210] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:44:46 2022] DELETE /identity/v3/users/6a1fb651503546cd89461a63add2c8b9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:44:46.477106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f51034-6c28-4a0b-b15b-050e13e29799 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:46.477571 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f51034-6c28-4a0b-b15b-050e13e29799 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:46.477675 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f51034-6c28-4a0b-b15b-050e13e29799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:46.497958 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-37f51034-6c28-4a0b-b15b-050e13e29799 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:44:46.499503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-37f51034-6c28-4a0b-b15b-050e13e29799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:46.561368 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1121/2211] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:44:46.571427 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5df000-88c1-410c-afa0-2ee71b7065ff admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:44:46.572916 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3f5df000-88c1-410c-afa0-2ee71b7065ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:46.635892 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5df000-88c1-410c-afa0-2ee71b7065ff admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:44:46.640572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673e1bf-6696-4a41-84e4-3a05fbf0a9ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:44:46.641384 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673e1bf-6696-4a41-84e4-3a05fbf0a9ca service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:46.641811 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673e1bf-6696-4a41-84e4-3a05fbf0a9ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:46.642166 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673e1bf-6696-4a41-84e4-3a05fbf0a9ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:46.652880 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673e1bf-6696-4a41-84e4-3a05fbf0a9ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:44:46.654548 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673e1bf-6696-4a41-84e4-3a05fbf0a9ca service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:44:46.664607 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1091/2212] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:44:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:44:46.954048 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f51034-6c28-4a0b-b15b-050e13e29799 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:44:46.955488 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-37f51034-6c28-4a0b-b15b-050e13e29799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:46.970638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f51034-6c28-4a0b-b15b-050e13e29799 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:44:46.975227 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132166f5-04bc-4f63-83f7-0fb99d17a10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:44:46.976199 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132166f5-04bc-4f63-83f7-0fb99d17a10a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:46.976482 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132166f5-04bc-4f63-83f7-0fb99d17a10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:46.976894 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132166f5-04bc-4f63-83f7-0fb99d17a10a admin admin] PATH_INFO: `/v3/projects/18d24b04491a49178ebd4f99e7d0dce0` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:46.978068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132166f5-04bc-4f63-83f7-0fb99d17a10a admin admin] RBAC: Authorizing `identity:delete_project(project_id=18d24b04491a49178ebd4f99e7d0dce0)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:44:46.979854 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132166f5-04bc-4f63-83f7-0fb99d17a10a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:44:47.030221 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-132166f5-04bc-4f63-83f7-0fb99d17a10a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18d24b04491a49178ebd4f99e7d0dce0', 'request_id': 'req-132166f5-04bc-4f63-83f7-0fb99d17a10a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:44:47.037400 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-132166f5-04bc-4f63-83f7-0fb99d17a10a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18d24b04491a49178ebd4f99e7d0dce0', 'request_id': 'req-132166f5-04bc-4f63-83f7-0fb99d17a10a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:44:47.043539 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-132166f5-04bc-4f63-83f7-0fb99d17a10a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18d24b04491a49178ebd4f99e7d0dce0', 'request_id': 'req-132166f5-04bc-4f63-83f7-0fb99d17a10a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:44:47.053650 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-132166f5-04bc-4f63-83f7-0fb99d17a10a admin admin] The token cache is being invalidate because project 18d24b04491a49178ebd4f99e7d0dce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:44:47.053934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-132166f5-04bc-4f63-83f7-0fb99d17a10a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:44:47.054557 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-132166f5-04bc-4f63-83f7-0fb99d17a10a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:44:47.056114 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1122/2213] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:44:46 2022] DELETE /identity/v3/projects/18d24b04491a49178ebd4f99e7d0dce0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:44:56.659851 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:44:57.050763 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:44:58.744570 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673e1bf-6696-4a41-84e4-3a05fbf0a9ca service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:44:58.753532 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673e1bf-6696-4a41-84e4-3a05fbf0a9ca service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:44:58.801521 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a69000-a823-4707-aae3-5ee1b6d7df59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:44:58.802153 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a69000-a823-4707-aae3-5ee1b6d7df59 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:44:58.802437 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a69000-a823-4707-aae3-5ee1b6d7df59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:44:58.802713 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a69000-a823-4707-aae3-5ee1b6d7df59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:44:58.804478 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b7a69000-a823-4707-aae3-5ee1b6d7df59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:44:58.884598 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a69000-a823-4707-aae3-5ee1b6d7df59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:44:58.886041 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a69000-a823-4707-aae3-5ee1b6d7df59 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:44:58.906468 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1092/2214] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:44:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:45:02.422493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132166f5-04bc-4f63-83f7-0fb99d17a10a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:02.423927 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-132166f5-04bc-4f63-83f7-0fb99d17a10a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:02.436151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132166f5-04bc-4f63-83f7-0fb99d17a10a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:02.439619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e570ef9-f79c-4a11-b421-5644771e9859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:02.440240 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e570ef9-f79c-4a11-b421-5644771e9859 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:02.440538 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e570ef9-f79c-4a11-b421-5644771e9859 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:02.440815 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e570ef9-f79c-4a11-b421-5644771e9859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:02.442480 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7e570ef9-f79c-4a11-b421-5644771e9859 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:02.455962 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e570ef9-f79c-4a11-b421-5644771e9859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:02.457429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e570ef9-f79c-4a11-b421-5644771e9859 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:02.468328 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1123/2215] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:45:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:45:08.903833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=63 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:10.021913 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a69000-a823-4707-aae3-5ee1b6d7df59 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:10.023342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b7a69000-a823-4707-aae3-5ee1b6d7df59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:10.088740 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a69000-a823-4707-aae3-5ee1b6d7df59 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:10.093225 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2347e6a-bd47-43a5-8d9a-75822740cde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:10.094069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2347e6a-bd47-43a5-8d9a-75822740cde3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:10.094347 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2347e6a-bd47-43a5-8d9a-75822740cde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:10.094624 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2347e6a-bd47-43a5-8d9a-75822740cde3 admin admin] PATH_INFO: `/v3/users/048f9b7d3ad84b439fedd0b80bc6c353` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:10.095782 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2347e6a-bd47-43a5-8d9a-75822740cde3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=048f9b7d3ad84b439fedd0b80bc6c353)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:10.097743 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2347e6a-bd47-43a5-8d9a-75822740cde3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:10.144365 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d2347e6a-bd47-43a5-8d9a-75822740cde3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '048f9b7d3ad84b439fedd0b80bc6c353'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:45:10.145039 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d2347e6a-bd47-43a5-8d9a-75822740cde3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '048f9b7d3ad84b439fedd0b80bc6c353'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:45:10.152116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d2347e6a-bd47-43a5-8d9a-75822740cde3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '048f9b7d3ad84b439fedd0b80bc6c353'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:45:10.152815 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d2347e6a-bd47-43a5-8d9a-75822740cde3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '048f9b7d3ad84b439fedd0b80bc6c353'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:45:10.160283 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d2347e6a-bd47-43a5-8d9a-75822740cde3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '048f9b7d3ad84b439fedd0b80bc6c353'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:45:10.177736 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1093/2216] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:45:10 2022] DELETE /identity/v3/users/048f9b7d3ad84b439fedd0b80bc6c353 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:45:10.349786 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e570ef9-f79c-4a11-b421-5644771e9859 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:10.361945 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e570ef9-f79c-4a11-b421-5644771e9859 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:10.420405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39727526-c687-4621-8855-8887cfce0570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:10.421526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39727526-c687-4621-8855-8887cfce0570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:10.421811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39727526-c687-4621-8855-8887cfce0570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:10.422087 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39727526-c687-4621-8855-8887cfce0570 admin admin] PATH_INFO: `/v3/projects/bd7df7b583a4440ebcf76e5cce3dffc3` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:10.423262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39727526-c687-4621-8855-8887cfce0570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd7df7b583a4440ebcf76e5cce3dffc3)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:10.425264 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39727526-c687-4621-8855-8887cfce0570 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:10.470746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-39727526-c687-4621-8855-8887cfce0570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'request_id': 'req-39727526-c687-4621-8855-8887cfce0570'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:45:10.479490 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-39727526-c687-4621-8855-8887cfce0570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'request_id': 'req-39727526-c687-4621-8855-8887cfce0570'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:45:10.487375 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-39727526-c687-4621-8855-8887cfce0570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd7df7b583a4440ebcf76e5cce3dffc3', 'request_id': 'req-39727526-c687-4621-8855-8887cfce0570'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:45:10.497675 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-39727526-c687-4621-8855-8887cfce0570 admin admin] The token cache is being invalidate because project bd7df7b583a4440ebcf76e5cce3dffc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:45:10.497960 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-39727526-c687-4621-8855-8887cfce0570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:45:10.498608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-39727526-c687-4621-8855-8887cfce0570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:45:10.500144 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1124/2217] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:45:10 2022] DELETE /identity/v3/projects/bd7df7b583a4440ebcf76e5cce3dffc3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:45:10.505252 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f1314-36be-4a6a-93ee-df9fff964600 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:10.505547 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f1314-36be-4a6a-93ee-df9fff964600 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:10.505826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f1314-36be-4a6a-93ee-df9fff964600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:10.524638 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e34f1314-36be-4a6a-93ee-df9fff964600 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:45:10.525922 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e34f1314-36be-4a6a-93ee-df9fff964600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:10.586138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1094/2218] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:45:10.593468 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed7dca-1b41-4082-9c37-19ca20510a5e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:10.593756 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed7dca-1b41-4082-9c37-19ca20510a5e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:10.594033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed7dca-1b41-4082-9c37-19ca20510a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:10.611909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-dfed7dca-1b41-4082-9c37-19ca20510a5e None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:45:10.613126 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-dfed7dca-1b41-4082-9c37-19ca20510a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:10.620850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1125/2219] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:45:10.625304 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f1314-36be-4a6a-93ee-df9fff964600 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:10.635008 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f1314-36be-4a6a-93ee-df9fff964600 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:10.641222 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6547b2-b8d4-4fd2-99c1-d36b2266c0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:10.641886 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6547b2-b8d4-4fd2-99c1-d36b2266c0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:10.642173 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6547b2-b8d4-4fd2-99c1-d36b2266c0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:10.642527 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6547b2-b8d4-4fd2-99c1-d36b2266c0f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:10.643172 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6547b2-b8d4-4fd2-99c1-d36b2266c0f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:45:10.643479 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6547b2-b8d4-4fd2-99c1-d36b2266c0f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:10.645534 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6547b2-b8d4-4fd2-99c1-d36b2266c0f4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:10.659812 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1095/2220] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:45:10.664012 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed7dca-1b41-4082-9c37-19ca20510a5e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:10.673332 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed7dca-1b41-4082-9c37-19ca20510a5e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:10.678952 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6207636-146c-4ab9-afb7-c70aba19d578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:10.679613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6207636-146c-4ab9-afb7-c70aba19d578 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:10.679898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6207636-146c-4ab9-afb7-c70aba19d578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:10.680174 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6207636-146c-4ab9-afb7-c70aba19d578 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:10.680914 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6207636-146c-4ab9-afb7-c70aba19d578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:10.682828 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6207636-146c-4ab9-afb7-c70aba19d578 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:10.715322 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1126/2221] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:45:10 2022] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:45:10.716848 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6547b2-b8d4-4fd2-99c1-d36b2266c0f4 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:10.727531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6547b2-b8d4-4fd2-99c1-d36b2266c0f4 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:10.731858 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:10.789219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60b74a-2438-4e1b-ae53-5b6e0ab9cef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:10.789887 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60b74a-2438-4e1b-ae53-5b6e0ab9cef6 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:10.790192 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60b74a-2438-4e1b-ae53-5b6e0ab9cef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:10.790459 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60b74a-2438-4e1b-ae53-5b6e0ab9cef6 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:10.791143 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60b74a-2438-4e1b-ae53-5b6e0ab9cef6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:10.793111 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60b74a-2438-4e1b-ae53-5b6e0ab9cef6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:10.814110 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1096/2222] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:45:10 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:45:10.818175 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6207636-146c-4ab9-afb7-c70aba19d578 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:10.829567 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6207636-146c-4ab9-afb7-c70aba19d578 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:10.834114 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462ffde-226d-47bb-9486-5017930b0f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:10.834763 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462ffde-226d-47bb-9486-5017930b0f24 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:10.835049 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462ffde-226d-47bb-9486-5017930b0f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:10.835328 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462ffde-226d-47bb-9486-5017930b0f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:10.836047 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462ffde-226d-47bb-9486-5017930b0f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:10.837694 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462ffde-226d-47bb-9486-5017930b0f24 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:10.847947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1127/2223] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:45:10.851663 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60b74a-2438-4e1b-ae53-5b6e0ab9cef6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:10.861693 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60b74a-2438-4e1b-ae53-5b6e0ab9cef6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:10.866234 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b176b1-ebab-4c12-8851-dcc4e81683c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:10.866868 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b176b1-ebab-4c12-8851-dcc4e81683c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:10.867153 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b176b1-ebab-4c12-8851-dcc4e81683c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:10.867429 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b176b1-ebab-4c12-8851-dcc4e81683c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:10.868153 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b176b1-ebab-4c12-8851-dcc4e81683c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:10.869773 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b176b1-ebab-4c12-8851-dcc4e81683c9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:10.879993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1097/2224] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:45:10.883781 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462ffde-226d-47bb-9486-5017930b0f24 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:10.894120 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462ffde-226d-47bb-9486-5017930b0f24 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:10.898743 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb3343-fe28-45e7-a3d3-4831f90cd07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:10.899603 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb3343-fe28-45e7-a3d3-4831f90cd07e admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:10.899884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb3343-fe28-45e7-a3d3-4831f90cd07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:10.900532 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb3343-fe28-45e7-a3d3-4831f90cd07e admin admin] PATH_INFO: `/v3/projects/4a4e35f7bcf54ff8b296836d852b48cc/users/659a4890d8704ba5998822d307940869/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:10.914728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb3343-fe28-45e7-a3d3-4831f90cd07e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a4e35f7bcf54ff8b296836d852b48cc, user_id=659a4890d8704ba5998822d307940869, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:10.917471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb3343-fe28-45e7-a3d3-4831f90cd07e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:10.930617 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1128/2225] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:45:10 2022] PUT /identity/v3/projects/4a4e35f7bcf54ff8b296836d852b48cc/users/659a4890d8704ba5998822d307940869/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:45:10.941790 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e2bf3-8d7f-4127-bdac-a7a8b975b198 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:10.942080 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e2bf3-8d7f-4127-bdac-a7a8b975b198 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:10.942353 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e2bf3-8d7f-4127-bdac-a7a8b975b198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:10.967824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ab3e2bf3-8d7f-4127-bdac-a7a8b975b198 None None] MFA Rules not processed for user `659a4890d8704ba5998822d307940869`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:45:10.969056 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ab3e2bf3-8d7f-4127-bdac-a7a8b975b198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:11.031335 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1098/2226] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:45:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:45:11.042967 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb3343-fe28-45e7-a3d3-4831f90cd07e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:11.045234 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8aeb3343-fe28-45e7-a3d3-4831f90cd07e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:11.059350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:11.103301 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb3343-fe28-45e7-a3d3-4831f90cd07e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:11.107817 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4cf0f-0eaf-4747-b590-bad540f95019 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:11.108453 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4cf0f-0eaf-4747-b590-bad540f95019 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:11.108769 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4cf0f-0eaf-4747-b590-bad540f95019 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:11.109049 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4cf0f-0eaf-4747-b590-bad540f95019 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:11.117544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4cf0f-0eaf-4747-b590-bad540f95019 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:11.118970 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4cf0f-0eaf-4747-b590-bad540f95019 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:11.128343 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1129/2227] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:45:11 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:45:17.636812 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e2bf3-8d7f-4127-bdac-a7a8b975b198 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:17.638211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ab3e2bf3-8d7f-4127-bdac-a7a8b975b198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:17.710471 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e2bf3-8d7f-4127-bdac-a7a8b975b198 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:17.715802 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f1902-1d81-4413-bc32-f486b56eb3a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:17.716433 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f1902-1d81-4413-bc32-f486b56eb3a8 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:17.716745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f1902-1d81-4413-bc32-f486b56eb3a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:17.717672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f1902-1d81-4413-bc32-f486b56eb3a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:17.719393 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-713f1902-1d81-4413-bc32-f486b56eb3a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:17.729152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:17.776714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f1902-1d81-4413-bc32-f486b56eb3a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:17.778236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f1902-1d81-4413-bc32-f486b56eb3a8 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:17.787823 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1099/2228] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:45:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:45:20.308949 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4cf0f-0eaf-4747-b590-bad540f95019 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:20.310408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3be4cf0f-0eaf-4747-b590-bad540f95019 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:20.329295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4cf0f-0eaf-4747-b590-bad540f95019 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:20.334832 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008eaf1-e3c1-4726-8486-d45b3df52361 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:20.335495 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008eaf1-e3c1-4726-8486-d45b3df52361 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:20.335777 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008eaf1-e3c1-4726-8486-d45b3df52361 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:20.336053 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008eaf1-e3c1-4726-8486-d45b3df52361 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:20.337830 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2008eaf1-e3c1-4726-8486-d45b3df52361 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:20.396315 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008eaf1-e3c1-4726-8486-d45b3df52361 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:20.397938 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008eaf1-e3c1-4726-8486-d45b3df52361 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:20.406998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1130/2229] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:45:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:45:21.038234 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f1902-1d81-4413-bc32-f486b56eb3a8 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:21.050990 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f1902-1d81-4413-bc32-f486b56eb3a8 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:21.056848 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923344d-b010-4805-a4c4-8f375e10a8f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:21.057606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923344d-b010-4805-a4c4-8f375e10a8f5 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:21.057975 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923344d-b010-4805-a4c4-8f375e10a8f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:21.058324 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923344d-b010-4805-a4c4-8f375e10a8f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:21.060186 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f923344d-b010-4805-a4c4-8f375e10a8f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:21.125092 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923344d-b010-4805-a4c4-8f375e10a8f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:21.126708 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923344d-b010-4805-a4c4-8f375e10a8f5 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:21.136555 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1100/2230] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:45:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:45:21.358897 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63d2b7-1c0e-4724-8b9b-68adc9919727 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:21.360029 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63d2b7-1c0e-4724-8b9b-68adc9919727 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:21.360458 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63d2b7-1c0e-4724-8b9b-68adc9919727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:21.445605 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-6e63d2b7-1c0e-4724-8b9b-68adc9919727 None None] MFA Rules not processed for user `a2bd48e6390241448fe2cf098ab64df3`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:45:21.447245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6e63d2b7-1c0e-4724-8b9b-68adc9919727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:21.529999 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1131/2231] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 30 10:45:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:45:21.588259 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923344d-b010-4805-a4c4-8f375e10a8f5 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:21.590129 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f923344d-b010-4805-a4c4-8f375e10a8f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:21.701160 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923344d-b010-4805-a4c4-8f375e10a8f5 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:21.706444 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12c0f7-7420-40e3-9da6-4ea69547f645 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c15327c36c8c49ac87a3b3e9ab49eea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:21.707184 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12c0f7-7420-40e3-9da6-4ea69547f645 service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:21.707476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12c0f7-7420-40e3-9da6-4ea69547f645 service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:21.707753 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12c0f7-7420-40e3-9da6-4ea69547f645 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:21.716664 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12c0f7-7420-40e3-9da6-4ea69547f645 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:21.718683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12c0f7-7420-40e3-9da6-4ea69547f645 service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:21.727211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1101/2232] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 30 10:45:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:45:22.250521 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63d2b7-1c0e-4724-8b9b-68adc9919727 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:22.286593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:22.324571 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63d2b7-1c0e-4724-8b9b-68adc9919727 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:22.328996 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339e4f0-37ca-4bdc-a236-13e54ef2af1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:22.329858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339e4f0-37ca-4bdc-a236-13e54ef2af1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:22.330134 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339e4f0-37ca-4bdc-a236-13e54ef2af1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:22.330405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339e4f0-37ca-4bdc-a236-13e54ef2af1c admin admin] PATH_INFO: `/v3/users/659a4890d8704ba5998822d307940869` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:22.331569 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339e4f0-37ca-4bdc-a236-13e54ef2af1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=659a4890d8704ba5998822d307940869)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:22.333513 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339e4f0-37ca-4bdc-a236-13e54ef2af1c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:22.390262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0339e4f0-37ca-4bdc-a236-13e54ef2af1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '659a4890d8704ba5998822d307940869'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:45:22.403476 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0339e4f0-37ca-4bdc-a236-13e54ef2af1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '659a4890d8704ba5998822d307940869'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:45:22.404200 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0339e4f0-37ca-4bdc-a236-13e54ef2af1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '659a4890d8704ba5998822d307940869'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:45:22.411392 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0339e4f0-37ca-4bdc-a236-13e54ef2af1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '659a4890d8704ba5998822d307940869'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:45:22.412045 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0339e4f0-37ca-4bdc-a236-13e54ef2af1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '659a4890d8704ba5998822d307940869'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:45:22.425680 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1132/2233] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:45:22 2022] DELETE /identity/v3/users/659a4890d8704ba5998822d307940869 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:45:22.430138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85bd14-7de9-4343-b51a-60d04479b83d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:22.430669 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85bd14-7de9-4343-b51a-60d04479b83d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:22.430669 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85bd14-7de9-4343-b51a-60d04479b83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:22.450256 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-fd85bd14-7de9-4343-b51a-60d04479b83d None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:45:22.451713 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fd85bd14-7de9-4343-b51a-60d04479b83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:22.467090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:22.522223 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1102/2234] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:45:22.532556 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339e4f0-37ca-4bdc-a236-13e54ef2af1c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:22.533998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0339e4f0-37ca-4bdc-a236-13e54ef2af1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:22.626024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339e4f0-37ca-4bdc-a236-13e54ef2af1c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:22.640172 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700943c-546e-41e4-93eb-a70645cf385c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:22.640936 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700943c-546e-41e4-93eb-a70645cf385c service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:22.641218 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700943c-546e-41e4-93eb-a70645cf385c service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:22.641713 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700943c-546e-41e4-93eb-a70645cf385c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:22.659496 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700943c-546e-41e4-93eb-a70645cf385c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:22.667653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700943c-546e-41e4-93eb-a70645cf385c service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:22.710461 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1133/2235] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:45:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:45:23.080800 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd85bd14-7de9-4343-b51a-60d04479b83d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:23.082991 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fd85bd14-7de9-4343-b51a-60d04479b83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:23.103517 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd85bd14-7de9-4343-b51a-60d04479b83d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:23.111775 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468d37c-e212-4098-930e-e61aa4d6f71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:23.113133 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468d37c-e212-4098-930e-e61aa4d6f71d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:23.113827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468d37c-e212-4098-930e-e61aa4d6f71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:23.114257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468d37c-e212-4098-930e-e61aa4d6f71d admin admin] PATH_INFO: `/v3/projects/4a4e35f7bcf54ff8b296836d852b48cc` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:23.116443 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468d37c-e212-4098-930e-e61aa4d6f71d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a4e35f7bcf54ff8b296836d852b48cc)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:23.120061 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468d37c-e212-4098-930e-e61aa4d6f71d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:23.197416 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7468d37c-e212-4098-930e-e61aa4d6f71d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a4e35f7bcf54ff8b296836d852b48cc', 'request_id': 'req-7468d37c-e212-4098-930e-e61aa4d6f71d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:45:23.206669 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7468d37c-e212-4098-930e-e61aa4d6f71d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a4e35f7bcf54ff8b296836d852b48cc', 'request_id': 'req-7468d37c-e212-4098-930e-e61aa4d6f71d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:45:23.217418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7468d37c-e212-4098-930e-e61aa4d6f71d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a4e35f7bcf54ff8b296836d852b48cc', 'request_id': 'req-7468d37c-e212-4098-930e-e61aa4d6f71d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:45:23.235416 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7468d37c-e212-4098-930e-e61aa4d6f71d admin admin] The token cache is being invalidate because project 4a4e35f7bcf54ff8b296836d852b48cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:45:23.235727 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7468d37c-e212-4098-930e-e61aa4d6f71d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:45:23.236377 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7468d37c-e212-4098-930e-e61aa4d6f71d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:45:23.240577 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1103/2236] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:45:23 2022] DELETE /identity/v3/projects/4a4e35f7bcf54ff8b296836d852b48cc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:45:32.149997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54354c89-d43e-4e96-b5f3-6dd92176c60e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:32.150560 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54354c89-d43e-4e96-b5f3-6dd92176c60e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:32.150560 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54354c89-d43e-4e96-b5f3-6dd92176c60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:32.173202 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-54354c89-d43e-4e96-b5f3-6dd92176c60e None None] MFA Rules not processed for user `d6a194d68415422fbc6ca75a8dbccf22`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:45:32.174385 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-54354c89-d43e-4e96-b5f3-6dd92176c60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:32.225394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:32.240242 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1134/2237] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:45:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:45:32.564920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468d37c-e212-4098-930e-e61aa4d6f71d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:32.566332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7468d37c-e212-4098-930e-e61aa4d6f71d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:32.623887 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468d37c-e212-4098-930e-e61aa4d6f71d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:32.627448 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a1492-acc0-430a-b475-cd7a82560b58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:32.628084 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a1492-acc0-430a-b475-cd7a82560b58 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:32.628426 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a1492-acc0-430a-b475-cd7a82560b58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:32.628748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a1492-acc0-430a-b475-cd7a82560b58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:32.630557 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a21a1492-acc0-430a-b475-cd7a82560b58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:32.640726 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a1492-acc0-430a-b475-cd7a82560b58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:32.642179 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a1492-acc0-430a-b475-cd7a82560b58 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:32.650402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1104/2238] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:45:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:45:32.957911 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54354c89-d43e-4e96-b5f3-6dd92176c60e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:32.959454 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-54354c89-d43e-4e96-b5f3-6dd92176c60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:33.042810 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54354c89-d43e-4e96-b5f3-6dd92176c60e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:33.047739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf75709-2af8-4899-a1c7-fe4fcea607a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48709a771ab64ed38018873313f37c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:33.048382 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf75709-2af8-4899-a1c7-fe4fcea607a1 service placement] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:33.048701 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf75709-2af8-4899-a1c7-fe4fcea607a1 service placement] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:33.048982 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf75709-2af8-4899-a1c7-fe4fcea607a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:33.050725 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-bdf75709-2af8-4899-a1c7-fe4fcea607a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:33.062376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf75709-2af8-4899-a1c7-fe4fcea607a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:33.063945 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf75709-2af8-4899-a1c7-fe4fcea607a1 service placement] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:33.073639 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1135/2239] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:45:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:45:33.344339 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a1492-acc0-430a-b475-cd7a82560b58 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:33.345924 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a21a1492-acc0-430a-b475-cd7a82560b58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:33.358772 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a1492-acc0-430a-b475-cd7a82560b58 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:33.363063 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274986a6-f3e1-48a1-8d4f-c4d80c1e6cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:33.363703 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274986a6-f3e1-48a1-8d4f-c4d80c1e6cdf service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:33.364018 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274986a6-f3e1-48a1-8d4f-c4d80c1e6cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:33.364255 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274986a6-f3e1-48a1-8d4f-c4d80c1e6cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:33.366475 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-274986a6-f3e1-48a1-8d4f-c4d80c1e6cdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:33.377719 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274986a6-f3e1-48a1-8d4f-c4d80c1e6cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:33.379179 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274986a6-f3e1-48a1-8d4f-c4d80c1e6cdf service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:33.387857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1105/2240] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:45:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:45:37.110563 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf75709-2af8-4899-a1c7-fe4fcea607a1 service placement] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:37.112843 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-bdf75709-2af8-4899-a1c7-fe4fcea607a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:37.214557 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf75709-2af8-4899-a1c7-fe4fcea607a1 service placement] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:37.229846 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae33869-3813-4c80-a8e6-24cb94ed0a9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:37.235701 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae33869-3813-4c80-a8e6-24cb94ed0a9c service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:37.236084 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae33869-3813-4c80-a8e6-24cb94ed0a9c service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:37.236373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae33869-3813-4c80-a8e6-24cb94ed0a9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:37.239204 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-aae33869-3813-4c80-a8e6-24cb94ed0a9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:37.252848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae33869-3813-4c80-a8e6-24cb94ed0a9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:37.254545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae33869-3813-4c80-a8e6-24cb94ed0a9c service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:37.269229 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1136/2241] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:45:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:45:37.756760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274986a6-f3e1-48a1-8d4f-c4d80c1e6cdf service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:37.765966 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274986a6-f3e1-48a1-8d4f-c4d80c1e6cdf service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:37.769531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdce5f9-6c78-495e-bea4-8d0d48faf586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:37.770184 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdce5f9-6c78-495e-bea4-8d0d48faf586 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:37.770473 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdce5f9-6c78-495e-bea4-8d0d48faf586 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:37.770756 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdce5f9-6c78-495e-bea4-8d0d48faf586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:37.772554 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9cdce5f9-6c78-495e-bea4-8d0d48faf586 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:37.781863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdce5f9-6c78-495e-bea4-8d0d48faf586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:37.783349 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdce5f9-6c78-495e-bea4-8d0d48faf586 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:37.791519 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1106/2242] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:45:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:45:37.892409 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d624d-85fc-4312-ba10-635e1109999e None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:37.892777 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d624d-85fc-4312-ba10-635e1109999e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:37.893004 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d624d-85fc-4312-ba10-635e1109999e None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:37.894483 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1137/2243] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 30 10:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:45:37.901971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d8acb-6e15-4788-bb8e-33daddb0315a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:37.902361 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d8acb-6e15-4788-bb8e-33daddb0315a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:37.902703 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d8acb-6e15-4788-bb8e-33daddb0315a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:37.949536 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:37.953386 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-449d8acb-6e15-4788-bb8e-33daddb0315a None None] MFA Rules not processed for user `1bfd036d747241d9bc314b60bf8648b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:45:37.954891 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-449d8acb-6e15-4788-bb8e-33daddb0315a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:37.967299 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1107/2244] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 30 10:45:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:45:37.983558 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d624d-85fc-4312-ba10-635e1109999e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:37.988258 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2a1d624d-85fc-4312-ba10-635e1109999e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:38.078063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:38.081416 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d624d-85fc-4312-ba10-635e1109999e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:38.085271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc6d9a-fff6-416a-8ca9-6db9447796f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2522b8560d224aa1a973207a79ce6a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:38.085984 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc6d9a-fff6-416a-8ca9-6db9447796f4 service glance] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:38.086364 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc6d9a-fff6-416a-8ca9-6db9447796f4 service glance] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:38.086707 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc6d9a-fff6-416a-8ca9-6db9447796f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:38.097404 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc6d9a-fff6-416a-8ca9-6db9447796f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:38.098920 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc6d9a-fff6-416a-8ca9-6db9447796f4 service glance] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:38.112852 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1138/2245] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:45:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:45:38.181433 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28127e51-b732-4296-8fd3-08aee3b0e5ea None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:38.181728 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28127e51-b732-4296-8fd3-08aee3b0e5ea None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:38.182012 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28127e51-b732-4296-8fd3-08aee3b0e5ea None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:38.183395 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1108/2246] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 30 10:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:45:38.188749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c4001-99b4-49f8-a2ef-72920744e0d2 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:38.189043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c4001-99b4-49f8-a2ef-72920744e0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:38.189323 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c4001-99b4-49f8-a2ef-72920744e0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:38.207819 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c37c4001-99b4-49f8-a2ef-72920744e0d2 None None] MFA Rules not processed for user `fa8cb52425ba42d9ae3576e6fb18dc88`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:45:38.209051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c37c4001-99b4-49f8-a2ef-72920744e0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:38.215532 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1139/2247] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 30 10:45:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:45:38.227920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28127e51-b732-4296-8fd3-08aee3b0e5ea None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:38.239393 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28127e51-b732-4296-8fd3-08aee3b0e5ea None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:38.242973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b93b5-1ab4-4984-bec5-d7012207bc06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:38.243603 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b93b5-1ab4-4984-bec5-d7012207bc06 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:38.243889 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b93b5-1ab4-4984-bec5-d7012207bc06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:38.244165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b93b5-1ab4-4984-bec5-d7012207bc06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:38.251619 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b93b5-1ab4-4984-bec5-d7012207bc06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:38.253117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b93b5-1ab4-4984-bec5-d7012207bc06 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:38.263900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1109/2248] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:45:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:45:38.345732 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd28dc-93c5-43e4-a056-e905df3968a2 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:38.346025 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd28dc-93c5-43e4-a056-e905df3968a2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:38.346306 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd28dc-93c5-43e4-a056-e905df3968a2 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:38.347735 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1140/2249] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 30 10:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:45:38.353095 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26175107-3e74-4459-878b-c6cee99ecadf None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:38.353411 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26175107-3e74-4459-878b-c6cee99ecadf None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:38.353690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26175107-3e74-4459-878b-c6cee99ecadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:38.372543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-26175107-3e74-4459-878b-c6cee99ecadf None None] MFA Rules not processed for user `1bfd036d747241d9bc314b60bf8648b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:45:38.374185 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-26175107-3e74-4459-878b-c6cee99ecadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:38.383360 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1110/2250] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 30 10:45:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:45:38.394339 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd28dc-93c5-43e4-a056-e905df3968a2 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:38.405567 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd28dc-93c5-43e4-a056-e905df3968a2 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:38.409089 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684f4c8-66fc-43c8-af66-84b26b7c8f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:38.409713 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684f4c8-66fc-43c8-af66-84b26b7c8f6f service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:38.410003 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684f4c8-66fc-43c8-af66-84b26b7c8f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:38.410282 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684f4c8-66fc-43c8-af66-84b26b7c8f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:38.420198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684f4c8-66fc-43c8-af66-84b26b7c8f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:38.421665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684f4c8-66fc-43c8-af66-84b26b7c8f6f service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:38.432350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1141/2251] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:45:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:45:43.056215 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db0eaf-040c-4ee4-83b1-d77f0621e8fd None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:43.056711 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db0eaf-040c-4ee4-83b1-d77f0621e8fd None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:43.056826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db0eaf-040c-4ee4-83b1-d77f0621e8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:43.074050 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-92db0eaf-040c-4ee4-83b1-d77f0621e8fd None None] MFA Rules not processed for user `a2bd48e6390241448fe2cf098ab64df3`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:45:43.075223 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-92db0eaf-040c-4ee4-83b1-d77f0621e8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:43.131930 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1111/2252] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 30 10:45:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:45:43.144410 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684f4c8-66fc-43c8-af66-84b26b7c8f6f service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:45:43.145837 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e684f4c8-66fc-43c8-af66-84b26b7c8f6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:45:43.213447 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684f4c8-66fc-43c8-af66-84b26b7c8f6f service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:45:43.218509 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471e039-beab-40b1-b4da-e196fbbbcf70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c15327c36c8c49ac87a3b3e9ab49eea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:45:43.219148 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471e039-beab-40b1-b4da-e196fbbbcf70 service swift] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:45:43.219432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471e039-beab-40b1-b4da-e196fbbbcf70 service swift] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:45:43.219709 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471e039-beab-40b1-b4da-e196fbbbcf70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:45:43.227612 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471e039-beab-40b1-b4da-e196fbbbcf70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:45:43.229230 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471e039-beab-40b1-b4da-e196fbbbcf70 service swift] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:45:43.237975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1142/2253] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 30 10:45:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:45:53.125288 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=34 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:45:53.234705 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=45 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:46:07.746950 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db0eaf-040c-4ee4-83b1-d77f0621e8fd None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:46:07.748464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-92db0eaf-040c-4ee4-83b1-d77f0621e8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:46:07.764394 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db0eaf-040c-4ee4-83b1-d77f0621e8fd None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:46:07.770377 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808b216-89f2-4415-b7ef-81a1b2e0b552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:46:07.771013 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808b216-89f2-4415-b7ef-81a1b2e0b552 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:46:07.771295 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808b216-89f2-4415-b7ef-81a1b2e0b552 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:46:07.771572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808b216-89f2-4415-b7ef-81a1b2e0b552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:46:07.773497 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1808b216-89f2-4415-b7ef-81a1b2e0b552 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:46:07.786067 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808b216-89f2-4415-b7ef-81a1b2e0b552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:46:07.787700 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808b216-89f2-4415-b7ef-81a1b2e0b552 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:46:07.798775 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1112/2254] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:46:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:46:10.246085 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cacf50-a33a-4fa5-a6ad-49e45a26a5e0 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:46:10.246585 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cacf50-a33a-4fa5-a6ad-49e45a26a5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:46:10.246696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cacf50-a33a-4fa5-a6ad-49e45a26a5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:46:10.264532 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d3cacf50-a33a-4fa5-a6ad-49e45a26a5e0 None None] MFA Rules not processed for user `a2bd48e6390241448fe2cf098ab64df3`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:46:10.265737 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d3cacf50-a33a-4fa5-a6ad-49e45a26a5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:46:10.272988 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1143/2255] 10.222.0.59 () {58 vars in 967 bytes} [Thu Jun 30 10:46:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:46:10.285077 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808b216-89f2-4415-b7ef-81a1b2e0b552 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:46:10.296291 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808b216-89f2-4415-b7ef-81a1b2e0b552 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:46:10.301764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b641191-de8a-4e84-b0ff-804bec54201b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c15327c36c8c49ac87a3b3e9ab49eea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:46:10.302392 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b641191-de8a-4e84-b0ff-804bec54201b service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:46:10.302678 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b641191-de8a-4e84-b0ff-804bec54201b service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:46:10.302958 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b641191-de8a-4e84-b0ff-804bec54201b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:46:10.311192 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b641191-de8a-4e84-b0ff-804bec54201b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:46:10.313548 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b641191-de8a-4e84-b0ff-804bec54201b service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:46:10.321632 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1113/2256] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 30 10:46:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:46:14.781050 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cacf50-a33a-4fa5-a6ad-49e45a26a5e0 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:46:14.793932 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cacf50-a33a-4fa5-a6ad-49e45a26a5e0 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:46:14.799909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1cea4-c937-41da-a896-9f3d51e17158 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:46:14.800575 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1cea4-c937-41da-a896-9f3d51e17158 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:46:14.800863 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1cea4-c937-41da-a896-9f3d51e17158 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:46:14.801145 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1cea4-c937-41da-a896-9f3d51e17158 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:46:14.802885 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-25f1cea4-c937-41da-a896-9f3d51e17158 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:46:14.860272 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1cea4-c937-41da-a896-9f3d51e17158 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:46:14.861914 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1cea4-c937-41da-a896-9f3d51e17158 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:46:14.870860 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1144/2257] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:46:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:46:20.318413 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=12 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:46:24.866664 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=31 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:46:38.054696 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed7c83-66bb-4209-bb50-e25f3330b867 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:46:38.055210 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed7c83-66bb-4209-bb50-e25f3330b867 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:46:38.055314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed7c83-66bb-4209-bb50-e25f3330b867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:46:38.073154 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3fed7c83-66bb-4209-bb50-e25f3330b867 None None] MFA Rules not processed for user `6c963986b46d4d148fc843b0a1183d69`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:46:38.074355 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3fed7c83-66bb-4209-bb50-e25f3330b867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:46:38.081390 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1114/2258] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:46:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:46:44.018220 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1cea4-c937-41da-a896-9f3d51e17158 service nova] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:46:44.032033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1cea4-c937-41da-a896-9f3d51e17158 service nova] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:46:44.039186 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4ff1e-a948-4196-b5bb-0c5e5272dd40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:46:44.042554 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4ff1e-a948-4196-b5bb-0c5e5272dd40 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:46:44.042849 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4ff1e-a948-4196-b5bb-0c5e5272dd40 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:46:44.043134 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4ff1e-a948-4196-b5bb-0c5e5272dd40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:46:44.045003 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b0a4ff1e-a948-4196-b5bb-0c5e5272dd40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:46:44.057872 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a4ff1e-a948-4196-b5bb-0c5e5272dd40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:46:44.059459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a4ff1e-a948-4196-b5bb-0c5e5272dd40 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:46:44.069981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1145/2259] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:46:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:46:48.068485 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:46:54.065563 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=6 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:47:35.300380 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c4852-cd17-4d60-b3ae-c9e6bd5a4010 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:47:35.300918 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c4852-cd17-4d60-b3ae-c9e6bd5a4010 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:47:35.301024 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c4852-cd17-4d60-b3ae-c9e6bd5a4010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:47:35.318037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-089c4852-cd17-4d60-b3ae-c9e6bd5a4010 None None] MFA Rules not processed for user `f5003e984d58440a80d98405d187eab0`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:47:35.319241 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-089c4852-cd17-4d60-b3ae-c9e6bd5a4010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:47:35.373858 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1115/2260] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:47:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:47:45.367273 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=25 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:48:01.609242 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd77575-6d48-4c75-8c18-80caa502371a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:01.609763 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd77575-6d48-4c75-8c18-80caa502371a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:01.609867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd77575-6d48-4c75-8c18-80caa502371a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:01.627950 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-efd77575-6d48-4c75-8c18-80caa502371a None None] MFA Rules not processed for user `d6a194d68415422fbc6ca75a8dbccf22`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:48:01.629175 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-efd77575-6d48-4c75-8c18-80caa502371a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:48:01.635968 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1146/2261] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:48:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:48:07.190066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c4852-cd17-4d60-b3ae-c9e6bd5a4010 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:07.203257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c4852-cd17-4d60-b3ae-c9e6bd5a4010 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:07.207040 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799ca8e-c0d4-4d17-b49f-1523618880e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:07.207690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799ca8e-c0d4-4d17-b49f-1523618880e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:07.207977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799ca8e-c0d4-4d17-b49f-1523618880e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:07.208258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799ca8e-c0d4-4d17-b49f-1523618880e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:07.210229 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0799ca8e-c0d4-4d17-b49f-1523618880e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:48:07.282170 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799ca8e-c0d4-4d17-b49f-1523618880e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:07.283626 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799ca8e-c0d4-4d17-b49f-1523618880e8 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:07.293922 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1116/2262] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:48:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:48:10.834293 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd77575-6d48-4c75-8c18-80caa502371a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:10.836670 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-efd77575-6d48-4c75-8c18-80caa502371a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:48:10.862175 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd77575-6d48-4c75-8c18-80caa502371a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:10.879904 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66826ac-399e-421f-a39e-68564bf3b4d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48709a771ab64ed38018873313f37c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:10.880905 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66826ac-399e-421f-a39e-68564bf3b4d7 service placement] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:10.881685 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66826ac-399e-421f-a39e-68564bf3b4d7 service placement] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:10.882300 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66826ac-399e-421f-a39e-68564bf3b4d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:10.884736 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b66826ac-399e-421f-a39e-68564bf3b4d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:48:10.901792 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66826ac-399e-421f-a39e-68564bf3b4d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:10.903847 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66826ac-399e-421f-a39e-68564bf3b4d7 service placement] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:10.917881 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799ca8e-c0d4-4d17-b49f-1523618880e8 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:10.919410 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1147/2263] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:48:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:48:10.920049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0799ca8e-c0d4-4d17-b49f-1523618880e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:48:10.943298 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799ca8e-c0d4-4d17-b49f-1523618880e8 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:10.946066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ffd61-6578-4f47-9ed8-d87f5bf6007e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:10.952241 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ffd61-6578-4f47-9ed8-d87f5bf6007e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:10.952759 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ffd61-6578-4f47-9ed8-d87f5bf6007e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:10.953361 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ffd61-6578-4f47-9ed8-d87f5bf6007e admin admin] PATH_INFO: `/v3/users/6c963986b46d4d148fc843b0a1183d69` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:10.954855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ffd61-6578-4f47-9ed8-d87f5bf6007e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c963986b46d4d148fc843b0a1183d69)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:10.957374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ffd61-6578-4f47-9ed8-d87f5bf6007e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:11.017813 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0a4ffd61-6578-4f47-9ed8-d87f5bf6007e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c963986b46d4d148fc843b0a1183d69'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:11.018566 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0a4ffd61-6578-4f47-9ed8-d87f5bf6007e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c963986b46d4d148fc843b0a1183d69'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:11.025682 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0a4ffd61-6578-4f47-9ed8-d87f5bf6007e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c963986b46d4d148fc843b0a1183d69'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:11.026318 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0a4ffd61-6578-4f47-9ed8-d87f5bf6007e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c963986b46d4d148fc843b0a1183d69'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:11.034119 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0a4ffd61-6578-4f47-9ed8-d87f5bf6007e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c963986b46d4d148fc843b0a1183d69'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:11.053810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1117/2264] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:48:10 2022] DELETE /identity/v3/users/6c963986b46d4d148fc843b0a1183d69 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:48:11.235717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66826ac-399e-421f-a39e-68564bf3b4d7 service placement] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:11.246416 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66826ac-399e-421f-a39e-68564bf3b4d7 service placement] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:11.318972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1ccd8-0da9-43de-98dc-99b1c25acb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:11.319846 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1ccd8-0da9-43de-98dc-99b1c25acb28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:11.320129 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1ccd8-0da9-43de-98dc-99b1c25acb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:11.320405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1ccd8-0da9-43de-98dc-99b1c25acb28 admin admin] PATH_INFO: `/v3/projects/0e38b1cc4c0d45a8b38ba7b670f83c79` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:11.322293 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1ccd8-0da9-43de-98dc-99b1c25acb28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e38b1cc4c0d45a8b38ba7b670f83c79)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:11.324240 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1ccd8-0da9-43de-98dc-99b1c25acb28 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:11.375923 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a5a1ccd8-0da9-43de-98dc-99b1c25acb28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'request_id': 'req-a5a1ccd8-0da9-43de-98dc-99b1c25acb28'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:11.384857 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a5a1ccd8-0da9-43de-98dc-99b1c25acb28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'request_id': 'req-a5a1ccd8-0da9-43de-98dc-99b1c25acb28'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:11.392120 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a5a1ccd8-0da9-43de-98dc-99b1c25acb28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e38b1cc4c0d45a8b38ba7b670f83c79', 'request_id': 'req-a5a1ccd8-0da9-43de-98dc-99b1c25acb28'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:11.404390 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a5a1ccd8-0da9-43de-98dc-99b1c25acb28 admin admin] The token cache is being invalidate because project 0e38b1cc4c0d45a8b38ba7b670f83c79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:48:11.405364 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a5a1ccd8-0da9-43de-98dc-99b1c25acb28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:11.406167 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a5a1ccd8-0da9-43de-98dc-99b1c25acb28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:11.408233 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1148/2265] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:48:11 2022] DELETE /identity/v3/projects/0e38b1cc4c0d45a8b38ba7b670f83c79 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:48:11.419395 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ee5ac-ed9a-4e54-a01f-1e510898b7b5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:11.419775 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ee5ac-ed9a-4e54-a01f-1e510898b7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:11.420125 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ee5ac-ed9a-4e54-a01f-1e510898b7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:11.440046 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-307ee5ac-ed9a-4e54-a01f-1e510898b7b5 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:48:11.441539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-307ee5ac-ed9a-4e54-a01f-1e510898b7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:48:11.528979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1118/2266] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:48:11.531638 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60615d14-7e4b-404b-9937-94bd0b93303e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:11.531922 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60615d14-7e4b-404b-9937-94bd0b93303e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:11.532482 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60615d14-7e4b-404b-9937-94bd0b93303e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:11.554169 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-60615d14-7e4b-404b-9937-94bd0b93303e None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:48:11.555619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-60615d14-7e4b-404b-9937-94bd0b93303e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:48:11.568782 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1149/2267] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:48:11.569102 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ee5ac-ed9a-4e54-a01f-1e510898b7b5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:11.583122 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ee5ac-ed9a-4e54-a01f-1e510898b7b5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:11.588195 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f5106-152f-4cf6-a482-e4257ad65d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:11.589021 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f5106-152f-4cf6-a482-e4257ad65d81 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:11.589413 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f5106-152f-4cf6-a482-e4257ad65d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:11.589825 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f5106-152f-4cf6-a482-e4257ad65d81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:11.590812 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f5106-152f-4cf6-a482-e4257ad65d81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:48:11.591195 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f5106-152f-4cf6-a482-e4257ad65d81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:11.593546 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f5106-152f-4cf6-a482-e4257ad65d81 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:11.595384 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:48:11.613439 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60615d14-7e4b-404b-9937-94bd0b93303e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:11.615437 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1119/2268] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:48:11.623637 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60615d14-7e4b-404b-9937-94bd0b93303e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:11.628307 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf173b95-13ac-45f0-88c3-8b8d3840bff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:11.629021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf173b95-13ac-45f0-88c3-8b8d3840bff9 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:11.629298 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf173b95-13ac-45f0-88c3-8b8d3840bff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:11.629569 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf173b95-13ac-45f0-88c3-8b8d3840bff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:11.630249 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf173b95-13ac-45f0-88c3-8b8d3840bff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:11.632142 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf173b95-13ac-45f0-88c3-8b8d3840bff9 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:11.668379 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1150/2269] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:48:11 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:48:11.672518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f5106-152f-4cf6-a482-e4257ad65d81 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:11.682663 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f5106-152f-4cf6-a482-e4257ad65d81 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:11.740806 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b9cd2-8deb-4956-b9c4-f08ff905a051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:11.741480 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b9cd2-8deb-4956-b9c4-f08ff905a051 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:11.741765 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b9cd2-8deb-4956-b9c4-f08ff905a051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:11.742045 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b9cd2-8deb-4956-b9c4-f08ff905a051 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:11.742737 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b9cd2-8deb-4956-b9c4-f08ff905a051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:11.744714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b9cd2-8deb-4956-b9c4-f08ff905a051 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:11.765863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1120/2270] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:48:11 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:48:11.770079 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf173b95-13ac-45f0-88c3-8b8d3840bff9 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:11.782874 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf173b95-13ac-45f0-88c3-8b8d3840bff9 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:11.787653 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fb653-cac5-4362-abbd-eeee85366865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:11.788395 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fb653-cac5-4362-abbd-eeee85366865 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:11.788777 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fb653-cac5-4362-abbd-eeee85366865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:11.789216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fb653-cac5-4362-abbd-eeee85366865 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:11.790014 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fb653-cac5-4362-abbd-eeee85366865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:11.791681 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fb653-cac5-4362-abbd-eeee85366865 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:11.802091 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1151/2271] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:48:11.806159 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b9cd2-8deb-4956-b9c4-f08ff905a051 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:11.816330 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b9cd2-8deb-4956-b9c4-f08ff905a051 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:11.820910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c82af9-fcd8-450a-9ed8-11857d0076c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:11.821555 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c82af9-fcd8-450a-9ed8-11857d0076c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:11.821837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c82af9-fcd8-450a-9ed8-11857d0076c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:11.822131 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c82af9-fcd8-450a-9ed8-11857d0076c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:11.822837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c82af9-fcd8-450a-9ed8-11857d0076c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:11.824441 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c82af9-fcd8-450a-9ed8-11857d0076c8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:11.834992 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1121/2272] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:48:11.839411 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fb653-cac5-4362-abbd-eeee85366865 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:11.850131 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fb653-cac5-4362-abbd-eeee85366865 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:11.854622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f099c9-e7be-4d78-910e-1d0f9ba260b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:11.855485 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f099c9-e7be-4d78-910e-1d0f9ba260b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:11.855767 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f099c9-e7be-4d78-910e-1d0f9ba260b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:11.856034 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f099c9-e7be-4d78-910e-1d0f9ba260b5 admin admin] PATH_INFO: `/v3/projects/6bfb75761344407b8abec607c2feacae/users/8f5f1fc4c210434cb49a04e621ed7f84/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:11.870667 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f099c9-e7be-4d78-910e-1d0f9ba260b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bfb75761344407b8abec607c2feacae, user_id=8f5f1fc4c210434cb49a04e621ed7f84, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:11.873346 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f099c9-e7be-4d78-910e-1d0f9ba260b5 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:11.881735 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:48:11.888467 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1152/2273] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:48:11 2022] PUT /identity/v3/projects/6bfb75761344407b8abec607c2feacae/users/8f5f1fc4c210434cb49a04e621ed7f84/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:48:11.899045 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29ac12-b01a-4b39-9bd8-a8a463a25580 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:11.899336 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29ac12-b01a-4b39-9bd8-a8a463a25580 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:11.899617 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29ac12-b01a-4b39-9bd8-a8a463a25580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:11.926630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-fc29ac12-b01a-4b39-9bd8-a8a463a25580 None None] MFA Rules not processed for user `8f5f1fc4c210434cb49a04e621ed7f84`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:48:11.927836 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fc29ac12-b01a-4b39-9bd8-a8a463a25580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:48:11.993178 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1122/2274] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:48:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:48:11.997575 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f099c9-e7be-4d78-910e-1d0f9ba260b5 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:12.060313 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f099c9-e7be-4d78-910e-1d0f9ba260b5 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:12.065441 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a5b8c-a3de-4e8d-a586-0f319587958d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:12.066126 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a5b8c-a3de-4e8d-a586-0f319587958d admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:12.066412 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a5b8c-a3de-4e8d-a586-0f319587958d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:12.066692 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a5b8c-a3de-4e8d-a586-0f319587958d admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:12.067380 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a5b8c-a3de-4e8d-a586-0f319587958d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:12.069320 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a5b8c-a3de-4e8d-a586-0f319587958d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:12.095431 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1153/2275] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:48:11 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:48:12.099435 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29ac12-b01a-4b39-9bd8-a8a463a25580 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:12.110539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29ac12-b01a-4b39-9bd8-a8a463a25580 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:12.166582 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95141fa0-61f6-47e7-a7f2-1d23f7c3d8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:12.167236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95141fa0-61f6-47e7-a7f2-1d23f7c3d8a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:12.167518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95141fa0-61f6-47e7-a7f2-1d23f7c3d8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:12.167792 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95141fa0-61f6-47e7-a7f2-1d23f7c3d8a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:12.168475 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95141fa0-61f6-47e7-a7f2-1d23f7c3d8a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:12.170492 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95141fa0-61f6-47e7-a7f2-1d23f7c3d8a8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:12.178501 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:48:12.192822 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1123/2276] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:48:12 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:48:12.196787 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a5b8c-a3de-4e8d-a586-0f319587958d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:12.207339 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a5b8c-a3de-4e8d-a586-0f319587958d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:12.211888 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6025f-a099-44d9-831e-d5ffc4ed44b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:12.212566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6025f-a099-44d9-831e-d5ffc4ed44b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:12.212847 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6025f-a099-44d9-831e-d5ffc4ed44b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:12.213124 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6025f-a099-44d9-831e-d5ffc4ed44b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:12.213848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6025f-a099-44d9-831e-d5ffc4ed44b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:12.215422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6025f-a099-44d9-831e-d5ffc4ed44b3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:12.225937 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1154/2277] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:48:12.230135 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95141fa0-61f6-47e7-a7f2-1d23f7c3d8a8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:12.240611 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95141fa0-61f6-47e7-a7f2-1d23f7c3d8a8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:12.245245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e0948-80a2-4a4d-9ee9-9baec4be8860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:12.246104 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e0948-80a2-4a4d-9ee9-9baec4be8860 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:12.246387 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e0948-80a2-4a4d-9ee9-9baec4be8860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:12.246663 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e0948-80a2-4a4d-9ee9-9baec4be8860 admin admin] PATH_INFO: `/v3/projects/862cd57074824b88bd0b2af902023388/users/2c5b46ff6f1047a59db075f4534e2de0/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:12.268204 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e0948-80a2-4a4d-9ee9-9baec4be8860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=862cd57074824b88bd0b2af902023388, user_id=2c5b46ff6f1047a59db075f4534e2de0, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:12.270958 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e0948-80a2-4a4d-9ee9-9baec4be8860 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:12.289447 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1124/2278] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:48:12 2022] PUT /identity/v3/projects/862cd57074824b88bd0b2af902023388/users/2c5b46ff6f1047a59db075f4534e2de0/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:48:12.295118 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6025f-a099-44d9-831e-d5ffc4ed44b3 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:12.307312 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6025f-a099-44d9-831e-d5ffc4ed44b3 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:12.368628 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd28c31-8848-4ea3-b240-b749b99ff0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:12.369305 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd28c31-8848-4ea3-b240-b749b99ff0cb admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:12.369588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd28c31-8848-4ea3-b240-b749b99ff0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:12.369883 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd28c31-8848-4ea3-b240-b749b99ff0cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:12.370643 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd28c31-8848-4ea3-b240-b749b99ff0cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:12.372241 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd28c31-8848-4ea3-b240-b749b99ff0cb admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:12.384425 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1155/2279] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:48:12.388571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e0948-80a2-4a4d-9ee9-9baec4be8860 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:12.400588 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e0948-80a2-4a4d-9ee9-9baec4be8860 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:12.405999 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d8b46-ef52-434f-9b77-da1851c4d53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:12.407072 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d8b46-ef52-434f-9b77-da1851c4d53f admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:12.407867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d8b46-ef52-434f-9b77-da1851c4d53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:12.407867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d8b46-ef52-434f-9b77-da1851c4d53f admin admin] PATH_INFO: `/v3/projects/862cd57074824b88bd0b2af902023388/users/2c5b46ff6f1047a59db075f4534e2de0/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:12.410036 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d8b46-ef52-434f-9b77-da1851c4d53f admin admin] RBAC: Authorizing `identity:create_grant(project_id=862cd57074824b88bd0b2af902023388, user_id=2c5b46ff6f1047a59db075f4534e2de0, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:12.412940 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d8b46-ef52-434f-9b77-da1851c4d53f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:12.424566 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1125/2280] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:48:12 2022] PUT /identity/v3/projects/862cd57074824b88bd0b2af902023388/users/2c5b46ff6f1047a59db075f4534e2de0/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:48:12.434798 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30237284-4949-4b48-9436-3453740daf58 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:12.435157 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30237284-4949-4b48-9436-3453740daf58 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:12.435505 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30237284-4949-4b48-9436-3453740daf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:12.462271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-30237284-4949-4b48-9436-3453740daf58 None None] MFA Rules not processed for user `2c5b46ff6f1047a59db075f4534e2de0`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:48:12.463466 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-30237284-4949-4b48-9436-3453740daf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:48:12.520888 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:48:12.532045 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1156/2281] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:48:12 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:48:12.543151 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d8b46-ef52-434f-9b77-da1851c4d53f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:12.544900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a33d8b46-ef52-434f-9b77-da1851c4d53f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:48:12.605055 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d8b46-ef52-434f-9b77-da1851c4d53f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:12.609483 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4c412-a4c4-4c52-bc24-b206bf75abbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:12.610127 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4c412-a4c4-4c52-bc24-b206bf75abbf service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:12.610412 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4c412-a4c4-4c52-bc24-b206bf75abbf service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:12.610691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4c412-a4c4-4c52-bc24-b206bf75abbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:12.620308 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4c412-a4c4-4c52-bc24-b206bf75abbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:12.622290 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4c412-a4c4-4c52-bc24-b206bf75abbf service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:12.633372 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1126/2282] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:48:12 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:48:12.711093 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30237284-4949-4b48-9436-3453740daf58 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:12.721272 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30237284-4949-4b48-9436-3453740daf58 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:12.725012 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2273319-a6a1-4ca0-ba9c-a0616c67cfc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:12.725658 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2273319-a6a1-4ca0-ba9c-a0616c67cfc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:12.726425 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2273319-a6a1-4ca0-ba9c-a0616c67cfc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:12.726425 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2273319-a6a1-4ca0-ba9c-a0616c67cfc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:12.788313 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2273319-a6a1-4ca0-ba9c-a0616c67cfc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:12.789810 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2273319-a6a1-4ca0-ba9c-a0616c67cfc8 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:12.799310 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1157/2283] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:48:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:48:22.629422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:INSERT=4,keystone:SELECT=43 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:48:22.794738 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=31 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:48:57.032880 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4c412-a4c4-4c52-bc24-b206bf75abbf service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:57.094237 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4c412-a4c4-4c52-bc24-b206bf75abbf service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:57.098769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a146bd0-76c1-4df5-a7d6-ef13a18d00cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:57.099620 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a146bd0-76c1-4df5-a7d6-ef13a18d00cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:57.099907 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a146bd0-76c1-4df5-a7d6-ef13a18d00cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:57.100187 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a146bd0-76c1-4df5-a7d6-ef13a18d00cd admin admin] PATH_INFO: `/v3/users/8f5f1fc4c210434cb49a04e621ed7f84` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:57.101377 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a146bd0-76c1-4df5-a7d6-ef13a18d00cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f5f1fc4c210434cb49a04e621ed7f84)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:57.103445 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a146bd0-76c1-4df5-a7d6-ef13a18d00cd admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:57.151181 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9a146bd0-76c1-4df5-a7d6-ef13a18d00cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f5f1fc4c210434cb49a04e621ed7f84'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:57.152110 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9a146bd0-76c1-4df5-a7d6-ef13a18d00cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f5f1fc4c210434cb49a04e621ed7f84'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:57.159583 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9a146bd0-76c1-4df5-a7d6-ef13a18d00cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f5f1fc4c210434cb49a04e621ed7f84'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:57.160396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9a146bd0-76c1-4df5-a7d6-ef13a18d00cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f5f1fc4c210434cb49a04e621ed7f84'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:57.167676 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9a146bd0-76c1-4df5-a7d6-ef13a18d00cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f5f1fc4c210434cb49a04e621ed7f84'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:57.185078 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1127/2284] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:48:57 2022] DELETE /identity/v3/users/8f5f1fc4c210434cb49a04e621ed7f84 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:48:57.190160 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86de616-3be6-4374-a94e-b8ea7dda6cc2 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:57.190666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86de616-3be6-4374-a94e-b8ea7dda6cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:57.190771 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86de616-3be6-4374-a94e-b8ea7dda6cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:57.207229 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b86de616-3be6-4374-a94e-b8ea7dda6cc2 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:48:57.208443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b86de616-3be6-4374-a94e-b8ea7dda6cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:48:57.266660 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1158/2285] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:48:57.276244 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a146bd0-76c1-4df5-a7d6-ef13a18d00cd admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:57.277726 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9a146bd0-76c1-4df5-a7d6-ef13a18d00cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:48:57.334055 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a146bd0-76c1-4df5-a7d6-ef13a18d00cd admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:57.337704 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f272f-2ecb-4f2b-85c3-2065c4b04f40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:57.338338 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f272f-2ecb-4f2b-85c3-2065c4b04f40 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:57.338622 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f272f-2ecb-4f2b-85c3-2065c4b04f40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:57.338901 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f272f-2ecb-4f2b-85c3-2065c4b04f40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:57.347792 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f272f-2ecb-4f2b-85c3-2065c4b04f40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:57.349258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f272f-2ecb-4f2b-85c3-2065c4b04f40 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:57.358853 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1128/2286] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:48:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:48:57.626545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86de616-3be6-4374-a94e-b8ea7dda6cc2 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:57.627974 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b86de616-3be6-4374-a94e-b8ea7dda6cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:48:57.640066 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86de616-3be6-4374-a94e-b8ea7dda6cc2 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:57.645260 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a77cd1-b0a0-4f22-a44a-6f9edfff3864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:57.646098 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a77cd1-b0a0-4f22-a44a-6f9edfff3864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:57.646379 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a77cd1-b0a0-4f22-a44a-6f9edfff3864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:57.646777 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a77cd1-b0a0-4f22-a44a-6f9edfff3864 admin admin] PATH_INFO: `/v3/projects/6bfb75761344407b8abec607c2feacae` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:57.647875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a77cd1-b0a0-4f22-a44a-6f9edfff3864 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bfb75761344407b8abec607c2feacae)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:57.649825 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a77cd1-b0a0-4f22-a44a-6f9edfff3864 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:57.699430 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-60a77cd1-b0a0-4f22-a44a-6f9edfff3864 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bfb75761344407b8abec607c2feacae', 'request_id': 'req-60a77cd1-b0a0-4f22-a44a-6f9edfff3864'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:57.706550 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-60a77cd1-b0a0-4f22-a44a-6f9edfff3864 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bfb75761344407b8abec607c2feacae', 'request_id': 'req-60a77cd1-b0a0-4f22-a44a-6f9edfff3864'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:57.712631 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-60a77cd1-b0a0-4f22-a44a-6f9edfff3864 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bfb75761344407b8abec607c2feacae', 'request_id': 'req-60a77cd1-b0a0-4f22-a44a-6f9edfff3864'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:57.723028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-60a77cd1-b0a0-4f22-a44a-6f9edfff3864 admin admin] The token cache is being invalidate because project 6bfb75761344407b8abec607c2feacae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:48:57.723306 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-60a77cd1-b0a0-4f22-a44a-6f9edfff3864 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:57.723920 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-60a77cd1-b0a0-4f22-a44a-6f9edfff3864 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:57.725473 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1159/2287] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:48:57 2022] DELETE /identity/v3/projects/6bfb75761344407b8abec607c2feacae => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:48:57.729382 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f272f-2ecb-4f2b-85c3-2065c4b04f40 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:57.739920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f272f-2ecb-4f2b-85c3-2065c4b04f40 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:57.757617 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:48:57.796834 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7670cbb-febd-4c17-bcb9-72ccfc6e33bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:57.797693 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7670cbb-febd-4c17-bcb9-72ccfc6e33bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:57.797983 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7670cbb-febd-4c17-bcb9-72ccfc6e33bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:57.798400 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7670cbb-febd-4c17-bcb9-72ccfc6e33bd admin admin] PATH_INFO: `/v3/users/2c5b46ff6f1047a59db075f4534e2de0` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:57.799587 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7670cbb-febd-4c17-bcb9-72ccfc6e33bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c5b46ff6f1047a59db075f4534e2de0)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:57.801620 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7670cbb-febd-4c17-bcb9-72ccfc6e33bd admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:57.847807 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e7670cbb-febd-4c17-bcb9-72ccfc6e33bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c5b46ff6f1047a59db075f4534e2de0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:57.848464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e7670cbb-febd-4c17-bcb9-72ccfc6e33bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c5b46ff6f1047a59db075f4534e2de0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:57.855471 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e7670cbb-febd-4c17-bcb9-72ccfc6e33bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c5b46ff6f1047a59db075f4534e2de0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:57.856211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e7670cbb-febd-4c17-bcb9-72ccfc6e33bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c5b46ff6f1047a59db075f4534e2de0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:57.863433 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e7670cbb-febd-4c17-bcb9-72ccfc6e33bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c5b46ff6f1047a59db075f4534e2de0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:57.880732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1129/2288] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:48:57 2022] DELETE /identity/v3/users/2c5b46ff6f1047a59db075f4534e2de0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:48:58.157225 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a77cd1-b0a0-4f22-a44a-6f9edfff3864 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:58.159500 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-60a77cd1-b0a0-4f22-a44a-6f9edfff3864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:48:58.173160 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a77cd1-b0a0-4f22-a44a-6f9edfff3864 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:58.231143 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6a6b1-65a9-4f8b-a8ec-d07ff83660f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:58.231935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6a6b1-65a9-4f8b-a8ec-d07ff83660f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:58.232217 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6a6b1-65a9-4f8b-a8ec-d07ff83660f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:58.232781 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6a6b1-65a9-4f8b-a8ec-d07ff83660f8 admin admin] PATH_INFO: `/v3/projects/862cd57074824b88bd0b2af902023388` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:58.233952 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6a6b1-65a9-4f8b-a8ec-d07ff83660f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=862cd57074824b88bd0b2af902023388)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:58.235903 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6a6b1-65a9-4f8b-a8ec-d07ff83660f8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:58.268514 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:48:58.285787 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9de6a6b1-65a9-4f8b-a8ec-d07ff83660f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '862cd57074824b88bd0b2af902023388', 'request_id': 'req-9de6a6b1-65a9-4f8b-a8ec-d07ff83660f8'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:58.293232 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9de6a6b1-65a9-4f8b-a8ec-d07ff83660f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '862cd57074824b88bd0b2af902023388', 'request_id': 'req-9de6a6b1-65a9-4f8b-a8ec-d07ff83660f8'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:58.300233 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9de6a6b1-65a9-4f8b-a8ec-d07ff83660f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '862cd57074824b88bd0b2af902023388', 'request_id': 'req-9de6a6b1-65a9-4f8b-a8ec-d07ff83660f8'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:58.310253 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9de6a6b1-65a9-4f8b-a8ec-d07ff83660f8 admin admin] The token cache is being invalidate because project 862cd57074824b88bd0b2af902023388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:48:58.310535 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9de6a6b1-65a9-4f8b-a8ec-d07ff83660f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:58.311151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9de6a6b1-65a9-4f8b-a8ec-d07ff83660f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:48:58.312706 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1160/2289] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:48:58 2022] DELETE /identity/v3/projects/862cd57074824b88bd0b2af902023388 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:48:58.318193 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0da32-fed0-4f50-ac0c-819b12ab73e9 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:58.318639 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0da32-fed0-4f50-ac0c-819b12ab73e9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:58.318785 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0da32-fed0-4f50-ac0c-819b12ab73e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:58.337199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-24a0da32-fed0-4f50-ac0c-819b12ab73e9 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:48:58.338386 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-24a0da32-fed0-4f50-ac0c-819b12ab73e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:48:58.396441 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1130/2290] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:48:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:48:58.403993 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7916ac2-06f0-4fdf-a751-c9a6989e49b8 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:58.404313 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7916ac2-06f0-4fdf-a751-c9a6989e49b8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:58.404625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7916ac2-06f0-4fdf-a751-c9a6989e49b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:58.422978 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b7916ac2-06f0-4fdf-a751-c9a6989e49b8 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:48:58.424263 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b7916ac2-06f0-4fdf-a751-c9a6989e49b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:48:58.432095 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1161/2291] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:48:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:48:58.436211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0da32-fed0-4f50-ac0c-819b12ab73e9 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:58.446590 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0da32-fed0-4f50-ac0c-819b12ab73e9 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:58.451521 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4621861-576f-4683-b64f-5f128356af6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:58.452209 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4621861-576f-4683-b64f-5f128356af6e admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:58.452497 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4621861-576f-4683-b64f-5f128356af6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:58.452814 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4621861-576f-4683-b64f-5f128356af6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:58.453537 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4621861-576f-4683-b64f-5f128356af6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:48:58.453850 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4621861-576f-4683-b64f-5f128356af6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:58.455577 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4621861-576f-4683-b64f-5f128356af6e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:58.467315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1131/2292] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:48:58.472148 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7916ac2-06f0-4fdf-a751-c9a6989e49b8 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:58.481223 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7916ac2-06f0-4fdf-a751-c9a6989e49b8 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:58.486593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd13518-617b-4384-bb31-710952589db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:58.487228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd13518-617b-4384-bb31-710952589db7 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:58.487510 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd13518-617b-4384-bb31-710952589db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:58.487789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd13518-617b-4384-bb31-710952589db7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:58.488479 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd13518-617b-4384-bb31-710952589db7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:58.490394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd13518-617b-4384-bb31-710952589db7 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:58.514694 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1162/2293] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:48:58 2022] POST /identity/v3/projects => generated 357 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:48:58.519692 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4621861-576f-4683-b64f-5f128356af6e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:58.529630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4621861-576f-4683-b64f-5f128356af6e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:58.556234 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:48:58.587828 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e8b51-6fe0-44e0-ba30-02e907f15d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:58.588476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e8b51-6fe0-44e0-ba30-02e907f15d35 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:58.588790 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e8b51-6fe0-44e0-ba30-02e907f15d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:58.589063 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e8b51-6fe0-44e0-ba30-02e907f15d35 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:58.589740 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e8b51-6fe0-44e0-ba30-02e907f15d35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:58.591660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e8b51-6fe0-44e0-ba30-02e907f15d35 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:58.611847 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1132/2294] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:48:58 2022] POST /identity/v3/users => generated 279 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:48:58.616162 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd13518-617b-4384-bb31-710952589db7 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:58.626096 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd13518-617b-4384-bb31-710952589db7 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:58.630620 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ef97e-b691-43f2-9bbe-19c1bf5bc100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:58.631260 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ef97e-b691-43f2-9bbe-19c1bf5bc100 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:58.631539 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ef97e-b691-43f2-9bbe-19c1bf5bc100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:58.631809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ef97e-b691-43f2-9bbe-19c1bf5bc100 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:58.632545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ef97e-b691-43f2-9bbe-19c1bf5bc100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:58.634114 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ef97e-b691-43f2-9bbe-19c1bf5bc100 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:58.644147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1163/2295] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:48:58.647907 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e8b51-6fe0-44e0-ba30-02e907f15d35 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:58.658587 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e8b51-6fe0-44e0-ba30-02e907f15d35 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:58.663188 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c00b28-2e4b-4a09-8a43-a3a9be6277b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:58.663833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c00b28-2e4b-4a09-8a43-a3a9be6277b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:58.664121 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c00b28-2e4b-4a09-8a43-a3a9be6277b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:58.664404 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c00b28-2e4b-4a09-8a43-a3a9be6277b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:58.665155 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c00b28-2e4b-4a09-8a43-a3a9be6277b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:58.666754 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c00b28-2e4b-4a09-8a43-a3a9be6277b1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:58.677566 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1133/2296] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:48:58.681420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ef97e-b691-43f2-9bbe-19c1bf5bc100 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:58.690952 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ef97e-b691-43f2-9bbe-19c1bf5bc100 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:58.695483 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd76834-d563-4ef7-8df3-a86bce431f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:58.696333 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd76834-d563-4ef7-8df3-a86bce431f81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:58.696643 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd76834-d563-4ef7-8df3-a86bce431f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:58.696912 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd76834-d563-4ef7-8df3-a86bce431f81 admin admin] PATH_INFO: `/v3/projects/bfdff4360fa841ce854cc5c143b9c719/users/74fe19f20a9a4c75a49ee98631d93856/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:58.711308 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd76834-d563-4ef7-8df3-a86bce431f81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfdff4360fa841ce854cc5c143b9c719, user_id=74fe19f20a9a4c75a49ee98631d93856, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:58.713971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd76834-d563-4ef7-8df3-a86bce431f81 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:58.726322 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1164/2297] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:48:58 2022] PUT /identity/v3/projects/bfdff4360fa841ce854cc5c143b9c719/users/74fe19f20a9a4c75a49ee98631d93856/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:48:58.737883 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936f5e7-99d3-424b-b9fa-8435537b6ee5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:58.738108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936f5e7-99d3-424b-b9fa-8435537b6ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:58.738393 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936f5e7-99d3-424b-b9fa-8435537b6ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:58.763952 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b936f5e7-99d3-424b-b9fa-8435537b6ee5 None None] MFA Rules not processed for user `74fe19f20a9a4c75a49ee98631d93856`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:48:58.765173 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b936f5e7-99d3-424b-b9fa-8435537b6ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:48:58.827425 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1134/2298] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:48:58 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:48:58.832405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd76834-d563-4ef7-8df3-a86bce431f81 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:58.891175 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd76834-d563-4ef7-8df3-a86bce431f81 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:58.896437 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f58464-11ea-4590-b779-c180d3b8bda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:58.897112 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f58464-11ea-4590-b779-c180d3b8bda6 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:58.897398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f58464-11ea-4590-b779-c180d3b8bda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:58.897678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f58464-11ea-4590-b779-c180d3b8bda6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:58.898371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f58464-11ea-4590-b779-c180d3b8bda6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:58.900288 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f58464-11ea-4590-b779-c180d3b8bda6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:58.924979 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1165/2299] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:48:58 2022] POST /identity/v3/projects => generated 357 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:48:58.929065 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936f5e7-99d3-424b-b9fa-8435537b6ee5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:58.939991 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936f5e7-99d3-424b-b9fa-8435537b6ee5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:58.997864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52a411-6258-456c-ab27-d7b51d209e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:58.998565 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52a411-6258-456c-ab27-d7b51d209e24 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:58.998915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52a411-6258-456c-ab27-d7b51d209e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:58.999262 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52a411-6258-456c-ab27-d7b51d209e24 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:59.000031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52a411-6258-456c-ab27-d7b51d209e24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:59.002806 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52a411-6258-456c-ab27-d7b51d209e24 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:59.025641 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1135/2300] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:48:58 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:48:59.028768 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f58464-11ea-4590-b779-c180d3b8bda6 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:59.039680 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f58464-11ea-4590-b779-c180d3b8bda6 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:59.044401 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1a42e-7303-49cc-ac59-86d8261a813b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:59.045179 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1a42e-7303-49cc-ac59-86d8261a813b admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:59.045388 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1a42e-7303-49cc-ac59-86d8261a813b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:59.045661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1a42e-7303-49cc-ac59-86d8261a813b admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:59.046442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1a42e-7303-49cc-ac59-86d8261a813b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:59.048527 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1a42e-7303-49cc-ac59-86d8261a813b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:59.059315 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1166/2301] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:48:59.063632 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52a411-6258-456c-ab27-d7b51d209e24 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:59.074308 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52a411-6258-456c-ab27-d7b51d209e24 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:59.079172 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d4f37-11f9-4a19-9f27-c68d5ee0f104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:59.080111 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d4f37-11f9-4a19-9f27-c68d5ee0f104 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:59.080461 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d4f37-11f9-4a19-9f27-c68d5ee0f104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:59.080837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d4f37-11f9-4a19-9f27-c68d5ee0f104 admin admin] PATH_INFO: `/v3/projects/f52b7c63ab944e7fbd1212c1197a132a/users/9a5b8b4f10d24ee487d48886a2bda56d/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:59.101459 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d4f37-11f9-4a19-9f27-c68d5ee0f104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f52b7c63ab944e7fbd1212c1197a132a, user_id=9a5b8b4f10d24ee487d48886a2bda56d, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:59.104193 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d4f37-11f9-4a19-9f27-c68d5ee0f104 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:59.118304 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1136/2302] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:48:59 2022] PUT /identity/v3/projects/f52b7c63ab944e7fbd1212c1197a132a/users/9a5b8b4f10d24ee487d48886a2bda56d/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:48:59.122529 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1a42e-7303-49cc-ac59-86d8261a813b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:59.133013 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1a42e-7303-49cc-ac59-86d8261a813b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:59.152701 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:48:59.193030 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adec8f-fbfd-45ad-8d63-8810c636b826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:59.193704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adec8f-fbfd-45ad-8d63-8810c636b826 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:59.193987 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adec8f-fbfd-45ad-8d63-8810c636b826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:59.194264 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adec8f-fbfd-45ad-8d63-8810c636b826 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:59.194973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adec8f-fbfd-45ad-8d63-8810c636b826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:59.196592 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adec8f-fbfd-45ad-8d63-8810c636b826 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:59.206631 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1167/2303] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:48:59.210824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d4f37-11f9-4a19-9f27-c68d5ee0f104 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:59.216418 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:48:59.223978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d4f37-11f9-4a19-9f27-c68d5ee0f104 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:59.229322 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c28ce1-4369-4203-8b1f-26995394e543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:59.230307 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c28ce1-4369-4203-8b1f-26995394e543 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:59.230716 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c28ce1-4369-4203-8b1f-26995394e543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:59.231100 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c28ce1-4369-4203-8b1f-26995394e543 admin admin] PATH_INFO: `/v3/projects/f52b7c63ab944e7fbd1212c1197a132a/users/9a5b8b4f10d24ee487d48886a2bda56d/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:59.233498 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c28ce1-4369-4203-8b1f-26995394e543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f52b7c63ab944e7fbd1212c1197a132a, user_id=9a5b8b4f10d24ee487d48886a2bda56d, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:59.236578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c28ce1-4369-4203-8b1f-26995394e543 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:59.247710 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1137/2304] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:48:59 2022] PUT /identity/v3/projects/f52b7c63ab944e7fbd1212c1197a132a/users/9a5b8b4f10d24ee487d48886a2bda56d/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:48:59.258525 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67312d50-7f82-41b8-891a-8ee600140ee0 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:59.259031 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67312d50-7f82-41b8-891a-8ee600140ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:59.259031 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67312d50-7f82-41b8-891a-8ee600140ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:59.286500 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-67312d50-7f82-41b8-891a-8ee600140ee0 None None] MFA Rules not processed for user `9a5b8b4f10d24ee487d48886a2bda56d`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:48:59.287690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-67312d50-7f82-41b8-891a-8ee600140ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:48:59.354873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1168/2305] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:48:59 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:48:59.366734 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c28ce1-4369-4203-8b1f-26995394e543 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:59.368546 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-55c28ce1-4369-4203-8b1f-26995394e543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:48:59.424746 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c28ce1-4369-4203-8b1f-26995394e543 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:59.428311 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d2259-5970-45e5-9c8b-54b3952078ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:59.428962 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d2259-5970-45e5-9c8b-54b3952078ba service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:59.429244 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d2259-5970-45e5-9c8b-54b3952078ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:59.429518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d2259-5970-45e5-9c8b-54b3952078ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:59.438203 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d2259-5970-45e5-9c8b-54b3952078ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:59.439659 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d2259-5970-45e5-9c8b-54b3952078ba service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:59.448835 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1138/2306] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:48:59 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:48:59.518475 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67312d50-7f82-41b8-891a-8ee600140ee0 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:48:59.527930 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67312d50-7f82-41b8-891a-8ee600140ee0 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:48:59.531640 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed76c9-83c5-44fb-8224-0f0c3787cd34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:48:59.532314 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed76c9-83c5-44fb-8224-0f0c3787cd34 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:48:59.533229 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed76c9-83c5-44fb-8224-0f0c3787cd34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:48:59.533507 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed76c9-83c5-44fb-8224-0f0c3787cd34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:48:59.589283 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed76c9-83c5-44fb-8224-0f0c3787cd34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:48:59.590715 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed76c9-83c5-44fb-8224-0f0c3787cd34 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:48:59.600101 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1169/2307] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:48:59 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:49:04.254999 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d2259-5970-45e5-9c8b-54b3952078ba service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:04.256839 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9b1d2259-5970-45e5-9c8b-54b3952078ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:04.354417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d2259-5970-45e5-9c8b-54b3952078ba service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:04.361759 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9be695-a2e7-4de0-886d-14130d7341a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48709a771ab64ed38018873313f37c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:04.362428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9be695-a2e7-4de0-886d-14130d7341a4 service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:04.362716 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9be695-a2e7-4de0-886d-14130d7341a4 service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:04.362995 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9be695-a2e7-4de0-886d-14130d7341a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:04.365298 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fb9be695-a2e7-4de0-886d-14130d7341a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:04.379483 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9be695-a2e7-4de0-886d-14130d7341a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:04.381521 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9be695-a2e7-4de0-886d-14130d7341a4 service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:04.394432 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1139/2308] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:49:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:49:07.337462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d0c0a-daf6-4682-abcb-24c00bd217ce None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:07.337976 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d0c0a-daf6-4682-abcb-24c00bd217ce None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:07.338087 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d0c0a-daf6-4682-abcb-24c00bd217ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:07.354963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-098d0c0a-daf6-4682-abcb-24c00bd217ce None None] MFA Rules not processed for user `131fb3808ea341618e17256b43862937`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:07.356142 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-098d0c0a-daf6-4682-abcb-24c00bd217ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:07.396685 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:07.412096 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1170/2309] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:49:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:14.387644 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=62,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:14.611113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9be695-a2e7-4de0-886d-14130d7341a4 service placement] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:14.684678 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9be695-a2e7-4de0-886d-14130d7341a4 service placement] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:14.690248 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7d091-6f15-4d25-9980-dc908bacc209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:14.691139 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7d091-6f15-4d25-9980-dc908bacc209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:14.691427 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7d091-6f15-4d25-9980-dc908bacc209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:14.691709 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7d091-6f15-4d25-9980-dc908bacc209 admin admin] PATH_INFO: `/v3/users/74fe19f20a9a4c75a49ee98631d93856` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:14.693265 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7d091-6f15-4d25-9980-dc908bacc209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74fe19f20a9a4c75a49ee98631d93856)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:14.695257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7d091-6f15-4d25-9980-dc908bacc209 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:14.747075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d7f7d091-6f15-4d25-9980-dc908bacc209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74fe19f20a9a4c75a49ee98631d93856'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:14.747722 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d7f7d091-6f15-4d25-9980-dc908bacc209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74fe19f20a9a4c75a49ee98631d93856'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:14.756071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d7f7d091-6f15-4d25-9980-dc908bacc209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74fe19f20a9a4c75a49ee98631d93856'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:14.756910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d7f7d091-6f15-4d25-9980-dc908bacc209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74fe19f20a9a4c75a49ee98631d93856'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:14.765269 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d7f7d091-6f15-4d25-9980-dc908bacc209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74fe19f20a9a4c75a49ee98631d93856'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:14.784810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1140/2310] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:49:14 2022] DELETE /identity/v3/users/74fe19f20a9a4c75a49ee98631d93856 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:14.789490 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe1b8e-d2a9-4a80-b686-f897f6bab3ed None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:14.790043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe1b8e-d2a9-4a80-b686-f897f6bab3ed None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:14.790043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe1b8e-d2a9-4a80-b686-f897f6bab3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:14.808150 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-abbe1b8e-d2a9-4a80-b686-f897f6bab3ed None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:14.809707 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-abbe1b8e-d2a9-4a80-b686-f897f6bab3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:14.869686 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1171/2311] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:14.879290 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7d091-6f15-4d25-9980-dc908bacc209 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:14.881234 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d7f7d091-6f15-4d25-9980-dc908bacc209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:14.940050 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7d091-6f15-4d25-9980-dc908bacc209 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:14.944357 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e14fa5-4f25-4f54-a8ff-70a1fbf9d9bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:14.945103 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e14fa5-4f25-4f54-a8ff-70a1fbf9d9bf service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:14.945412 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e14fa5-4f25-4f54-a8ff-70a1fbf9d9bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:14.945713 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e14fa5-4f25-4f54-a8ff-70a1fbf9d9bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:14.955086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e14fa5-4f25-4f54-a8ff-70a1fbf9d9bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:14.956617 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e14fa5-4f25-4f54-a8ff-70a1fbf9d9bf service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:14.967312 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1141/2312] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:49:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:49:15.284758 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe1b8e-d2a9-4a80-b686-f897f6bab3ed None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:15.286290 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-abbe1b8e-d2a9-4a80-b686-f897f6bab3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:15.298224 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe1b8e-d2a9-4a80-b686-f897f6bab3ed None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:15.303781 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441e880-3581-4542-834f-6514f2439c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:15.304758 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441e880-3581-4542-834f-6514f2439c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:15.305043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441e880-3581-4542-834f-6514f2439c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:15.305321 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441e880-3581-4542-834f-6514f2439c4c admin admin] PATH_INFO: `/v3/projects/bfdff4360fa841ce854cc5c143b9c719` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:15.306566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441e880-3581-4542-834f-6514f2439c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfdff4360fa841ce854cc5c143b9c719)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:15.312127 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441e880-3581-4542-834f-6514f2439c4c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:15.369565 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9441e880-3581-4542-834f-6514f2439c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfdff4360fa841ce854cc5c143b9c719', 'request_id': 'req-9441e880-3581-4542-834f-6514f2439c4c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:15.377412 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9441e880-3581-4542-834f-6514f2439c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfdff4360fa841ce854cc5c143b9c719', 'request_id': 'req-9441e880-3581-4542-834f-6514f2439c4c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:15.384271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9441e880-3581-4542-834f-6514f2439c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfdff4360fa841ce854cc5c143b9c719', 'request_id': 'req-9441e880-3581-4542-834f-6514f2439c4c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:15.394405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9441e880-3581-4542-834f-6514f2439c4c admin admin] The token cache is being invalidate because project bfdff4360fa841ce854cc5c143b9c719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:49:15.394686 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9441e880-3581-4542-834f-6514f2439c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:15.395304 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9441e880-3581-4542-834f-6514f2439c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:15.396873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1172/2313] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:49:15 2022] DELETE /identity/v3/projects/bfdff4360fa841ce854cc5c143b9c719 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:15.401005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e14fa5-4f25-4f54-a8ff-70a1fbf9d9bf service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:15.410619 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e14fa5-4f25-4f54-a8ff-70a1fbf9d9bf service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:15.428691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:15.470437 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2e90f-9ee4-47f1-9667-c6590513548d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:15.471300 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2e90f-9ee4-47f1-9667-c6590513548d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:15.471682 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2e90f-9ee4-47f1-9667-c6590513548d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:15.471959 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2e90f-9ee4-47f1-9667-c6590513548d admin admin] PATH_INFO: `/v3/users/9a5b8b4f10d24ee487d48886a2bda56d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:15.473148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2e90f-9ee4-47f1-9667-c6590513548d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a5b8b4f10d24ee487d48886a2bda56d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:15.475582 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2e90f-9ee4-47f1-9667-c6590513548d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:15.519426 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0cb2e90f-9ee4-47f1-9667-c6590513548d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a5b8b4f10d24ee487d48886a2bda56d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:15.520062 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0cb2e90f-9ee4-47f1-9667-c6590513548d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a5b8b4f10d24ee487d48886a2bda56d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:15.526774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0cb2e90f-9ee4-47f1-9667-c6590513548d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a5b8b4f10d24ee487d48886a2bda56d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:15.527392 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0cb2e90f-9ee4-47f1-9667-c6590513548d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a5b8b4f10d24ee487d48886a2bda56d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:15.533730 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0cb2e90f-9ee4-47f1-9667-c6590513548d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a5b8b4f10d24ee487d48886a2bda56d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:15.551107 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1142/2314] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:49:15 2022] DELETE /identity/v3/users/9a5b8b4f10d24ee487d48886a2bda56d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:15.819592 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441e880-3581-4542-834f-6514f2439c4c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:15.821156 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9441e880-3581-4542-834f-6514f2439c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:15.834690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441e880-3581-4542-834f-6514f2439c4c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:15.890892 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d394a-a07e-425f-9048-88d5c53c575b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:15.891746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d394a-a07e-425f-9048-88d5c53c575b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:15.892028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d394a-a07e-425f-9048-88d5c53c575b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:15.892305 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d394a-a07e-425f-9048-88d5c53c575b admin admin] PATH_INFO: `/v3/projects/f52b7c63ab944e7fbd1212c1197a132a` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:15.893501 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d394a-a07e-425f-9048-88d5c53c575b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f52b7c63ab944e7fbd1212c1197a132a)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:15.896010 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d394a-a07e-425f-9048-88d5c53c575b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:15.911837 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:15.941189 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c99d394a-a07e-425f-9048-88d5c53c575b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f52b7c63ab944e7fbd1212c1197a132a', 'request_id': 'req-c99d394a-a07e-425f-9048-88d5c53c575b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:15.947929 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c99d394a-a07e-425f-9048-88d5c53c575b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f52b7c63ab944e7fbd1212c1197a132a', 'request_id': 'req-c99d394a-a07e-425f-9048-88d5c53c575b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:15.953938 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c99d394a-a07e-425f-9048-88d5c53c575b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f52b7c63ab944e7fbd1212c1197a132a', 'request_id': 'req-c99d394a-a07e-425f-9048-88d5c53c575b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:15.964388 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c99d394a-a07e-425f-9048-88d5c53c575b admin admin] The token cache is being invalidate because project f52b7c63ab944e7fbd1212c1197a132a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:49:15.964704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c99d394a-a07e-425f-9048-88d5c53c575b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:15.965333 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c99d394a-a07e-425f-9048-88d5c53c575b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:15.966858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1173/2315] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:49:15 2022] DELETE /identity/v3/projects/f52b7c63ab944e7fbd1212c1197a132a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:15.972496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af16417-a970-4186-8bc6-d6787321cc0c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:15.972806 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af16417-a970-4186-8bc6-d6787321cc0c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:15.973087 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af16417-a970-4186-8bc6-d6787321cc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:15.992011 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8af16417-a970-4186-8bc6-d6787321cc0c None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:15.993249 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8af16417-a970-4186-8bc6-d6787321cc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:16.054071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1143/2316] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:16.061804 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c9513-5d89-42ef-acf2-06bcf643ff77 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:16.062095 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c9513-5d89-42ef-acf2-06bcf643ff77 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:16.062376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c9513-5d89-42ef-acf2-06bcf643ff77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:16.080206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e67c9513-5d89-42ef-acf2-06bcf643ff77 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:16.081338 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e67c9513-5d89-42ef-acf2-06bcf643ff77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:16.089645 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1174/2317] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:16.093708 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af16417-a970-4186-8bc6-d6787321cc0c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:16.104168 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af16417-a970-4186-8bc6-d6787321cc0c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:16.108888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa915b9-1e6c-4e2a-b186-929ac63fac68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:16.109528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa915b9-1e6c-4e2a-b186-929ac63fac68 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:16.109809 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa915b9-1e6c-4e2a-b186-929ac63fac68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:16.110084 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa915b9-1e6c-4e2a-b186-929ac63fac68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:16.110822 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa915b9-1e6c-4e2a-b186-929ac63fac68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:49:16.111127 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa915b9-1e6c-4e2a-b186-929ac63fac68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:16.112763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa915b9-1e6c-4e2a-b186-929ac63fac68 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:16.124377 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1144/2318] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:49:16.130235 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c9513-5d89-42ef-acf2-06bcf643ff77 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:16.139839 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c9513-5d89-42ef-acf2-06bcf643ff77 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:16.144662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3af46-1fa5-47ac-9ed1-23fc2b7eb5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:16.145808 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3af46-1fa5-47ac-9ed1-23fc2b7eb5ed admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:16.146085 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3af46-1fa5-47ac-9ed1-23fc2b7eb5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:16.146358 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3af46-1fa5-47ac-9ed1-23fc2b7eb5ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:16.147033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3af46-1fa5-47ac-9ed1-23fc2b7eb5ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:16.149012 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3af46-1fa5-47ac-9ed1-23fc2b7eb5ed admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:16.174382 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1175/2319] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:49:16 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:49:16.178247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa915b9-1e6c-4e2a-b186-929ac63fac68 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:16.188302 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa915b9-1e6c-4e2a-b186-929ac63fac68 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:16.214666 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:16.248917 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb1a22-6d23-4a47-a7ec-f69cdbeaa162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:16.249587 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb1a22-6d23-4a47-a7ec-f69cdbeaa162 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:16.249888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb1a22-6d23-4a47-a7ec-f69cdbeaa162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:16.250271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb1a22-6d23-4a47-a7ec-f69cdbeaa162 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:16.250977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb1a22-6d23-4a47-a7ec-f69cdbeaa162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:16.252953 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb1a22-6d23-4a47-a7ec-f69cdbeaa162 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:16.280684 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1145/2320] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:49:16 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:49:16.284444 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3af46-1fa5-47ac-9ed1-23fc2b7eb5ed admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:16.294862 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3af46-1fa5-47ac-9ed1-23fc2b7eb5ed admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:16.299670 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422626a2-441c-4806-b5fe-fd900902c6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:16.300326 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422626a2-441c-4806-b5fe-fd900902c6fa admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:16.300632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422626a2-441c-4806-b5fe-fd900902c6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:16.300906 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422626a2-441c-4806-b5fe-fd900902c6fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:16.301623 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422626a2-441c-4806-b5fe-fd900902c6fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:16.303207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422626a2-441c-4806-b5fe-fd900902c6fa admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:16.314232 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1176/2321] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:49:16.318757 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb1a22-6d23-4a47-a7ec-f69cdbeaa162 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:16.328821 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb1a22-6d23-4a47-a7ec-f69cdbeaa162 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:16.334030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b662fd-3f6a-488f-891d-fa228bedc3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:16.334621 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b662fd-3f6a-488f-891d-fa228bedc3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:16.334901 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b662fd-3f6a-488f-891d-fa228bedc3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:16.335175 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b662fd-3f6a-488f-891d-fa228bedc3d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:16.335888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b662fd-3f6a-488f-891d-fa228bedc3d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:16.337524 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b662fd-3f6a-488f-891d-fa228bedc3d7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:16.347731 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1146/2322] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:49:16.351785 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422626a2-441c-4806-b5fe-fd900902c6fa admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:16.362076 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422626a2-441c-4806-b5fe-fd900902c6fa admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:16.366588 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d9669-9c64-40c0-83fb-6118ffb93620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:16.367451 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d9669-9c64-40c0-83fb-6118ffb93620 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:16.367728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d9669-9c64-40c0-83fb-6118ffb93620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:16.368002 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d9669-9c64-40c0-83fb-6118ffb93620 admin admin] PATH_INFO: `/v3/projects/a5b2ef61f7474807b03d67ffe08816b4/users/cf3a75d51afb41e7a01c60cd4668e519/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:16.382691 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d9669-9c64-40c0-83fb-6118ffb93620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b2ef61f7474807b03d67ffe08816b4, user_id=cf3a75d51afb41e7a01c60cd4668e519, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:16.385364 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d9669-9c64-40c0-83fb-6118ffb93620 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:16.398213 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1177/2323] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:49:16 2022] PUT /identity/v3/projects/a5b2ef61f7474807b03d67ffe08816b4/users/cf3a75d51afb41e7a01c60cd4668e519/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:16.409382 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac84dd6-c42a-40a7-b4ea-2a15c111a11d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:16.409867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac84dd6-c42a-40a7-b4ea-2a15c111a11d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:16.409965 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac84dd6-c42a-40a7-b4ea-2a15c111a11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:16.435242 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-2ac84dd6-c42a-40a7-b4ea-2a15c111a11d None None] MFA Rules not processed for user `cf3a75d51afb41e7a01c60cd4668e519`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:16.436424 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2ac84dd6-c42a-40a7-b4ea-2a15c111a11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:16.505262 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1147/2324] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:49:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:16.509715 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d9669-9c64-40c0-83fb-6118ffb93620 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:16.573623 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d9669-9c64-40c0-83fb-6118ffb93620 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:16.578750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ed221-4507-42b2-8cf8-e196caa7d330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:16.579411 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ed221-4507-42b2-8cf8-e196caa7d330 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:16.579711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ed221-4507-42b2-8cf8-e196caa7d330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:16.579980 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ed221-4507-42b2-8cf8-e196caa7d330 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:16.580708 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ed221-4507-42b2-8cf8-e196caa7d330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:16.582719 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ed221-4507-42b2-8cf8-e196caa7d330 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:16.609745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1178/2325] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:49:16 2022] POST /identity/v3/projects => generated 399 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:49:16.613616 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac84dd6-c42a-40a7-b4ea-2a15c111a11d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:16.626163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac84dd6-c42a-40a7-b4ea-2a15c111a11d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:16.703897 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367947e2-2567-48ad-9ea4-90c5599e60ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:16.704691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367947e2-2567-48ad-9ea4-90c5599e60ff admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:16.704984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367947e2-2567-48ad-9ea4-90c5599e60ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:16.705272 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367947e2-2567-48ad-9ea4-90c5599e60ff admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:16.705965 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367947e2-2567-48ad-9ea4-90c5599e60ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:16.708664 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367947e2-2567-48ad-9ea4-90c5599e60ff admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:16.728922 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1148/2326] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:49:16 2022] POST /identity/v3/users => generated 306 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:49:16.733149 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ed221-4507-42b2-8cf8-e196caa7d330 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:16.744451 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ed221-4507-42b2-8cf8-e196caa7d330 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:16.750268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18b31f-4bb6-44d3-b7e5-586d509aa890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:16.751677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18b31f-4bb6-44d3-b7e5-586d509aa890 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:16.752285 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18b31f-4bb6-44d3-b7e5-586d509aa890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:16.752622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18b31f-4bb6-44d3-b7e5-586d509aa890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:16.753348 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18b31f-4bb6-44d3-b7e5-586d509aa890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:16.754984 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18b31f-4bb6-44d3-b7e5-586d509aa890 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:16.766066 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1179/2327] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:49:16.770750 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367947e2-2567-48ad-9ea4-90c5599e60ff admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:16.780929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367947e2-2567-48ad-9ea4-90c5599e60ff admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:16.785765 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283901bb-168d-4fc7-ab2e-0abb2f60e3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:16.787186 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283901bb-168d-4fc7-ab2e-0abb2f60e3a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:16.787470 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283901bb-168d-4fc7-ab2e-0abb2f60e3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:16.787744 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283901bb-168d-4fc7-ab2e-0abb2f60e3a4 admin admin] PATH_INFO: `/v3/projects/ac8057c91e5c44b099bc5a678972fee8/users/0a315423074a4bc9aafc3fd8024275e8/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:16.803959 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283901bb-168d-4fc7-ab2e-0abb2f60e3a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac8057c91e5c44b099bc5a678972fee8, user_id=0a315423074a4bc9aafc3fd8024275e8, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:16.806644 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283901bb-168d-4fc7-ab2e-0abb2f60e3a4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:16.819463 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1149/2328] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:49:16 2022] PUT /identity/v3/projects/ac8057c91e5c44b099bc5a678972fee8/users/0a315423074a4bc9aafc3fd8024275e8/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:16.823422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18b31f-4bb6-44d3-b7e5-586d509aa890 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:16.834172 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18b31f-4bb6-44d3-b7e5-586d509aa890 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:16.843321 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:16.892821 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd57fd-0644-4786-8f7a-ec25f9e3b599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:16.893541 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd57fd-0644-4786-8f7a-ec25f9e3b599 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:16.893806 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd57fd-0644-4786-8f7a-ec25f9e3b599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:16.894080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd57fd-0644-4786-8f7a-ec25f9e3b599 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:16.894819 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd57fd-0644-4786-8f7a-ec25f9e3b599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:16.897011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd57fd-0644-4786-8f7a-ec25f9e3b599 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:16.906607 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1180/2329] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:49:16.910659 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283901bb-168d-4fc7-ab2e-0abb2f60e3a4 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:16.916855 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:16.922867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283901bb-168d-4fc7-ab2e-0abb2f60e3a4 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:16.927762 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f772345-9ebb-432f-b5bf-aea3b19cde81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:16.928658 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f772345-9ebb-432f-b5bf-aea3b19cde81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:16.928938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f772345-9ebb-432f-b5bf-aea3b19cde81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:16.929210 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f772345-9ebb-432f-b5bf-aea3b19cde81 admin admin] PATH_INFO: `/v3/projects/ac8057c91e5c44b099bc5a678972fee8/users/0a315423074a4bc9aafc3fd8024275e8/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:16.931132 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f772345-9ebb-432f-b5bf-aea3b19cde81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac8057c91e5c44b099bc5a678972fee8, user_id=0a315423074a4bc9aafc3fd8024275e8, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:16.933830 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f772345-9ebb-432f-b5bf-aea3b19cde81 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:16.943714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1150/2330] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:49:16 2022] PUT /identity/v3/projects/ac8057c91e5c44b099bc5a678972fee8/users/0a315423074a4bc9aafc3fd8024275e8/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:16.953529 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49bac2-ec1f-4907-8fa0-34fc32589737 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:16.953823 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49bac2-ec1f-4907-8fa0-34fc32589737 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:16.954097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49bac2-ec1f-4907-8fa0-34fc32589737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:16.981332 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-5f49bac2-ec1f-4907-8fa0-34fc32589737 None None] MFA Rules not processed for user `0a315423074a4bc9aafc3fd8024275e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:16.982818 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-5f49bac2-ec1f-4907-8fa0-34fc32589737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:17.048674 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1181/2331] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:49:16 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:17.059039 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f772345-9ebb-432f-b5bf-aea3b19cde81 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:17.060781 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7f772345-9ebb-432f-b5bf-aea3b19cde81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:17.118472 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f772345-9ebb-432f-b5bf-aea3b19cde81 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:17.122027 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41086a5-af6b-479e-b600-6f01c1f5a6ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:17.122657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41086a5-af6b-479e-b600-6f01c1f5a6ed service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:17.122935 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41086a5-af6b-479e-b600-6f01c1f5a6ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:17.123252 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41086a5-af6b-479e-b600-6f01c1f5a6ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:17.134965 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41086a5-af6b-479e-b600-6f01c1f5a6ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:17.136398 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41086a5-af6b-479e-b600-6f01c1f5a6ed service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:17.146645 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1151/2332] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:49:17 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:49:17.220898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49bac2-ec1f-4907-8fa0-34fc32589737 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:17.230244 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49bac2-ec1f-4907-8fa0-34fc32589737 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:17.234072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0fdbc-760f-4431-acda-67216978c0af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:17.234696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0fdbc-760f-4431-acda-67216978c0af service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:17.234971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0fdbc-760f-4431-acda-67216978c0af service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:17.235247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0fdbc-760f-4431-acda-67216978c0af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:17.293194 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0fdbc-760f-4431-acda-67216978c0af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:17.294628 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0fdbc-760f-4431-acda-67216978c0af service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:17.303479 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1182/2333] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:49:17 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:49:21.348041 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41086a5-af6b-479e-b600-6f01c1f5a6ed service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:21.414193 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41086a5-af6b-479e-b600-6f01c1f5a6ed service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:21.418779 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34912d-7543-4ca5-8383-c9bd325ad528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:21.419661 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34912d-7543-4ca5-8383-c9bd325ad528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:21.419950 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34912d-7543-4ca5-8383-c9bd325ad528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:21.420225 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34912d-7543-4ca5-8383-c9bd325ad528 admin admin] PATH_INFO: `/v3/users/cf3a75d51afb41e7a01c60cd4668e519` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:21.421448 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34912d-7543-4ca5-8383-c9bd325ad528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf3a75d51afb41e7a01c60cd4668e519)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:21.423394 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34912d-7543-4ca5-8383-c9bd325ad528 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:21.479195 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cf34912d-7543-4ca5-8383-c9bd325ad528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf3a75d51afb41e7a01c60cd4668e519'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:21.480479 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cf34912d-7543-4ca5-8383-c9bd325ad528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf3a75d51afb41e7a01c60cd4668e519'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:21.488090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cf34912d-7543-4ca5-8383-c9bd325ad528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf3a75d51afb41e7a01c60cd4668e519'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:21.488897 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cf34912d-7543-4ca5-8383-c9bd325ad528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf3a75d51afb41e7a01c60cd4668e519'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:21.497172 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cf34912d-7543-4ca5-8383-c9bd325ad528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf3a75d51afb41e7a01c60cd4668e519'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:21.518619 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1152/2334] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:49:21 2022] DELETE /identity/v3/users/cf3a75d51afb41e7a01c60cd4668e519 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:21.523641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a84ff-7683-43ae-88ac-830286e018df None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:21.524173 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a84ff-7683-43ae-88ac-830286e018df None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:21.524173 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a84ff-7683-43ae-88ac-830286e018df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:21.541249 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-040a84ff-7683-43ae-88ac-830286e018df None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:21.542452 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-040a84ff-7683-43ae-88ac-830286e018df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:21.572788 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:21.606237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1183/2335] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:49:21.616190 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34912d-7543-4ca5-8383-c9bd325ad528 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:21.617961 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cf34912d-7543-4ca5-8383-c9bd325ad528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:21.633267 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:21.685485 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34912d-7543-4ca5-8383-c9bd325ad528 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:21.689344 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b28855-f1bd-4a06-9914-0bd1ce6e4642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:21.689986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b28855-f1bd-4a06-9914-0bd1ce6e4642 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:21.690263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b28855-f1bd-4a06-9914-0bd1ce6e4642 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:21.690535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b28855-f1bd-4a06-9914-0bd1ce6e4642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:21.700958 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b28855-f1bd-4a06-9914-0bd1ce6e4642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:21.702322 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b28855-f1bd-4a06-9914-0bd1ce6e4642 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:21.712492 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1153/2336] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:49:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:49:21.994316 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a84ff-7683-43ae-88ac-830286e018df None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:21.995937 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-040a84ff-7683-43ae-88ac-830286e018df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:22.008896 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a84ff-7683-43ae-88ac-830286e018df None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:22.013694 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d911a41-5ae6-459a-a2ca-d74fc1f70d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:22.014675 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d911a41-5ae6-459a-a2ca-d74fc1f70d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:22.015049 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d911a41-5ae6-459a-a2ca-d74fc1f70d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:22.015546 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d911a41-5ae6-459a-a2ca-d74fc1f70d5d admin admin] PATH_INFO: `/v3/projects/a5b2ef61f7474807b03d67ffe08816b4` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:22.016872 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d911a41-5ae6-459a-a2ca-d74fc1f70d5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5b2ef61f7474807b03d67ffe08816b4)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:22.019484 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d911a41-5ae6-459a-a2ca-d74fc1f70d5d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:22.068804 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7d911a41-5ae6-459a-a2ca-d74fc1f70d5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5b2ef61f7474807b03d67ffe08816b4', 'request_id': 'req-7d911a41-5ae6-459a-a2ca-d74fc1f70d5d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:22.079898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7d911a41-5ae6-459a-a2ca-d74fc1f70d5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5b2ef61f7474807b03d67ffe08816b4', 'request_id': 'req-7d911a41-5ae6-459a-a2ca-d74fc1f70d5d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:22.090795 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7d911a41-5ae6-459a-a2ca-d74fc1f70d5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5b2ef61f7474807b03d67ffe08816b4', 'request_id': 'req-7d911a41-5ae6-459a-a2ca-d74fc1f70d5d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:22.101306 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7d911a41-5ae6-459a-a2ca-d74fc1f70d5d admin admin] The token cache is being invalidate because project a5b2ef61f7474807b03d67ffe08816b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:49:22.101593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7d911a41-5ae6-459a-a2ca-d74fc1f70d5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:22.102251 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7d911a41-5ae6-459a-a2ca-d74fc1f70d5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:22.103826 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1184/2337] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:49:21 2022] DELETE /identity/v3/projects/a5b2ef61f7474807b03d67ffe08816b4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:22.108042 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b28855-f1bd-4a06-9914-0bd1ce6e4642 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:22.118583 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b28855-f1bd-4a06-9914-0bd1ce6e4642 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:22.180871 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60171b-20e2-4784-a94d-0541a2b413b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:22.181738 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60171b-20e2-4784-a94d-0541a2b413b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:22.182128 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60171b-20e2-4784-a94d-0541a2b413b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:22.182408 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60171b-20e2-4784-a94d-0541a2b413b4 admin admin] PATH_INFO: `/v3/users/0a315423074a4bc9aafc3fd8024275e8` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:22.183585 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60171b-20e2-4784-a94d-0541a2b413b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a315423074a4bc9aafc3fd8024275e8)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:22.185560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60171b-20e2-4784-a94d-0541a2b413b4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:22.229905 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1a60171b-20e2-4784-a94d-0541a2b413b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a315423074a4bc9aafc3fd8024275e8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:22.230469 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1a60171b-20e2-4784-a94d-0541a2b413b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a315423074a4bc9aafc3fd8024275e8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:22.237411 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1a60171b-20e2-4784-a94d-0541a2b413b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a315423074a4bc9aafc3fd8024275e8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:22.238022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1a60171b-20e2-4784-a94d-0541a2b413b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a315423074a4bc9aafc3fd8024275e8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:22.245467 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1a60171b-20e2-4784-a94d-0541a2b413b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a315423074a4bc9aafc3fd8024275e8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:22.262932 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1154/2338] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:49:22 2022] DELETE /identity/v3/users/0a315423074a4bc9aafc3fd8024275e8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:22.527762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d911a41-5ae6-459a-a2ca-d74fc1f70d5d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:22.529210 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7d911a41-5ae6-459a-a2ca-d74fc1f70d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:22.545024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d911a41-5ae6-459a-a2ca-d74fc1f70d5d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:22.603907 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afef2c6-239e-46b9-86a4-617433ea249d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:22.604794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afef2c6-239e-46b9-86a4-617433ea249d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:22.605080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afef2c6-239e-46b9-86a4-617433ea249d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:22.605355 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afef2c6-239e-46b9-86a4-617433ea249d admin admin] PATH_INFO: `/v3/projects/ac8057c91e5c44b099bc5a678972fee8` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:22.606538 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afef2c6-239e-46b9-86a4-617433ea249d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac8057c91e5c44b099bc5a678972fee8)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:22.608761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afef2c6-239e-46b9-86a4-617433ea249d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:22.654936 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0afef2c6-239e-46b9-86a4-617433ea249d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac8057c91e5c44b099bc5a678972fee8', 'request_id': 'req-0afef2c6-239e-46b9-86a4-617433ea249d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:22.662730 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0afef2c6-239e-46b9-86a4-617433ea249d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac8057c91e5c44b099bc5a678972fee8', 'request_id': 'req-0afef2c6-239e-46b9-86a4-617433ea249d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:22.664799 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:22.669278 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0afef2c6-239e-46b9-86a4-617433ea249d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac8057c91e5c44b099bc5a678972fee8', 'request_id': 'req-0afef2c6-239e-46b9-86a4-617433ea249d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:22.680626 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0afef2c6-239e-46b9-86a4-617433ea249d admin admin] The token cache is being invalidate because project ac8057c91e5c44b099bc5a678972fee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:49:22.680908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0afef2c6-239e-46b9-86a4-617433ea249d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:22.681522 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0afef2c6-239e-46b9-86a4-617433ea249d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:22.683054 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1185/2339] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:49:22 2022] DELETE /identity/v3/projects/ac8057c91e5c44b099bc5a678972fee8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:22.688018 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767bd9b-d438-4807-91a9-398e53f1d579 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:22.688472 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767bd9b-d438-4807-91a9-398e53f1d579 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:22.688609 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767bd9b-d438-4807-91a9-398e53f1d579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:22.706736 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8767bd9b-d438-4807-91a9-398e53f1d579 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:22.708423 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8767bd9b-d438-4807-91a9-398e53f1d579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:22.737093 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:22.767444 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1155/2340] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:22.776954 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a8a3d-ae89-40ae-9f71-e37a11908ff6 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:22.777183 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a8a3d-ae89-40ae-9f71-e37a11908ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:22.777462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a8a3d-ae89-40ae-9f71-e37a11908ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:22.796203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-248a8a3d-ae89-40ae-9f71-e37a11908ff6 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:22.797456 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-248a8a3d-ae89-40ae-9f71-e37a11908ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:22.805508 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1186/2341] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:22.809595 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767bd9b-d438-4807-91a9-398e53f1d579 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:22.819156 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767bd9b-d438-4807-91a9-398e53f1d579 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:22.823662 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02d959-fa17-4264-a462-cc6a44b97b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:22.824304 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02d959-fa17-4264-a462-cc6a44b97b10 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:22.824631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02d959-fa17-4264-a462-cc6a44b97b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:22.824915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02d959-fa17-4264-a462-cc6a44b97b10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:22.825642 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02d959-fa17-4264-a462-cc6a44b97b10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:49:22.825956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02d959-fa17-4264-a462-cc6a44b97b10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:22.827563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02d959-fa17-4264-a462-cc6a44b97b10 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:22.839588 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1156/2342] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:49:22.843316 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a8a3d-ae89-40ae-9f71-e37a11908ff6 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:22.853089 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a8a3d-ae89-40ae-9f71-e37a11908ff6 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:22.857847 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04a7d7-afcd-4560-ab51-121618f8ddbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:22.858482 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04a7d7-afcd-4560-ab51-121618f8ddbd admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:22.858767 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04a7d7-afcd-4560-ab51-121618f8ddbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:22.859045 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04a7d7-afcd-4560-ab51-121618f8ddbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:22.859731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04a7d7-afcd-4560-ab51-121618f8ddbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:22.861664 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04a7d7-afcd-4560-ab51-121618f8ddbd admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:22.886164 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1187/2343] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:49:22 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:49:22.890201 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02d959-fa17-4264-a462-cc6a44b97b10 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:22.900562 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02d959-fa17-4264-a462-cc6a44b97b10 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:22.954568 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0c035-1bff-43af-b6fc-fd463fedfde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:22.955223 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0c035-1bff-43af-b6fc-fd463fedfde6 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:22.955512 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0c035-1bff-43af-b6fc-fd463fedfde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:22.955793 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0c035-1bff-43af-b6fc-fd463fedfde6 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:22.956481 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a0c035-1bff-43af-b6fc-fd463fedfde6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:22.958986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a0c035-1bff-43af-b6fc-fd463fedfde6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:22.981595 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1157/2344] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:49:22 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:49:22.983211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04a7d7-afcd-4560-ab51-121618f8ddbd admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:22.993387 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04a7d7-afcd-4560-ab51-121618f8ddbd admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:22.997926 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bc6b3-cd4d-4823-a78c-dc5a64e14d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:22.998568 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bc6b3-cd4d-4823-a78c-dc5a64e14d51 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:22.998852 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bc6b3-cd4d-4823-a78c-dc5a64e14d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:22.999133 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bc6b3-cd4d-4823-a78c-dc5a64e14d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:22.999846 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bc6b3-cd4d-4823-a78c-dc5a64e14d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:23.001467 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bc6b3-cd4d-4823-a78c-dc5a64e14d51 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:23.012463 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1188/2345] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:49:23.016417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0c035-1bff-43af-b6fc-fd463fedfde6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:23.027512 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0c035-1bff-43af-b6fc-fd463fedfde6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:23.032152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec1b25-ad66-4a91-aa42-3a9bec0607b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:23.032867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec1b25-ad66-4a91-aa42-3a9bec0607b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:23.033153 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec1b25-ad66-4a91-aa42-3a9bec0607b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:23.033491 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec1b25-ad66-4a91-aa42-3a9bec0607b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:23.034166 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec1b25-ad66-4a91-aa42-3a9bec0607b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:23.035818 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec1b25-ad66-4a91-aa42-3a9bec0607b1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:23.045938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1158/2346] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:49:23.050381 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bc6b3-cd4d-4823-a78c-dc5a64e14d51 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:23.060450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bc6b3-cd4d-4823-a78c-dc5a64e14d51 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:23.065388 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36df4a-a4e3-49a3-a75f-61ed57e157b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:23.066264 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36df4a-a4e3-49a3-a75f-61ed57e157b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:23.066546 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36df4a-a4e3-49a3-a75f-61ed57e157b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:23.066827 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36df4a-a4e3-49a3-a75f-61ed57e157b8 admin admin] PATH_INFO: `/v3/projects/d12334c8806f40d1bbc8b4adbb7b2088/users/3949dde156144e62b5447353e078f5a7/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:23.083422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36df4a-a4e3-49a3-a75f-61ed57e157b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d12334c8806f40d1bbc8b4adbb7b2088, user_id=3949dde156144e62b5447353e078f5a7, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:23.086114 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36df4a-a4e3-49a3-a75f-61ed57e157b8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:23.100030 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1189/2347] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:49:23 2022] PUT /identity/v3/projects/d12334c8806f40d1bbc8b4adbb7b2088/users/3949dde156144e62b5447353e078f5a7/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:23.110346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57002d2e-7a7b-48b1-a893-e1f71e525d9f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:23.110664 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57002d2e-7a7b-48b1-a893-e1f71e525d9f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:23.110948 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57002d2e-7a7b-48b1-a893-e1f71e525d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:23.137984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-57002d2e-7a7b-48b1-a893-e1f71e525d9f None None] MFA Rules not processed for user `3949dde156144e62b5447353e078f5a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:23.139187 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-57002d2e-7a7b-48b1-a893-e1f71e525d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:23.206613 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1159/2348] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:49:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:23.211709 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36df4a-a4e3-49a3-a75f-61ed57e157b8 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:23.272483 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36df4a-a4e3-49a3-a75f-61ed57e157b8 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:23.277177 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf9e00-0c90-4ce9-b878-ba21dd97d51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:23.277879 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf9e00-0c90-4ce9-b878-ba21dd97d51a admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:23.278109 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf9e00-0c90-4ce9-b878-ba21dd97d51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:23.278386 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf9e00-0c90-4ce9-b878-ba21dd97d51a admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:23.279066 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf9e00-0c90-4ce9-b878-ba21dd97d51a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:23.281023 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf9e00-0c90-4ce9-b878-ba21dd97d51a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:23.305695 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1190/2349] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:49:23 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:49:23.309649 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57002d2e-7a7b-48b1-a893-e1f71e525d9f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:23.321086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57002d2e-7a7b-48b1-a893-e1f71e525d9f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:23.348003 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:23.382521 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15952159-bfd2-4408-993e-e125b57a5ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:23.383185 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15952159-bfd2-4408-993e-e125b57a5ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:23.383471 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15952159-bfd2-4408-993e-e125b57a5ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:23.383743 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15952159-bfd2-4408-993e-e125b57a5ec6 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:23.384436 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15952159-bfd2-4408-993e-e125b57a5ec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:23.386390 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15952159-bfd2-4408-993e-e125b57a5ec6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:23.408459 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1160/2350] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:49:23 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:49:23.412129 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf9e00-0c90-4ce9-b878-ba21dd97d51a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:23.422471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf9e00-0c90-4ce9-b878-ba21dd97d51a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:23.427496 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9491ec-9afe-45b9-b5e2-2efa19a18a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:23.428143 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9491ec-9afe-45b9-b5e2-2efa19a18a11 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:23.428426 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9491ec-9afe-45b9-b5e2-2efa19a18a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:23.428739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9491ec-9afe-45b9-b5e2-2efa19a18a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:23.429455 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9491ec-9afe-45b9-b5e2-2efa19a18a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:23.431041 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9491ec-9afe-45b9-b5e2-2efa19a18a11 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:23.441386 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1191/2351] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:49:23.446165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15952159-bfd2-4408-993e-e125b57a5ec6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:23.456060 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15952159-bfd2-4408-993e-e125b57a5ec6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:23.460720 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7fbb0-1e34-4876-9c0a-19930fb96c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:23.461653 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7fbb0-1e34-4876-9c0a-19930fb96c67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:23.461934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7fbb0-1e34-4876-9c0a-19930fb96c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:23.462225 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7fbb0-1e34-4876-9c0a-19930fb96c67 admin admin] PATH_INFO: `/v3/projects/a95eb4314529463693804205b241992d/users/cbc3fa9c3e254c86968b974d2769b878/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:23.476803 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7fbb0-1e34-4876-9c0a-19930fb96c67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a95eb4314529463693804205b241992d, user_id=cbc3fa9c3e254c86968b974d2769b878, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:23.479518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7fbb0-1e34-4876-9c0a-19930fb96c67 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:23.492224 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1161/2352] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:49:23 2022] PUT /identity/v3/projects/a95eb4314529463693804205b241992d/users/cbc3fa9c3e254c86968b974d2769b878/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:23.496095 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9491ec-9afe-45b9-b5e2-2efa19a18a11 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:23.506734 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9491ec-9afe-45b9-b5e2-2efa19a18a11 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:23.557468 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:23.563941 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37426676-ff6f-4b4d-9db1-34d81dca2987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:23.564963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37426676-ff6f-4b4d-9db1-34d81dca2987 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:23.565298 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37426676-ff6f-4b4d-9db1-34d81dca2987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:23.565583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37426676-ff6f-4b4d-9db1-34d81dca2987 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:23.566482 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37426676-ff6f-4b4d-9db1-34d81dca2987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:23.568993 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37426676-ff6f-4b4d-9db1-34d81dca2987 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:23.579498 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1192/2353] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:49:23.583689 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7fbb0-1e34-4876-9c0a-19930fb96c67 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:23.593941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7fbb0-1e34-4876-9c0a-19930fb96c67 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:23.598585 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994158c2-d1f5-4473-9b5c-16d60a3cc6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:23.599444 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994158c2-d1f5-4473-9b5c-16d60a3cc6bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:23.599729 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994158c2-d1f5-4473-9b5c-16d60a3cc6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:23.600004 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994158c2-d1f5-4473-9b5c-16d60a3cc6bb admin admin] PATH_INFO: `/v3/projects/a95eb4314529463693804205b241992d/users/cbc3fa9c3e254c86968b974d2769b878/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:23.602012 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994158c2-d1f5-4473-9b5c-16d60a3cc6bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a95eb4314529463693804205b241992d, user_id=cbc3fa9c3e254c86968b974d2769b878, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:23.604697 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994158c2-d1f5-4473-9b5c-16d60a3cc6bb admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:23.615491 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1162/2354] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:49:23 2022] PUT /identity/v3/projects/a95eb4314529463693804205b241992d/users/cbc3fa9c3e254c86968b974d2769b878/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:23.625449 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48272a45-2109-4bf6-8d95-57e0abc84c9e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:23.625737 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48272a45-2109-4bf6-8d95-57e0abc84c9e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:23.626037 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48272a45-2109-4bf6-8d95-57e0abc84c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:23.651850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-48272a45-2109-4bf6-8d95-57e0abc84c9e None None] MFA Rules not processed for user `cbc3fa9c3e254c86968b974d2769b878`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:23.653052 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-48272a45-2109-4bf6-8d95-57e0abc84c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:23.719647 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1193/2355] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:49:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:23.730893 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994158c2-d1f5-4473-9b5c-16d60a3cc6bb admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:23.732963 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-994158c2-d1f5-4473-9b5c-16d60a3cc6bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:23.789833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994158c2-d1f5-4473-9b5c-16d60a3cc6bb admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:23.793471 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c13b8-ac6a-40b4-bc12-476038cc5f24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:23.794101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c13b8-ac6a-40b4-bc12-476038cc5f24 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:23.794385 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c13b8-ac6a-40b4-bc12-476038cc5f24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:23.794662 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c13b8-ac6a-40b4-bc12-476038cc5f24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:23.804043 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c13b8-ac6a-40b4-bc12-476038cc5f24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:23.805515 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c13b8-ac6a-40b4-bc12-476038cc5f24 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:23.814802 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1163/2356] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:49:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:49:24.343294 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48272a45-2109-4bf6-8d95-57e0abc84c9e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:24.403815 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48272a45-2109-4bf6-8d95-57e0abc84c9e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:24.408433 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9751a-c764-4f65-ab1c-f1e9c0fe4552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:24.409343 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9751a-c764-4f65-ab1c-f1e9c0fe4552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:24.409621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9751a-c764-4f65-ab1c-f1e9c0fe4552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:24.409891 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9751a-c764-4f65-ab1c-f1e9c0fe4552 admin admin] PATH_INFO: `/v3/users/3949dde156144e62b5447353e078f5a7` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:24.411580 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9751a-c764-4f65-ab1c-f1e9c0fe4552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3949dde156144e62b5447353e078f5a7)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:24.413538 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9751a-c764-4f65-ab1c-f1e9c0fe4552 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:24.455088 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1dd9751a-c764-4f65-ab1c-f1e9c0fe4552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3949dde156144e62b5447353e078f5a7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:24.466987 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1dd9751a-c764-4f65-ab1c-f1e9c0fe4552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3949dde156144e62b5447353e078f5a7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:24.467624 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1dd9751a-c764-4f65-ab1c-f1e9c0fe4552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3949dde156144e62b5447353e078f5a7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:24.474821 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1dd9751a-c764-4f65-ab1c-f1e9c0fe4552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3949dde156144e62b5447353e078f5a7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:24.475434 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1dd9751a-c764-4f65-ab1c-f1e9c0fe4552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3949dde156144e62b5447353e078f5a7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:24.483670 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:24.489447 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1194/2357] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:49:24 2022] DELETE /identity/v3/users/3949dde156144e62b5447353e078f5a7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:24.493990 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c539a-e6c6-4827-b697-0fd4a5ae7821 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:24.494320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c539a-e6c6-4827-b697-0fd4a5ae7821 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:24.494633 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c539a-e6c6-4827-b697-0fd4a5ae7821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:24.512194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d50c539a-e6c6-4827-b697-0fd4a5ae7821 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:24.513413 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d50c539a-e6c6-4827-b697-0fd4a5ae7821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:24.570108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1164/2358] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:49:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:24.579897 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9751a-c764-4f65-ab1c-f1e9c0fe4552 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:24.581300 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1dd9751a-c764-4f65-ab1c-f1e9c0fe4552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:24.637691 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9751a-c764-4f65-ab1c-f1e9c0fe4552 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:24.641249 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa00d0-7c72-4c64-ad4d-9422a609b885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:24.641873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa00d0-7c72-4c64-ad4d-9422a609b885 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:24.642151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa00d0-7c72-4c64-ad4d-9422a609b885 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:24.642423 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa00d0-7c72-4c64-ad4d-9422a609b885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:24.651666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa00d0-7c72-4c64-ad4d-9422a609b885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:24.653118 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa00d0-7c72-4c64-ad4d-9422a609b885 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:24.662208 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1195/2359] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:49:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:49:24.935848 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c539a-e6c6-4827-b697-0fd4a5ae7821 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:24.937288 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d50c539a-e6c6-4827-b697-0fd4a5ae7821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:24.950425 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c539a-e6c6-4827-b697-0fd4a5ae7821 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:24.955062 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6dd5ef-fd36-4af8-801a-cb85571d931b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:24.955916 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6dd5ef-fd36-4af8-801a-cb85571d931b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:24.956219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6dd5ef-fd36-4af8-801a-cb85571d931b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:24.956483 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6dd5ef-fd36-4af8-801a-cb85571d931b admin admin] PATH_INFO: `/v3/projects/d12334c8806f40d1bbc8b4adbb7b2088` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:24.957684 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6dd5ef-fd36-4af8-801a-cb85571d931b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d12334c8806f40d1bbc8b4adbb7b2088)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:24.959601 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6dd5ef-fd36-4af8-801a-cb85571d931b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:24.980543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:25.006766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bf6dd5ef-fd36-4af8-801a-cb85571d931b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd12334c8806f40d1bbc8b4adbb7b2088', 'request_id': 'req-bf6dd5ef-fd36-4af8-801a-cb85571d931b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:25.013936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bf6dd5ef-fd36-4af8-801a-cb85571d931b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd12334c8806f40d1bbc8b4adbb7b2088', 'request_id': 'req-bf6dd5ef-fd36-4af8-801a-cb85571d931b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:25.019470 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bf6dd5ef-fd36-4af8-801a-cb85571d931b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd12334c8806f40d1bbc8b4adbb7b2088', 'request_id': 'req-bf6dd5ef-fd36-4af8-801a-cb85571d931b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:25.030460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bf6dd5ef-fd36-4af8-801a-cb85571d931b admin admin] The token cache is being invalidate because project d12334c8806f40d1bbc8b4adbb7b2088 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:49:25.030748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bf6dd5ef-fd36-4af8-801a-cb85571d931b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:25.031365 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bf6dd5ef-fd36-4af8-801a-cb85571d931b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:25.033063 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1165/2360] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:49:24 2022] DELETE /identity/v3/projects/d12334c8806f40d1bbc8b4adbb7b2088 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:25.036993 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa00d0-7c72-4c64-ad4d-9422a609b885 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:25.046339 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa00d0-7c72-4c64-ad4d-9422a609b885 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:25.102140 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd018f4-6f68-423e-92ad-8c0da2813e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:25.103023 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd018f4-6f68-423e-92ad-8c0da2813e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:25.103244 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd018f4-6f68-423e-92ad-8c0da2813e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:25.103518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd018f4-6f68-423e-92ad-8c0da2813e0c admin admin] PATH_INFO: `/v3/users/cbc3fa9c3e254c86968b974d2769b878` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:25.104710 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd018f4-6f68-423e-92ad-8c0da2813e0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbc3fa9c3e254c86968b974d2769b878)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:25.106651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd018f4-6f68-423e-92ad-8c0da2813e0c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:25.151534 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fbd018f4-6f68-423e-92ad-8c0da2813e0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbc3fa9c3e254c86968b974d2769b878'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:25.162940 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fbd018f4-6f68-423e-92ad-8c0da2813e0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbc3fa9c3e254c86968b974d2769b878'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:25.163582 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fbd018f4-6f68-423e-92ad-8c0da2813e0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbc3fa9c3e254c86968b974d2769b878'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:25.170201 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fbd018f4-6f68-423e-92ad-8c0da2813e0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbc3fa9c3e254c86968b974d2769b878'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:25.170809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fbd018f4-6f68-423e-92ad-8c0da2813e0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbc3fa9c3e254c86968b974d2769b878'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:25.183886 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1196/2361] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:49:25 2022] DELETE /identity/v3/users/cbc3fa9c3e254c86968b974d2769b878 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:25.449699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6dd5ef-fd36-4af8-801a-cb85571d931b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:25.451192 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-bf6dd5ef-fd36-4af8-801a-cb85571d931b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:25.465005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6dd5ef-fd36-4af8-801a-cb85571d931b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:25.522584 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5bce4-218d-4237-817d-aab3d62a3652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:25.523433 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5bce4-218d-4237-817d-aab3d62a3652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:25.523715 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5bce4-218d-4237-817d-aab3d62a3652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:25.523988 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5bce4-218d-4237-817d-aab3d62a3652 admin admin] PATH_INFO: `/v3/projects/a95eb4314529463693804205b241992d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:25.525137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5bce4-218d-4237-817d-aab3d62a3652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a95eb4314529463693804205b241992d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:25.527045 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5bce4-218d-4237-817d-aab3d62a3652 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:25.570810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-eee5bce4-218d-4237-817d-aab3d62a3652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a95eb4314529463693804205b241992d', 'request_id': 'req-eee5bce4-218d-4237-817d-aab3d62a3652'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:25.578299 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-eee5bce4-218d-4237-817d-aab3d62a3652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a95eb4314529463693804205b241992d', 'request_id': 'req-eee5bce4-218d-4237-817d-aab3d62a3652'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:25.584679 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-eee5bce4-218d-4237-817d-aab3d62a3652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a95eb4314529463693804205b241992d', 'request_id': 'req-eee5bce4-218d-4237-817d-aab3d62a3652'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:25.595458 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-eee5bce4-218d-4237-817d-aab3d62a3652 admin admin] The token cache is being invalidate because project a95eb4314529463693804205b241992d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:49:25.595747 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-eee5bce4-218d-4237-817d-aab3d62a3652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:25.596371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-eee5bce4-218d-4237-817d-aab3d62a3652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:25.597925 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1166/2362] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:49:25 2022] DELETE /identity/v3/projects/a95eb4314529463693804205b241992d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:25.602767 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2860096-423a-45a3-98e4-7c51cf869afb None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:25.603215 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2860096-423a-45a3-98e4-7c51cf869afb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:25.603342 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2860096-423a-45a3-98e4-7c51cf869afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:25.621610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c2860096-423a-45a3-98e4-7c51cf869afb None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:25.622783 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c2860096-423a-45a3-98e4-7c51cf869afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:25.635616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:25.681920 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1197/2363] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:25.743195 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146ae0d-e1e6-4e8f-ab47-3e7c4617fde2 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:25.743493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146ae0d-e1e6-4e8f-ab47-3e7c4617fde2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:25.743777 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146ae0d-e1e6-4e8f-ab47-3e7c4617fde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:25.763325 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b146ae0d-e1e6-4e8f-ab47-3e7c4617fde2 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:25.764556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b146ae0d-e1e6-4e8f-ab47-3e7c4617fde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:25.772427 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1167/2364] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:25.776585 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2860096-423a-45a3-98e4-7c51cf869afb None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:25.786239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2860096-423a-45a3-98e4-7c51cf869afb None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:25.790697 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e1ea5-ee00-4151-84ee-8ee49afd7354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:25.791338 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e1ea5-ee00-4151-84ee-8ee49afd7354 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:25.791621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e1ea5-ee00-4151-84ee-8ee49afd7354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:25.791897 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e1ea5-ee00-4151-84ee-8ee49afd7354 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:25.792642 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e1ea5-ee00-4151-84ee-8ee49afd7354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:49:25.792946 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e1ea5-ee00-4151-84ee-8ee49afd7354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:25.794528 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e1ea5-ee00-4151-84ee-8ee49afd7354 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:25.806232 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1198/2365] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:49:25.810692 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146ae0d-e1e6-4e8f-ab47-3e7c4617fde2 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:25.820409 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146ae0d-e1e6-4e8f-ab47-3e7c4617fde2 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:25.825064 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d856cf-315e-4468-b0d2-57cc337c3211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:25.825697 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d856cf-315e-4468-b0d2-57cc337c3211 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:25.826006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d856cf-315e-4468-b0d2-57cc337c3211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:25.826282 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d856cf-315e-4468-b0d2-57cc337c3211 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:25.826970 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d856cf-315e-4468-b0d2-57cc337c3211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:25.828905 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d856cf-315e-4468-b0d2-57cc337c3211 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:25.853739 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1168/2366] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:49:25 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:49:25.857077 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e1ea5-ee00-4151-84ee-8ee49afd7354 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:25.867566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e1ea5-ee00-4151-84ee-8ee49afd7354 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:25.921983 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac0975-3edc-44bb-8d25-53a3e81a4aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:25.922570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac0975-3edc-44bb-8d25-53a3e81a4aae admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:25.922853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac0975-3edc-44bb-8d25-53a3e81a4aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:25.923128 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac0975-3edc-44bb-8d25-53a3e81a4aae admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:25.923811 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac0975-3edc-44bb-8d25-53a3e81a4aae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:25.925748 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac0975-3edc-44bb-8d25-53a3e81a4aae admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:25.944605 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1199/2367] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:49:25 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:49:25.948589 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d856cf-315e-4468-b0d2-57cc337c3211 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:25.958692 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d856cf-315e-4468-b0d2-57cc337c3211 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:25.963181 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592438c0-c295-47d1-ae78-638ab89c853f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:25.963822 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592438c0-c295-47d1-ae78-638ab89c853f admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:25.964102 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592438c0-c295-47d1-ae78-638ab89c853f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:25.964382 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592438c0-c295-47d1-ae78-638ab89c853f admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:25.965137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592438c0-c295-47d1-ae78-638ab89c853f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:25.966735 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592438c0-c295-47d1-ae78-638ab89c853f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:25.968723 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:25.978877 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1169/2368] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:49:25.982482 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac0975-3edc-44bb-8d25-53a3e81a4aae admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:25.993654 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac0975-3edc-44bb-8d25-53a3e81a4aae admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:25.998197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106702d-3536-45dc-8cd9-31b88c64c1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:25.998844 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106702d-3536-45dc-8cd9-31b88c64c1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:25.999125 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106702d-3536-45dc-8cd9-31b88c64c1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:25.999400 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106702d-3536-45dc-8cd9-31b88c64c1a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:26.000110 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106702d-3536-45dc-8cd9-31b88c64c1a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:26.001726 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106702d-3536-45dc-8cd9-31b88c64c1a4 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:26.012141 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1200/2369] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:49:26.016280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592438c0-c295-47d1-ae78-638ab89c853f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:26.026346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592438c0-c295-47d1-ae78-638ab89c853f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:26.031217 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a947d0-d34f-4949-882f-25b64b0a2cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:26.032085 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a947d0-d34f-4949-882f-25b64b0a2cb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:26.032370 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a947d0-d34f-4949-882f-25b64b0a2cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:26.032695 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a947d0-d34f-4949-882f-25b64b0a2cb9 admin admin] PATH_INFO: `/v3/projects/34c35a2341164e508d5b9289ab4743c0/users/5cc859c13f4546dd8aa03ff4cfaa7204/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:26.048067 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a947d0-d34f-4949-882f-25b64b0a2cb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34c35a2341164e508d5b9289ab4743c0, user_id=5cc859c13f4546dd8aa03ff4cfaa7204, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:26.050769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a947d0-d34f-4949-882f-25b64b0a2cb9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:26.064921 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1170/2370] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:49:26 2022] PUT /identity/v3/projects/34c35a2341164e508d5b9289ab4743c0/users/5cc859c13f4546dd8aa03ff4cfaa7204/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:26.075167 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ce31f-345d-41c1-bf80-33bbdf92845c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:26.075475 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ce31f-345d-41c1-bf80-33bbdf92845c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:26.075752 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ce31f-345d-41c1-bf80-33bbdf92845c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:26.103142 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d02ce31f-345d-41c1-bf80-33bbdf92845c None None] MFA Rules not processed for user `5cc859c13f4546dd8aa03ff4cfaa7204`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:26.104345 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d02ce31f-345d-41c1-bf80-33bbdf92845c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:26.168477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1201/2371] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:49:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:26.173057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a947d0-d34f-4949-882f-25b64b0a2cb9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:26.234375 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a947d0-d34f-4949-882f-25b64b0a2cb9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:26.238928 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1736cf6-4a75-423a-80ed-127ac77f2016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:26.239610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1736cf6-4a75-423a-80ed-127ac77f2016 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:26.239893 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1736cf6-4a75-423a-80ed-127ac77f2016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:26.240719 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1736cf6-4a75-423a-80ed-127ac77f2016 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:26.241391 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1736cf6-4a75-423a-80ed-127ac77f2016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:26.243310 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1736cf6-4a75-423a-80ed-127ac77f2016 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:26.275329 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1171/2372] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:49:26 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:49:26.279469 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ce31f-345d-41c1-bf80-33bbdf92845c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:26.290592 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ce31f-345d-41c1-bf80-33bbdf92845c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:26.301731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:26.346857 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b9849-0d85-4742-9ddc-9e63f11b30d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:26.347512 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b9849-0d85-4742-9ddc-9e63f11b30d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:26.347793 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b9849-0d85-4742-9ddc-9e63f11b30d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:26.348068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b9849-0d85-4742-9ddc-9e63f11b30d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:26.349382 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b9849-0d85-4742-9ddc-9e63f11b30d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:26.351325 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b9849-0d85-4742-9ddc-9e63f11b30d4 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:26.371728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1202/2373] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:49:26 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:49:26.375697 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1736cf6-4a75-423a-80ed-127ac77f2016 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:26.386724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1736cf6-4a75-423a-80ed-127ac77f2016 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:26.391610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdb0d3-c059-4e7a-bd94-951d743db4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:26.392271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdb0d3-c059-4e7a-bd94-951d743db4df admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:26.392598 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdb0d3-c059-4e7a-bd94-951d743db4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:26.392879 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdb0d3-c059-4e7a-bd94-951d743db4df admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:26.393604 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdb0d3-c059-4e7a-bd94-951d743db4df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:26.395257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdb0d3-c059-4e7a-bd94-951d743db4df admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:26.406340 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1172/2374] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:49:26.410497 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b9849-0d85-4742-9ddc-9e63f11b30d4 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:26.420871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b9849-0d85-4742-9ddc-9e63f11b30d4 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:26.425489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48ef40-9855-42ec-8c8e-33840dce2742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:26.426078 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48ef40-9855-42ec-8c8e-33840dce2742 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:26.426359 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48ef40-9855-42ec-8c8e-33840dce2742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:26.426630 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48ef40-9855-42ec-8c8e-33840dce2742 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:26.427393 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48ef40-9855-42ec-8c8e-33840dce2742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:26.429025 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48ef40-9855-42ec-8c8e-33840dce2742 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:26.438862 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1203/2375] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:49:26.442906 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdb0d3-c059-4e7a-bd94-951d743db4df admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:26.452750 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdb0d3-c059-4e7a-bd94-951d743db4df admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:26.457330 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2d5d8-dcd5-4be8-bef9-9b51c33bb68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:26.458724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2d5d8-dcd5-4be8-bef9-9b51c33bb68c admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:26.459009 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2d5d8-dcd5-4be8-bef9-9b51c33bb68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:26.459284 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2d5d8-dcd5-4be8-bef9-9b51c33bb68c admin admin] PATH_INFO: `/v3/projects/1b551de32de848c6a618ef423bec56e1/users/ae9427ed654e49fdb808681727bfc1c4/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:26.473501 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2d5d8-dcd5-4be8-bef9-9b51c33bb68c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b551de32de848c6a618ef423bec56e1, user_id=ae9427ed654e49fdb808681727bfc1c4, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:26.476824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2d5d8-dcd5-4be8-bef9-9b51c33bb68c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:26.489809 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1173/2376] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:49:26 2022] PUT /identity/v3/projects/1b551de32de848c6a618ef423bec56e1/users/ae9427ed654e49fdb808681727bfc1c4/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:26.500279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae72b7-6f36-4965-9c09-c70c7de2d9cd None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:26.500602 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae72b7-6f36-4965-9c09-c70c7de2d9cd None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:26.500885 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae72b7-6f36-4965-9c09-c70c7de2d9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:26.529784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-6aae72b7-6f36-4965-9c09-c70c7de2d9cd None None] MFA Rules not processed for user `ae9427ed654e49fdb808681727bfc1c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:26.531193 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6aae72b7-6f36-4965-9c09-c70c7de2d9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:26.596053 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1204/2377] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:49:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:26.601026 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2d5d8-dcd5-4be8-bef9-9b51c33bb68c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:26.660992 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2d5d8-dcd5-4be8-bef9-9b51c33bb68c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:26.666303 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f38f78-c730-4cbe-8f48-a93a48df36d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:26.666951 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f38f78-c730-4cbe-8f48-a93a48df36d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:26.667237 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f38f78-c730-4cbe-8f48-a93a48df36d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:26.667516 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f38f78-c730-4cbe-8f48-a93a48df36d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:26.668235 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f38f78-c730-4cbe-8f48-a93a48df36d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:26.670232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f38f78-c730-4cbe-8f48-a93a48df36d9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:26.694911 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1174/2378] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:49:26 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:49:26.698838 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae72b7-6f36-4965-9c09-c70c7de2d9cd None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:26.711075 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae72b7-6f36-4965-9c09-c70c7de2d9cd None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:26.768658 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432b991-b1d1-4469-872c-dce4afdaa5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:26.769316 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432b991-b1d1-4469-872c-dce4afdaa5c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:26.769600 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432b991-b1d1-4469-872c-dce4afdaa5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:26.769879 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432b991-b1d1-4469-872c-dce4afdaa5c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:26.770586 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432b991-b1d1-4469-872c-dce4afdaa5c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:26.773088 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432b991-b1d1-4469-872c-dce4afdaa5c0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:26.791943 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1205/2379] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:49:26 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:49:26.795926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f38f78-c730-4cbe-8f48-a93a48df36d9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:26.806094 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f38f78-c730-4cbe-8f48-a93a48df36d9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:26.810630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fac88-9c44-498c-9998-887b6cefa057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:26.811275 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fac88-9c44-498c-9998-887b6cefa057 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:26.811561 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fac88-9c44-498c-9998-887b6cefa057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:26.811836 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fac88-9c44-498c-9998-887b6cefa057 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:26.812579 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028fac88-9c44-498c-9998-887b6cefa057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:26.814190 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028fac88-9c44-498c-9998-887b6cefa057 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:26.816181 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:26.826627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1175/2380] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:49:26.830390 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432b991-b1d1-4469-872c-dce4afdaa5c0 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:26.840758 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432b991-b1d1-4469-872c-dce4afdaa5c0 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:26.845318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e3856-9f1c-4b00-870c-7c162d85f768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:26.846224 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e3856-9f1c-4b00-870c-7c162d85f768 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:26.846480 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e3856-9f1c-4b00-870c-7c162d85f768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:26.846777 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e3856-9f1c-4b00-870c-7c162d85f768 admin admin] PATH_INFO: `/v3/projects/9e9b97b83c6146629eaf9e7ebaf061ef/users/6e43abd53fa3484882d6d698864f8320/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:26.857930 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:26.862327 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e3856-9f1c-4b00-870c-7c162d85f768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e9b97b83c6146629eaf9e7ebaf061ef, user_id=6e43abd53fa3484882d6d698864f8320, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:26.865523 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e3856-9f1c-4b00-870c-7c162d85f768 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:26.877334 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1206/2381] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:49:26 2022] PUT /identity/v3/projects/9e9b97b83c6146629eaf9e7ebaf061ef/users/6e43abd53fa3484882d6d698864f8320/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:49:26.881802 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fac88-9c44-498c-9998-887b6cefa057 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:26.891640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fac88-9c44-498c-9998-887b6cefa057 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:26.946769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640960d-19e5-48cf-b527-937b4dc53e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:26.947353 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640960d-19e5-48cf-b527-937b4dc53e95 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:26.947639 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640960d-19e5-48cf-b527-937b4dc53e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:26.947918 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640960d-19e5-48cf-b527-937b4dc53e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:26.948659 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640960d-19e5-48cf-b527-937b4dc53e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:26.950271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640960d-19e5-48cf-b527-937b4dc53e95 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:26.960371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1176/2382] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:49:26.964436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e3856-9f1c-4b00-870c-7c162d85f768 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:26.974586 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e3856-9f1c-4b00-870c-7c162d85f768 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:26.979081 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6f9e9-d746-45fb-b58b-25461884a936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:26.979973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6f9e9-d746-45fb-b58b-25461884a936 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:26.980258 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6f9e9-d746-45fb-b58b-25461884a936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:26.980546 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6f9e9-d746-45fb-b58b-25461884a936 admin admin] PATH_INFO: `/v3/projects/9e9b97b83c6146629eaf9e7ebaf061ef/users/6e43abd53fa3484882d6d698864f8320/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:26.982469 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6f9e9-d746-45fb-b58b-25461884a936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e9b97b83c6146629eaf9e7ebaf061ef, user_id=6e43abd53fa3484882d6d698864f8320, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:26.985373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6f9e9-d746-45fb-b58b-25461884a936 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:26.995231 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1207/2383] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:49:26 2022] PUT /identity/v3/projects/9e9b97b83c6146629eaf9e7ebaf061ef/users/6e43abd53fa3484882d6d698864f8320/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:27.006690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876d0b4-bdb4-47d4-ae28-e4ef1eb034d8 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:27.006983 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876d0b4-bdb4-47d4-ae28-e4ef1eb034d8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:27.007264 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876d0b4-bdb4-47d4-ae28-e4ef1eb034d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:27.033328 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a876d0b4-bdb4-47d4-ae28-e4ef1eb034d8 None None] MFA Rules not processed for user `6e43abd53fa3484882d6d698864f8320`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:27.034550 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a876d0b4-bdb4-47d4-ae28-e4ef1eb034d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:27.102302 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1177/2384] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:49:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:27.113572 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6f9e9-d746-45fb-b58b-25461884a936 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:27.115855 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3db6f9e9-d746-45fb-b58b-25461884a936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:27.173586 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6f9e9-d746-45fb-b58b-25461884a936 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:27.178436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecc38d-b2df-47aa-a8b2-718692f71c68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:27.179114 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecc38d-b2df-47aa-a8b2-718692f71c68 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:27.179396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecc38d-b2df-47aa-a8b2-718692f71c68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:27.179672 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecc38d-b2df-47aa-a8b2-718692f71c68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:27.234996 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecc38d-b2df-47aa-a8b2-718692f71c68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:27.236356 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecc38d-b2df-47aa-a8b2-718692f71c68 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:27.245656 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1208/2385] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:49:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:49:28.940876 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876d0b4-bdb4-47d4-ae28-e4ef1eb034d8 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:28.942289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a876d0b4-bdb4-47d4-ae28-e4ef1eb034d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:28.954241 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876d0b4-bdb4-47d4-ae28-e4ef1eb034d8 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:28.957679 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1ab8d-b9a8-403f-96cf-f9cfc7e4fef8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:28.958314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1ab8d-b9a8-403f-96cf-f9cfc7e4fef8 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:28.958600 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1ab8d-b9a8-403f-96cf-f9cfc7e4fef8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:28.958875 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1ab8d-b9a8-403f-96cf-f9cfc7e4fef8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:29.016955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1ab8d-b9a8-403f-96cf-f9cfc7e4fef8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:29.018416 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1ab8d-b9a8-403f-96cf-f9cfc7e4fef8 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:29.027464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1178/2386] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:49:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:49:29.577520 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecc38d-b2df-47aa-a8b2-718692f71c68 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:29.586780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecc38d-b2df-47aa-a8b2-718692f71c68 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:29.590375 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d3eb8-2418-4c0a-b8a5-f8820f5927ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:29.591003 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d3eb8-2418-4c0a-b8a5-f8820f5927ab service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:29.591286 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d3eb8-2418-4c0a-b8a5-f8820f5927ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:29.591591 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d3eb8-2418-4c0a-b8a5-f8820f5927ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:29.601445 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d3eb8-2418-4c0a-b8a5-f8820f5927ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:29.602866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d3eb8-2418-4c0a-b8a5-f8820f5927ab service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:29.612553 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1209/2387] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:49:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:49:33.453751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1ab8d-b9a8-403f-96cf-f9cfc7e4fef8 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:33.474589 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:33.520624 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1ab8d-b9a8-403f-96cf-f9cfc7e4fef8 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:33.525032 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d36437-fa4a-4b5b-8a6c-f2342838ec60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:33.525997 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d36437-fa4a-4b5b-8a6c-f2342838ec60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:33.526290 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d36437-fa4a-4b5b-8a6c-f2342838ec60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:33.526570 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d36437-fa4a-4b5b-8a6c-f2342838ec60 admin admin] PATH_INFO: `/v3/users/5cc859c13f4546dd8aa03ff4cfaa7204` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:33.527763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d36437-fa4a-4b5b-8a6c-f2342838ec60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cc859c13f4546dd8aa03ff4cfaa7204)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:33.529745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d36437-fa4a-4b5b-8a6c-f2342838ec60 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:33.581125 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-96d36437-fa4a-4b5b-8a6c-f2342838ec60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cc859c13f4546dd8aa03ff4cfaa7204'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:33.581821 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-96d36437-fa4a-4b5b-8a6c-f2342838ec60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cc859c13f4546dd8aa03ff4cfaa7204'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:33.589740 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-96d36437-fa4a-4b5b-8a6c-f2342838ec60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cc859c13f4546dd8aa03ff4cfaa7204'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:33.590166 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-96d36437-fa4a-4b5b-8a6c-f2342838ec60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cc859c13f4546dd8aa03ff4cfaa7204'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:33.597924 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-96d36437-fa4a-4b5b-8a6c-f2342838ec60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cc859c13f4546dd8aa03ff4cfaa7204'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:33.619080 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1179/2388] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:49:33 2022] DELETE /identity/v3/users/5cc859c13f4546dd8aa03ff4cfaa7204 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:49:33.621500 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4e836-3387-422e-8583-280af34fb358 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:33.621972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4e836-3387-422e-8583-280af34fb358 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:33.622068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4e836-3387-422e-8583-280af34fb358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:33.638550 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-34c4e836-3387-422e-8583-280af34fb358 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:33.639754 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-34c4e836-3387-422e-8583-280af34fb358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:33.697408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1210/2389] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:33.706993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d36437-fa4a-4b5b-8a6c-f2342838ec60 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:33.708405 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-96d36437-fa4a-4b5b-8a6c-f2342838ec60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:33.765239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d36437-fa4a-4b5b-8a6c-f2342838ec60 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:33.768892 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009e6d0-d6dc-45d8-9cfa-4a0df0f29773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:33.769555 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009e6d0-d6dc-45d8-9cfa-4a0df0f29773 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:33.769843 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009e6d0-d6dc-45d8-9cfa-4a0df0f29773 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:33.770123 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009e6d0-d6dc-45d8-9cfa-4a0df0f29773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:33.779134 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009e6d0-d6dc-45d8-9cfa-4a0df0f29773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:33.780599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009e6d0-d6dc-45d8-9cfa-4a0df0f29773 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:33.790393 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1180/2390] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:49:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:49:34.051699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4e836-3387-422e-8583-280af34fb358 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:34.053775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-34c4e836-3387-422e-8583-280af34fb358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:34.065819 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4e836-3387-422e-8583-280af34fb358 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:34.071207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b57c7-f60f-4034-8d3b-f707e29f5fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:34.072062 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b57c7-f60f-4034-8d3b-f707e29f5fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:34.072458 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b57c7-f60f-4034-8d3b-f707e29f5fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:34.072767 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b57c7-f60f-4034-8d3b-f707e29f5fb1 admin admin] PATH_INFO: `/v3/projects/34c35a2341164e508d5b9289ab4743c0` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:34.073944 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b57c7-f60f-4034-8d3b-f707e29f5fb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34c35a2341164e508d5b9289ab4743c0)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:34.075955 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b57c7-f60f-4034-8d3b-f707e29f5fb1 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:34.087800 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:34.124291 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f00b57c7-f60f-4034-8d3b-f707e29f5fb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34c35a2341164e508d5b9289ab4743c0', 'request_id': 'req-f00b57c7-f60f-4034-8d3b-f707e29f5fb1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:34.132824 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f00b57c7-f60f-4034-8d3b-f707e29f5fb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34c35a2341164e508d5b9289ab4743c0', 'request_id': 'req-f00b57c7-f60f-4034-8d3b-f707e29f5fb1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:34.139068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f00b57c7-f60f-4034-8d3b-f707e29f5fb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34c35a2341164e508d5b9289ab4743c0', 'request_id': 'req-f00b57c7-f60f-4034-8d3b-f707e29f5fb1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:34.149186 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f00b57c7-f60f-4034-8d3b-f707e29f5fb1 admin admin] The token cache is being invalidate because project 34c35a2341164e508d5b9289ab4743c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:49:34.149472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f00b57c7-f60f-4034-8d3b-f707e29f5fb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:34.150110 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f00b57c7-f60f-4034-8d3b-f707e29f5fb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:34.151651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1211/2391] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:49:34 2022] DELETE /identity/v3/projects/34c35a2341164e508d5b9289ab4743c0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:34.155862 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009e6d0-d6dc-45d8-9cfa-4a0df0f29773 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:34.169401 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009e6d0-d6dc-45d8-9cfa-4a0df0f29773 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:34.209122 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:34.229092 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c5832-e4bc-4c1e-a501-8305ea939cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:34.229946 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c5832-e4bc-4c1e-a501-8305ea939cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:34.230230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c5832-e4bc-4c1e-a501-8305ea939cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:34.230505 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c5832-e4bc-4c1e-a501-8305ea939cc8 admin admin] PATH_INFO: `/v3/users/ae9427ed654e49fdb808681727bfc1c4` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:34.231685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c5832-e4bc-4c1e-a501-8305ea939cc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae9427ed654e49fdb808681727bfc1c4)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:34.233915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c5832-e4bc-4c1e-a501-8305ea939cc8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:34.279698 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f86c5832-e4bc-4c1e-a501-8305ea939cc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae9427ed654e49fdb808681727bfc1c4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:34.280341 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f86c5832-e4bc-4c1e-a501-8305ea939cc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae9427ed654e49fdb808681727bfc1c4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:34.287213 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f86c5832-e4bc-4c1e-a501-8305ea939cc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae9427ed654e49fdb808681727bfc1c4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:34.287936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f86c5832-e4bc-4c1e-a501-8305ea939cc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae9427ed654e49fdb808681727bfc1c4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:34.296150 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f86c5832-e4bc-4c1e-a501-8305ea939cc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae9427ed654e49fdb808681727bfc1c4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:34.313494 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1181/2392] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:49:34 2022] DELETE /identity/v3/users/ae9427ed654e49fdb808681727bfc1c4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:34.577094 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b57c7-f60f-4034-8d3b-f707e29f5fb1 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:34.578541 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f00b57c7-f60f-4034-8d3b-f707e29f5fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:34.604935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b57c7-f60f-4034-8d3b-f707e29f5fb1 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:34.660883 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f313698-5261-42bc-b67a-e55b84c08448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:34.661752 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f313698-5261-42bc-b67a-e55b84c08448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:34.662035 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f313698-5261-42bc-b67a-e55b84c08448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:34.662318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f313698-5261-42bc-b67a-e55b84c08448 admin admin] PATH_INFO: `/v3/projects/1b551de32de848c6a618ef423bec56e1` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:34.664187 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f313698-5261-42bc-b67a-e55b84c08448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b551de32de848c6a618ef423bec56e1)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:34.666158 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f313698-5261-42bc-b67a-e55b84c08448 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:34.715411 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9f313698-5261-42bc-b67a-e55b84c08448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b551de32de848c6a618ef423bec56e1', 'request_id': 'req-9f313698-5261-42bc-b67a-e55b84c08448'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:34.723037 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9f313698-5261-42bc-b67a-e55b84c08448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b551de32de848c6a618ef423bec56e1', 'request_id': 'req-9f313698-5261-42bc-b67a-e55b84c08448'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:34.730580 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9f313698-5261-42bc-b67a-e55b84c08448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b551de32de848c6a618ef423bec56e1', 'request_id': 'req-9f313698-5261-42bc-b67a-e55b84c08448'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:34.741524 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9f313698-5261-42bc-b67a-e55b84c08448 admin admin] The token cache is being invalidate because project 1b551de32de848c6a618ef423bec56e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:49:34.741810 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9f313698-5261-42bc-b67a-e55b84c08448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:34.742451 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9f313698-5261-42bc-b67a-e55b84c08448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:34.744084 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1212/2393] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:49:34 2022] DELETE /identity/v3/projects/1b551de32de848c6a618ef423bec56e1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:34.747938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c5832-e4bc-4c1e-a501-8305ea939cc8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:34.749389 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f86c5832-e4bc-4c1e-a501-8305ea939cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:34.762004 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c5832-e4bc-4c1e-a501-8305ea939cc8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:34.819018 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f2f83-99c8-4713-8c29-254a62312f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:34.819931 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f2f83-99c8-4713-8c29-254a62312f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:34.820163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f2f83-99c8-4713-8c29-254a62312f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:34.820438 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f2f83-99c8-4713-8c29-254a62312f24 admin admin] PATH_INFO: `/v3/users/6e43abd53fa3484882d6d698864f8320` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:34.821627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f2f83-99c8-4713-8c29-254a62312f24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e43abd53fa3484882d6d698864f8320)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:34.823536 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f2f83-99c8-4713-8c29-254a62312f24 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:34.866835 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-606f2f83-99c8-4713-8c29-254a62312f24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e43abd53fa3484882d6d698864f8320'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:34.867459 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-606f2f83-99c8-4713-8c29-254a62312f24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e43abd53fa3484882d6d698864f8320'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:34.874311 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-606f2f83-99c8-4713-8c29-254a62312f24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e43abd53fa3484882d6d698864f8320'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:34.874962 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-606f2f83-99c8-4713-8c29-254a62312f24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e43abd53fa3484882d6d698864f8320'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:34.878554 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:34.882220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-606f2f83-99c8-4713-8c29-254a62312f24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e43abd53fa3484882d6d698864f8320'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:34.902289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1182/2394] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:49:34 2022] DELETE /identity/v3/users/6e43abd53fa3484882d6d698864f8320 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:35.176862 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f313698-5261-42bc-b67a-e55b84c08448 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:35.178345 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9f313698-5261-42bc-b67a-e55b84c08448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:35.192191 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f313698-5261-42bc-b67a-e55b84c08448 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:35.222154 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:35.250732 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4b606-8eb1-482b-ad24-09d3e0b61238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:35.251582 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4b606-8eb1-482b-ad24-09d3e0b61238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:35.251861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4b606-8eb1-482b-ad24-09d3e0b61238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:35.252134 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4b606-8eb1-482b-ad24-09d3e0b61238 admin admin] PATH_INFO: `/v3/projects/9e9b97b83c6146629eaf9e7ebaf061ef` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:35.253350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4b606-8eb1-482b-ad24-09d3e0b61238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e9b97b83c6146629eaf9e7ebaf061ef)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:35.255262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4b606-8eb1-482b-ad24-09d3e0b61238 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:35.300490 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-03d4b606-8eb1-482b-ad24-09d3e0b61238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e9b97b83c6146629eaf9e7ebaf061ef', 'request_id': 'req-03d4b606-8eb1-482b-ad24-09d3e0b61238'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:35.307779 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-03d4b606-8eb1-482b-ad24-09d3e0b61238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e9b97b83c6146629eaf9e7ebaf061ef', 'request_id': 'req-03d4b606-8eb1-482b-ad24-09d3e0b61238'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:35.314105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-03d4b606-8eb1-482b-ad24-09d3e0b61238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e9b97b83c6146629eaf9e7ebaf061ef', 'request_id': 'req-03d4b606-8eb1-482b-ad24-09d3e0b61238'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:35.324610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-03d4b606-8eb1-482b-ad24-09d3e0b61238 admin admin] The token cache is being invalidate because project 9e9b97b83c6146629eaf9e7ebaf061ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:49:35.324893 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-03d4b606-8eb1-482b-ad24-09d3e0b61238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:35.325516 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-03d4b606-8eb1-482b-ad24-09d3e0b61238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:49:35.327033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1213/2395] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:49:35 2022] DELETE /identity/v3/projects/9e9b97b83c6146629eaf9e7ebaf061ef => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:49:35.332127 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c340a-2acb-40dc-80be-f0d51a2bbc9b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:35.332421 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c340a-2acb-40dc-80be-f0d51a2bbc9b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:35.332740 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c340a-2acb-40dc-80be-f0d51a2bbc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:35.350347 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ef6c340a-2acb-40dc-80be-f0d51a2bbc9b None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:35.351469 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ef6c340a-2acb-40dc-80be-f0d51a2bbc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:35.410341 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1183/2396] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:35.418133 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ab029-ee7c-4ef5-9141-b8e00c83f196 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:35.418420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ab029-ee7c-4ef5-9141-b8e00c83f196 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:35.418695 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ab029-ee7c-4ef5-9141-b8e00c83f196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:35.437406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-2a8ab029-ee7c-4ef5-9141-b8e00c83f196 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:35.438601 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2a8ab029-ee7c-4ef5-9141-b8e00c83f196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:35.447100 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1214/2397] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:35.451343 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c340a-2acb-40dc-80be-f0d51a2bbc9b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:35.461108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c340a-2acb-40dc-80be-f0d51a2bbc9b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:35.465625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16f706-b8f5-42aa-b83f-c8340aad4694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:35.466261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16f706-b8f5-42aa-b83f-c8340aad4694 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:35.466541 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16f706-b8f5-42aa-b83f-c8340aad4694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:35.466881 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16f706-b8f5-42aa-b83f-c8340aad4694 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:35.467605 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16f706-b8f5-42aa-b83f-c8340aad4694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:49:35.467909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16f706-b8f5-42aa-b83f-c8340aad4694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:35.469534 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16f706-b8f5-42aa-b83f-c8340aad4694 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:35.481279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1184/2398] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:49:35.485853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ab029-ee7c-4ef5-9141-b8e00c83f196 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:35.495575 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ab029-ee7c-4ef5-9141-b8e00c83f196 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:35.500156 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e2fab-5fde-470a-8285-4f1793890315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:35.500832 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e2fab-5fde-470a-8285-4f1793890315 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:35.501113 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e2fab-5fde-470a-8285-4f1793890315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:35.501386 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e2fab-5fde-470a-8285-4f1793890315 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:35.502064 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e2fab-5fde-470a-8285-4f1793890315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:35.503957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e2fab-5fde-470a-8285-4f1793890315 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:35.528993 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1215/2399] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:49:35 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:49:35.533259 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16f706-b8f5-42aa-b83f-c8340aad4694 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:35.543193 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16f706-b8f5-42aa-b83f-c8340aad4694 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:35.597714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3787bd-dd74-4e9b-b405-e0d356425b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:35.598369 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3787bd-dd74-4e9b-b405-e0d356425b0d admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:35.598659 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3787bd-dd74-4e9b-b405-e0d356425b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:35.599230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3787bd-dd74-4e9b-b405-e0d356425b0d admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:35.600072 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3787bd-dd74-4e9b-b405-e0d356425b0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:35.602121 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3787bd-dd74-4e9b-b405-e0d356425b0d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:35.621919 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1185/2400] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:49:35 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:49:35.625950 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e2fab-5fde-470a-8285-4f1793890315 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:35.636710 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e2fab-5fde-470a-8285-4f1793890315 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:35.641246 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41dde6-ccf7-4bc2-b00f-3b28f764850c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:35.641895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41dde6-ccf7-4bc2-b00f-3b28f764850c admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:35.642180 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41dde6-ccf7-4bc2-b00f-3b28f764850c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:35.642457 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41dde6-ccf7-4bc2-b00f-3b28f764850c admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:35.643169 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41dde6-ccf7-4bc2-b00f-3b28f764850c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:35.644782 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41dde6-ccf7-4bc2-b00f-3b28f764850c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:35.655034 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1216/2401] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:49:35.658697 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3787bd-dd74-4e9b-b405-e0d356425b0d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:35.668979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3787bd-dd74-4e9b-b405-e0d356425b0d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:35.673578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19358293-9553-4c77-9c7b-48339ec72aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:35.674238 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19358293-9553-4c77-9c7b-48339ec72aef admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:35.674508 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19358293-9553-4c77-9c7b-48339ec72aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:35.674789 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19358293-9553-4c77-9c7b-48339ec72aef admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:35.675508 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19358293-9553-4c77-9c7b-48339ec72aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:35.677147 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19358293-9553-4c77-9c7b-48339ec72aef admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:35.687441 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1186/2402] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:49:35.691201 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41dde6-ccf7-4bc2-b00f-3b28f764850c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:35.701147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41dde6-ccf7-4bc2-b00f-3b28f764850c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:35.705637 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eed3b9-e411-4a3c-85a1-17b2a98137c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:35.706491 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eed3b9-e411-4a3c-85a1-17b2a98137c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:35.706772 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eed3b9-e411-4a3c-85a1-17b2a98137c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:35.707051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eed3b9-e411-4a3c-85a1-17b2a98137c3 admin admin] PATH_INFO: `/v3/projects/9d4ab649bf434f78b83122111ec19083/users/9a24491b2e4545e289fa4f1cff4f30d1/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:35.721520 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eed3b9-e411-4a3c-85a1-17b2a98137c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d4ab649bf434f78b83122111ec19083, user_id=9a24491b2e4545e289fa4f1cff4f30d1, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:35.724156 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eed3b9-e411-4a3c-85a1-17b2a98137c3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:35.737593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1217/2403] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:49:35 2022] PUT /identity/v3/projects/9d4ab649bf434f78b83122111ec19083/users/9a24491b2e4545e289fa4f1cff4f30d1/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:35.742477 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a93232-512f-482d-bdb8-d4f55a066f1b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:35.742777 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a93232-512f-482d-bdb8-d4f55a066f1b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:35.743061 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a93232-512f-482d-bdb8-d4f55a066f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:35.760993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d5a93232-512f-482d-bdb8-d4f55a066f1b None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:35.762175 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d5a93232-512f-482d-bdb8-d4f55a066f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:35.807521 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:35.828582 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1187/2404] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:35.838658 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eed3b9-e411-4a3c-85a1-17b2a98137c3 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:35.840360 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-73eed3b9-e411-4a3c-85a1-17b2a98137c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:35.899819 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eed3b9-e411-4a3c-85a1-17b2a98137c3 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:35.903498 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7cb35-4539-4428-b148-a00b4d9a39c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:35.904140 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7cb35-4539-4428-b148-a00b4d9a39c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:35.904431 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7cb35-4539-4428-b148-a00b4d9a39c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:35.904751 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7cb35-4539-4428-b148-a00b4d9a39c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:35.914902 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7cb35-4539-4428-b148-a00b4d9a39c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:35.916339 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7cb35-4539-4428-b148-a00b4d9a39c4 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:35.921378 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:35.926858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1218/2405] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:49:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:49:39.840016 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbb573-6bcb-47cc-a0b0-495c4348265d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:39.840594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbb573-6bcb-47cc-a0b0-495c4348265d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:39.840594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbb573-6bcb-47cc-a0b0-495c4348265d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:39.870698 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-51fbb573-6bcb-47cc-a0b0-495c4348265d None None] MFA Rules not processed for user `9a24491b2e4545e289fa4f1cff4f30d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:39.872037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-51fbb573-6bcb-47cc-a0b0-495c4348265d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:39.944758 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1188/2406] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:49:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:39.949381 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7cb35-4539-4428-b148-a00b4d9a39c4 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:39.959466 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7cb35-4539-4428-b148-a00b4d9a39c4 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:39.964794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59064d-853a-48f1-a351-1f20a52cf2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:39.965455 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59064d-853a-48f1-a351-1f20a52cf2ef admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:39.965740 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59064d-853a-48f1-a351-1f20a52cf2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:39.966019 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59064d-853a-48f1-a351-1f20a52cf2ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:39.967370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59064d-853a-48f1-a351-1f20a52cf2ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:39.969364 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59064d-853a-48f1-a351-1f20a52cf2ef admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:39.997953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1219/2407] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:49:39 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:49:40.002038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbb573-6bcb-47cc-a0b0-495c4348265d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:40.013745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbb573-6bcb-47cc-a0b0-495c4348265d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:40.072822 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cd7da-d445-4161-9c8e-fbfd3928c224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:40.073589 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cd7da-d445-4161-9c8e-fbfd3928c224 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:40.073948 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cd7da-d445-4161-9c8e-fbfd3928c224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:40.074314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cd7da-d445-4161-9c8e-fbfd3928c224 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:40.075086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cd7da-d445-4161-9c8e-fbfd3928c224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:40.077239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cd7da-d445-4161-9c8e-fbfd3928c224 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:40.101926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1189/2408] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:49:40 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:49:40.103190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59064d-853a-48f1-a351-1f20a52cf2ef admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:40.114084 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59064d-853a-48f1-a351-1f20a52cf2ef admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:40.118835 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91810436-be4d-4120-8aaf-9f65e5655a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:40.119634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91810436-be4d-4120-8aaf-9f65e5655a02 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:40.119938 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91810436-be4d-4120-8aaf-9f65e5655a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:40.120279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91810436-be4d-4120-8aaf-9f65e5655a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:40.121200 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91810436-be4d-4120-8aaf-9f65e5655a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:40.122914 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91810436-be4d-4120-8aaf-9f65e5655a02 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:40.135041 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1220/2409] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:49:40.139549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cd7da-d445-4161-9c8e-fbfd3928c224 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:40.150985 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cd7da-d445-4161-9c8e-fbfd3928c224 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:40.155889 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bee118-0f8a-4a9d-9a9b-0beff0baa90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:40.156827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bee118-0f8a-4a9d-9a9b-0beff0baa90e admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:40.157135 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bee118-0f8a-4a9d-9a9b-0beff0baa90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:40.157420 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bee118-0f8a-4a9d-9a9b-0beff0baa90e admin admin] PATH_INFO: `/v3/projects/aff0e117e98b47f69ba9c5c5b6ae0189/users/3d4ebe7ef0e14f1ca8a6b88b73c14760/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:40.176048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bee118-0f8a-4a9d-9a9b-0beff0baa90e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aff0e117e98b47f69ba9c5c5b6ae0189, user_id=3d4ebe7ef0e14f1ca8a6b88b73c14760, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:40.178884 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bee118-0f8a-4a9d-9a9b-0beff0baa90e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:40.198556 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91810436-be4d-4120-8aaf-9f65e5655a02 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:40.198999 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1190/2410] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:49:40 2022] PUT /identity/v3/projects/aff0e117e98b47f69ba9c5c5b6ae0189/users/3d4ebe7ef0e14f1ca8a6b88b73c14760/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:40.220235 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91810436-be4d-4120-8aaf-9f65e5655a02 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:40.295237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85f1e3-9e78-4937-bd0b-cd8ceaa45629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:40.295909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85f1e3-9e78-4937-bd0b-cd8ceaa45629 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:40.296190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85f1e3-9e78-4937-bd0b-cd8ceaa45629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:40.296460 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85f1e3-9e78-4937-bd0b-cd8ceaa45629 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:40.297235 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85f1e3-9e78-4937-bd0b-cd8ceaa45629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:40.298821 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85f1e3-9e78-4937-bd0b-cd8ceaa45629 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:40.309786 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1221/2411] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:49:40.314058 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bee118-0f8a-4a9d-9a9b-0beff0baa90e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:40.329611 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bee118-0f8a-4a9d-9a9b-0beff0baa90e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:40.334433 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58ad9d-ca81-4b60-a3d5-36d0ce0ef240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:40.335901 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58ad9d-ca81-4b60-a3d5-36d0ce0ef240 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:40.336178 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58ad9d-ca81-4b60-a3d5-36d0ce0ef240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:40.336452 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58ad9d-ca81-4b60-a3d5-36d0ce0ef240 admin admin] PATH_INFO: `/v3/projects/aff0e117e98b47f69ba9c5c5b6ae0189/users/3d4ebe7ef0e14f1ca8a6b88b73c14760/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:40.338481 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c58ad9d-ca81-4b60-a3d5-36d0ce0ef240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aff0e117e98b47f69ba9c5c5b6ae0189, user_id=3d4ebe7ef0e14f1ca8a6b88b73c14760, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:40.341192 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c58ad9d-ca81-4b60-a3d5-36d0ce0ef240 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:40.352191 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1191/2412] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:49:40 2022] PUT /identity/v3/projects/aff0e117e98b47f69ba9c5c5b6ae0189/users/3d4ebe7ef0e14f1ca8a6b88b73c14760/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:49:45.079139 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b511a-a13b-417d-8417-2ba0c787b48b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:45.079664 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b511a-a13b-417d-8417-2ba0c787b48b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:45.079780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b511a-a13b-417d-8417-2ba0c787b48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:45.106216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c52b511a-a13b-417d-8417-2ba0c787b48b None None] MFA Rules not processed for user `3d4ebe7ef0e14f1ca8a6b88b73c14760`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:45.107350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c52b511a-a13b-417d-8417-2ba0c787b48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:45.179484 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1222/2413] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:49:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:45.191725 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58ad9d-ca81-4b60-a3d5-36d0ce0ef240 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:45.193492 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4c58ad9d-ca81-4b60-a3d5-36d0ce0ef240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:45.225727 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:45.263143 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58ad9d-ca81-4b60-a3d5-36d0ce0ef240 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:45.267103 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b6736-2d58-4988-80bf-f41d5496846e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2522b8560d224aa1a973207a79ce6a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:45.267837 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b6736-2d58-4988-80bf-f41d5496846e service glance] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:45.268131 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b6736-2d58-4988-80bf-f41d5496846e service glance] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:45.268410 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b6736-2d58-4988-80bf-f41d5496846e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:45.331648 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b6736-2d58-4988-80bf-f41d5496846e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:45.333350 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b6736-2d58-4988-80bf-f41d5496846e service glance] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:45.344972 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1192/2414] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:49:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:49:45.448378 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691c0af-5ae6-4c8f-893a-e79f1f85a304 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:45.448711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691c0af-5ae6-4c8f-893a-e79f1f85a304 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:45.448997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691c0af-5ae6-4c8f-893a-e79f1f85a304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:45.469065 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-2691c0af-5ae6-4c8f-893a-e79f1f85a304 None None] MFA Rules not processed for user `a2bd48e6390241448fe2cf098ab64df3`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:45.470278 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2691c0af-5ae6-4c8f-893a-e79f1f85a304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:45.526225 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:45.541837 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1223/2415] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 30 10:49:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:45.594889 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b6736-2d58-4988-80bf-f41d5496846e service glance] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:45.596542 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fc4b6736-2d58-4988-80bf-f41d5496846e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:45.669005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b6736-2d58-4988-80bf-f41d5496846e service glance] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:45.674867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977b276-eed3-4863-8ae8-478de02e1486 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c15327c36c8c49ac87a3b3e9ab49eea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:45.675538 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977b276-eed3-4863-8ae8-478de02e1486 service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:45.676359 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977b276-eed3-4863-8ae8-478de02e1486 service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:45.676359 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977b276-eed3-4863-8ae8-478de02e1486 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:45.686912 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977b276-eed3-4863-8ae8-478de02e1486 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:45.688564 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977b276-eed3-4863-8ae8-478de02e1486 service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:45.703659 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1193/2416] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 30 10:49:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:49:50.064698 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ccacf-d0f5-404e-9d0e-8a0ebb205733 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:50.065195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ccacf-d0f5-404e-9d0e-8a0ebb205733 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:50.065302 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ccacf-d0f5-404e-9d0e-8a0ebb205733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:50.089149 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-478ccacf-d0f5-404e-9d0e-8a0ebb205733 None None] MFA Rules not processed for user `a2bd48e6390241448fe2cf098ab64df3`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:50.090395 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-478ccacf-d0f5-404e-9d0e-8a0ebb205733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:50.098097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1224/2417] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 30 10:49:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:50.112028 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977b276-eed3-4863-8ae8-478de02e1486 service swift] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:50.125589 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977b276-eed3-4863-8ae8-478de02e1486 service swift] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:50.133440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67b8aa-1045-4af4-9c68-803718485d75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c15327c36c8c49ac87a3b3e9ab49eea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:50.134481 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67b8aa-1045-4af4-9c68-803718485d75 service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:50.134914 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67b8aa-1045-4af4-9c68-803718485d75 service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:50.135281 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67b8aa-1045-4af4-9c68-803718485d75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:50.154043 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67b8aa-1045-4af4-9c68-803718485d75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:50.155764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67b8aa-1045-4af4-9c68-803718485d75 service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:50.173465 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1194/2418] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 30 10:49:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:49:55.989142 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39d8f5-6e5f-4684-886b-57718c455478 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:55.990226 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39d8f5-6e5f-4684-886b-57718c455478 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:55.990226 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39d8f5-6e5f-4684-886b-57718c455478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:56.009268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-5c39d8f5-6e5f-4684-886b-57718c455478 None None] MFA Rules not processed for user `9a24491b2e4545e289fa4f1cff4f30d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:56.010622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-5c39d8f5-6e5f-4684-886b-57718c455478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:56.023273 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1225/2419] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:49:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:58.052058 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd0cd1-1d9a-4135-bee0-d901fda7fc5d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:58.053509 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd0cd1-1d9a-4135-bee0-d901fda7fc5d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:58.053977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd0cd1-1d9a-4135-bee0-d901fda7fc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:58.075973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b8dd0cd1-1d9a-4135-bee0-d901fda7fc5d None None] MFA Rules not processed for user `a2bd48e6390241448fe2cf098ab64df3`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:49:58.077280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b8dd0cd1-1d9a-4135-bee0-d901fda7fc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:58.085058 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1195/2420] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 30 10:49:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:49:58.102385 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39d8f5-6e5f-4684-886b-57718c455478 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:58.121999 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39d8f5-6e5f-4684-886b-57718c455478 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:58.132187 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ea738-651c-43cc-9cdd-e1815998a048 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c15327c36c8c49ac87a3b3e9ab49eea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:58.133198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ea738-651c-43cc-9cdd-e1815998a048 service swift] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:58.133878 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ea738-651c-43cc-9cdd-e1815998a048 service swift] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:58.134193 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ea738-651c-43cc-9cdd-e1815998a048 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:58.146834 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ea738-651c-43cc-9cdd-e1815998a048 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:58.148787 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ea738-651c-43cc-9cdd-e1815998a048 service swift] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:58.159439 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1226/2421] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 30 10:49:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:49:59.017848 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd0cd1-1d9a-4135-bee0-d901fda7fc5d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:49:59.108253 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd0cd1-1d9a-4135-bee0-d901fda7fc5d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:49:59.115039 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61489f62-e09a-4d2f-867f-cc2023f9e02f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:49:59.116476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61489f62-e09a-4d2f-867f-cc2023f9e02f service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:49:59.117075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61489f62-e09a-4d2f-867f-cc2023f9e02f service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:49:59.117580 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61489f62-e09a-4d2f-867f-cc2023f9e02f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:49:59.120690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-61489f62-e09a-4d2f-867f-cc2023f9e02f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:49:59.127392 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:49:59.233068 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61489f62-e09a-4d2f-867f-cc2023f9e02f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:49:59.237333 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61489f62-e09a-4d2f-867f-cc2023f9e02f service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:49:59.264431 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1196/2422] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:49:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:50:02.439664 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ea738-651c-43cc-9cdd-e1815998a048 service swift] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:02.449791 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ea738-651c-43cc-9cdd-e1815998a048 service swift] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:02.453731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d5e72-f924-4700-9608-7dabaaa08fb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:02.454433 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d5e72-f924-4700-9608-7dabaaa08fb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:02.454879 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d5e72-f924-4700-9608-7dabaaa08fb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:02.455269 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d5e72-f924-4700-9608-7dabaaa08fb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:02.457761 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-238d5e72-f924-4700-9608-7dabaaa08fb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:02.471577 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d5e72-f924-4700-9608-7dabaaa08fb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:02.473028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d5e72-f924-4700-9608-7dabaaa08fb9 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:02.486702 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1227/2423] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:50:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:50:09.252104 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=31 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:12.481782 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=21 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:17.899325 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61489f62-e09a-4d2f-867f-cc2023f9e02f service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:17.900915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-61489f62-e09a-4d2f-867f-cc2023f9e02f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:17.914528 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61489f62-e09a-4d2f-867f-cc2023f9e02f service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:17.919944 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44fa1e-ac91-4f16-86d5-8431e09588bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:17.920610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44fa1e-ac91-4f16-86d5-8431e09588bc service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:17.920896 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44fa1e-ac91-4f16-86d5-8431e09588bc service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:17.921180 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44fa1e-ac91-4f16-86d5-8431e09588bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:17.922861 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9f44fa1e-ac91-4f16-86d5-8431e09588bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:17.999982 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44fa1e-ac91-4f16-86d5-8431e09588bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:18.001774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44fa1e-ac91-4f16-86d5-8431e09588bc service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:18.020794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1197/2424] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:50:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:50:19.103857 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ff216-750e-4e4e-bbd0-ec8843abcbfa None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:19.104429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ff216-750e-4e4e-bbd0-ec8843abcbfa None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:19.104429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ff216-750e-4e4e-bbd0-ec8843abcbfa None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:19.105964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1228/2425] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 30 10:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:50:19.114535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa13625-2a36-49f5-a545-d200b5e38bfd None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:19.115043 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa13625-2a36-49f5-a545-d200b5e38bfd None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:19.115148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa13625-2a36-49f5-a545-d200b5e38bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:19.136527 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4fa13625-2a36-49f5-a545-d200b5e38bfd None None] MFA Rules not processed for user `1bfd036d747241d9bc314b60bf8648b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:50:19.137809 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4fa13625-2a36-49f5-a545-d200b5e38bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:19.147672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1198/2426] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 30 10:50:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:50:19.159339 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ff216-750e-4e4e-bbd0-ec8843abcbfa None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:19.170354 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ff216-750e-4e4e-bbd0-ec8843abcbfa None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:19.174244 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb837fa1-b660-4b3c-8d74-9c9cf563d85d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2522b8560d224aa1a973207a79ce6a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:19.174890 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb837fa1-b660-4b3c-8d74-9c9cf563d85d service glance] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:19.175176 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb837fa1-b660-4b3c-8d74-9c9cf563d85d service glance] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:19.175458 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb837fa1-b660-4b3c-8d74-9c9cf563d85d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:19.186300 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb837fa1-b660-4b3c-8d74-9c9cf563d85d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:19.187722 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb837fa1-b660-4b3c-8d74-9c9cf563d85d service glance] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:19.199145 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1229/2427] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:50:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:50:19.266403 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ede29-f859-4fb0-955e-873d46b7c111 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:19.266927 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ede29-f859-4fb0-955e-873d46b7c111 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:19.267373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ede29-f859-4fb0-955e-873d46b7c111 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:19.268851 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1199/2428] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 30 10:50:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:50:19.275032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553fd21-42cc-4751-a0a2-51af98c20a5f None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:19.275387 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553fd21-42cc-4751-a0a2-51af98c20a5f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:19.275666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553fd21-42cc-4751-a0a2-51af98c20a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:19.310798 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c553fd21-42cc-4751-a0a2-51af98c20a5f None None] MFA Rules not processed for user `fa8cb52425ba42d9ae3576e6fb18dc88`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:50:19.311977 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c553fd21-42cc-4751-a0a2-51af98c20a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:19.319150 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1230/2429] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 30 10:50:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:50:19.331374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ede29-f859-4fb0-955e-873d46b7c111 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:19.333238 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-278ede29-f859-4fb0-955e-873d46b7c111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:19.347004 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ede29-f859-4fb0-955e-873d46b7c111 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:19.350608 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f739081-190f-42c7-993a-abde7bdba7f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:19.351246 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f739081-190f-42c7-993a-abde7bdba7f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:19.351530 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f739081-190f-42c7-993a-abde7bdba7f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:19.351808 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f739081-190f-42c7-993a-abde7bdba7f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:19.359384 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f739081-190f-42c7-993a-abde7bdba7f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:19.360987 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f739081-190f-42c7-993a-abde7bdba7f3 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:19.369065 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1200/2430] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:50:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:50:19.451283 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f3283-4d05-430f-bf5b-90d600741a7b None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:19.451584 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f3283-4d05-430f-bf5b-90d600741a7b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:19.451862 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f3283-4d05-430f-bf5b-90d600741a7b None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:19.453297 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1231/2431] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 30 10:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:50:19.458867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ad16f-068e-4b98-b0af-201cb3914fbb None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:19.459720 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ad16f-068e-4b98-b0af-201cb3914fbb None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:19.460031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ad16f-068e-4b98-b0af-201cb3914fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:19.478177 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e21ad16f-068e-4b98-b0af-201cb3914fbb None None] MFA Rules not processed for user `1bfd036d747241d9bc314b60bf8648b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:50:19.479543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e21ad16f-068e-4b98-b0af-201cb3914fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:19.489067 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1201/2432] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 30 10:50:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:50:19.499369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f3283-4d05-430f-bf5b-90d600741a7b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:19.511328 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f3283-4d05-430f-bf5b-90d600741a7b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:19.515366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b9367-dc2c-4424-9612-cd46f39d21a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:19.516079 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b9367-dc2c-4424-9612-cd46f39d21a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:19.516439 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b9367-dc2c-4424-9612-cd46f39d21a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:19.516825 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b9367-dc2c-4424-9612-cd46f39d21a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:19.528060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b9367-dc2c-4424-9612-cd46f39d21a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:19.529563 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b9367-dc2c-4424-9612-cd46f39d21a0 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:19.540325 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1232/2433] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:50:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:50:20.919616 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ad16f-068e-4b98-b0af-201cb3914fbb None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:20.935212 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ad16f-068e-4b98-b0af-201cb3914fbb None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:20.940710 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed115b61-8aa5-4db5-8abf-8baca183646a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:20.941687 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed115b61-8aa5-4db5-8abf-8baca183646a service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:20.942177 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed115b61-8aa5-4db5-8abf-8baca183646a service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:20.942641 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed115b61-8aa5-4db5-8abf-8baca183646a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:20.946465 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ed115b61-8aa5-4db5-8abf-8baca183646a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:21.062225 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed115b61-8aa5-4db5-8abf-8baca183646a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:21.063934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed115b61-8aa5-4db5-8abf-8baca183646a service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:21.089551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1202/2434] 10.222.0.59 () {60 vars in 1396 bytes} [Thu Jun 30 10:50:20 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:50:23.260570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79de6a-b23b-407d-9756-20bd1e15f211 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:23.261063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79de6a-b23b-407d-9756-20bd1e15f211 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:23.261155 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79de6a-b23b-407d-9756-20bd1e15f211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:23.281474 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-6d79de6a-b23b-407d-9756-20bd1e15f211 None None] MFA Rules not processed for user `a2bd48e6390241448fe2cf098ab64df3`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:50:23.282826 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6d79de6a-b23b-407d-9756-20bd1e15f211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:23.290633 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1233/2435] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 30 10:50:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:50:23.303178 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed115b61-8aa5-4db5-8abf-8baca183646a service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:23.315014 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed115b61-8aa5-4db5-8abf-8baca183646a service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:23.321840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78dbf64-8d9c-4ad8-8664-2e50fb833b26 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c15327c36c8c49ac87a3b3e9ab49eea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:23.322754 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78dbf64-8d9c-4ad8-8664-2e50fb833b26 service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:23.323043 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78dbf64-8d9c-4ad8-8664-2e50fb833b26 service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:23.323351 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78dbf64-8d9c-4ad8-8664-2e50fb833b26 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:23.332431 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78dbf64-8d9c-4ad8-8664-2e50fb833b26 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:23.334138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78dbf64-8d9c-4ad8-8664-2e50fb833b26 service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:23.339078 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:23.343320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1203/2436] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 30 10:50:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:50:26.099358 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d7ed1-72a6-4942-b207-9a3daf8295ab None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:26.100424 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d7ed1-72a6-4942-b207-9a3daf8295ab None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:26.100933 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d7ed1-72a6-4942-b207-9a3daf8295ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:26.134197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-769d7ed1-72a6-4942-b207-9a3daf8295ab None None] MFA Rules not processed for user `d6a194d68415422fbc6ca75a8dbccf22`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:50:26.135719 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-769d7ed1-72a6-4942-b207-9a3daf8295ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:26.148289 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1234/2437] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:50:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:50:36.128756 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=30 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:50:39.107734 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78dbf64-8d9c-4ad8-8664-2e50fb833b26 service swift] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:39.118408 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78dbf64-8d9c-4ad8-8664-2e50fb833b26 service swift] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:39.122136 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0efd9-5ea5-48af-9f57-9567e125100d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:39.122785 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0efd9-5ea5-48af-9f57-9567e125100d service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:39.123066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0efd9-5ea5-48af-9f57-9567e125100d service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:39.123336 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0efd9-5ea5-48af-9f57-9567e125100d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:39.125380 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b8a0efd9-5ea5-48af-9f57-9567e125100d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:39.136769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0efd9-5ea5-48af-9f57-9567e125100d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:39.138235 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0efd9-5ea5-48af-9f57-9567e125100d service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:39.148854 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1204/2438] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:50:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:50:39.811618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d7ed1-72a6-4942-b207-9a3daf8295ab None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:39.814009 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-769d7ed1-72a6-4942-b207-9a3daf8295ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:39.837456 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d7ed1-72a6-4942-b207-9a3daf8295ab None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:39.843681 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2f142-8937-4461-a793-838b8612a56e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:39.844648 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2f142-8937-4461-a793-838b8612a56e service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:39.845102 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2f142-8937-4461-a793-838b8612a56e service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:39.845544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2f142-8937-4461-a793-838b8612a56e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:39.848006 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9dd2f142-8937-4461-a793-838b8612a56e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:39.864321 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2f142-8937-4461-a793-838b8612a56e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:39.866050 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2f142-8937-4461-a793-838b8612a56e service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:39.880867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1235/2439] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:50:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:50:44.622668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52b57a-5f96-4beb-b82f-f5e511797165 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:44.623106 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52b57a-5f96-4beb-b82f-f5e511797165 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:44.623215 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52b57a-5f96-4beb-b82f-f5e511797165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:44.642448 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-da52b57a-5f96-4beb-b82f-f5e511797165 None None] MFA Rules not processed for user `a2bd48e6390241448fe2cf098ab64df3`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:50:44.643655 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-da52b57a-5f96-4beb-b82f-f5e511797165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:44.651537 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1205/2440] 10.222.0.59 () {58 vars in 967 bytes} [Thu Jun 30 10:50:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:50:44.664608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2f142-8937-4461-a793-838b8612a56e service nova] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:44.678406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2f142-8937-4461-a793-838b8612a56e service nova] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:44.684400 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad75db-adc4-4908-9bd0-44304bf32e0b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c15327c36c8c49ac87a3b3e9ab49eea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:44.685181 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad75db-adc4-4908-9bd0-44304bf32e0b service swift] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:44.685549 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad75db-adc4-4908-9bd0-44304bf32e0b service swift] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:44.685899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad75db-adc4-4908-9bd0-44304bf32e0b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:44.694935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad75db-adc4-4908-9bd0-44304bf32e0b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:44.697171 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad75db-adc4-4908-9bd0-44304bf32e0b service swift] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:44.706292 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1236/2441] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 30 10:50:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:50:46.688051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52b57a-5f96-4beb-b82f-f5e511797165 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:46.697139 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52b57a-5f96-4beb-b82f-f5e511797165 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:46.700666 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516391f9-4153-415f-bc97-d7b6d81b652b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:46.701289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516391f9-4153-415f-bc97-d7b6d81b652b service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:46.701569 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516391f9-4153-415f-bc97-d7b6d81b652b service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:46.701840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516391f9-4153-415f-bc97-d7b6d81b652b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:46.710529 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516391f9-4153-415f-bc97-d7b6d81b652b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:46.712455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516391f9-4153-415f-bc97-d7b6d81b652b service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:46.721679 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1206/2442] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:50:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:50:50.625643 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad75db-adc4-4908-9bd0-44304bf32e0b service swift] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:50:50.639041 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad75db-adc4-4908-9bd0-44304bf32e0b service swift] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:50:50.645507 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433aebb3-0de8-4577-aca6-bd9e727401b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:50:50.646175 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433aebb3-0de8-4577-aca6-bd9e727401b1 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:50:50.646462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433aebb3-0de8-4577-aca6-bd9e727401b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:50:50.646741 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433aebb3-0de8-4577-aca6-bd9e727401b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:50:50.648681 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-433aebb3-0de8-4577-aca6-bd9e727401b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:50:50.744848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433aebb3-0de8-4577-aca6-bd9e727401b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:50:50.746962 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433aebb3-0de8-4577-aca6-bd9e727401b1 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:50:50.791070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1237/2443] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:50:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:50:56.717560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=15 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:00.785888 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=53 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:22.358943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516391f9-4153-415f-bc97-d7b6d81b652b service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:22.367454 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516391f9-4153-415f-bc97-d7b6d81b652b service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:22.370991 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc80cca-f868-4cc9-83c2-a2e69b04d446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:22.371608 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc80cca-f868-4cc9-83c2-a2e69b04d446 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:22.371888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc80cca-f868-4cc9-83c2-a2e69b04d446 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:22.372159 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc80cca-f868-4cc9-83c2-a2e69b04d446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:22.373934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1dc80cca-f868-4cc9-83c2-a2e69b04d446 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:22.434008 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc80cca-f868-4cc9-83c2-a2e69b04d446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:22.435436 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc80cca-f868-4cc9-83c2-a2e69b04d446 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:22.445522 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1207/2444] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:25.190280 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433aebb3-0de8-4577-aca6-bd9e727401b1 service nova] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:25.192529 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-433aebb3-0de8-4577-aca6-bd9e727401b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:25.253010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc80cca-f868-4cc9-83c2-a2e69b04d446 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:25.256932 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1dc80cca-f868-4cc9-83c2-a2e69b04d446 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:25.279908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433aebb3-0de8-4577-aca6-bd9e727401b1 service nova] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:25.283386 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc80cca-f868-4cc9-83c2-a2e69b04d446 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:25.285156 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac79c13-a79c-48d3-a440-ff6380d274c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48709a771ab64ed38018873313f37c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:25.285877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac79c13-a79c-48d3-a440-ff6380d274c1 service placement] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:25.286257 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac79c13-a79c-48d3-a440-ff6380d274c1 service placement] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:25.286611 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac79c13-a79c-48d3-a440-ff6380d274c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:25.287974 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5f189-c147-4967-a67a-e923b6ff766c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:25.288372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6ac79c13-a79c-48d3-a440-ff6380d274c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:25.288884 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5f189-c147-4967-a67a-e923b6ff766c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:25.289167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5f189-c147-4967-a67a-e923b6ff766c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:25.289446 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5f189-c147-4967-a67a-e923b6ff766c admin admin] PATH_INFO: `/v3/users/131fb3808ea341618e17256b43862937` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:25.290623 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5f189-c147-4967-a67a-e923b6ff766c admin admin] RBAC: Authorizing `identity:delete_user(user_id=131fb3808ea341618e17256b43862937)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:25.292626 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5f189-c147-4967-a67a-e923b6ff766c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:25.300449 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac79c13-a79c-48d3-a440-ff6380d274c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:25.302041 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac79c13-a79c-48d3-a440-ff6380d274c1 service placement] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:25.312263 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1238/2445] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:25.340438 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-02b5f189-c147-4967-a67a-e923b6ff766c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '131fb3808ea341618e17256b43862937'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:25.341129 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-02b5f189-c147-4967-a67a-e923b6ff766c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '131fb3808ea341618e17256b43862937'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:25.348054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-02b5f189-c147-4967-a67a-e923b6ff766c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '131fb3808ea341618e17256b43862937'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:25.348787 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-02b5f189-c147-4967-a67a-e923b6ff766c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '131fb3808ea341618e17256b43862937'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:25.356247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-02b5f189-c147-4967-a67a-e923b6ff766c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '131fb3808ea341618e17256b43862937'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:25.374713 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1208/2446] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:51:25 2022] DELETE /identity/v3/users/131fb3808ea341618e17256b43862937 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:51:25.550378 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac79c13-a79c-48d3-a440-ff6380d274c1 service placement] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:25.568273 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac79c13-a79c-48d3-a440-ff6380d274c1 service placement] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:25.627237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6424048-512d-47ea-b607-66c82f158216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:25.628103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6424048-512d-47ea-b607-66c82f158216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:25.628387 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6424048-512d-47ea-b607-66c82f158216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:25.628703 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6424048-512d-47ea-b607-66c82f158216 admin admin] PATH_INFO: `/v3/projects/a531892a5f9e4964aa9b35519ad72b68` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:25.629880 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6424048-512d-47ea-b607-66c82f158216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a531892a5f9e4964aa9b35519ad72b68)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:25.631788 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6424048-512d-47ea-b607-66c82f158216 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:25.679374 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b6424048-512d-47ea-b607-66c82f158216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a531892a5f9e4964aa9b35519ad72b68', 'request_id': 'req-b6424048-512d-47ea-b607-66c82f158216'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:25.688448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b6424048-512d-47ea-b607-66c82f158216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a531892a5f9e4964aa9b35519ad72b68', 'request_id': 'req-b6424048-512d-47ea-b607-66c82f158216'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:25.695186 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b6424048-512d-47ea-b607-66c82f158216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a531892a5f9e4964aa9b35519ad72b68', 'request_id': 'req-b6424048-512d-47ea-b607-66c82f158216'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:25.706567 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b6424048-512d-47ea-b607-66c82f158216 admin admin] The token cache is being invalidate because project a531892a5f9e4964aa9b35519ad72b68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:51:25.706859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b6424048-512d-47ea-b607-66c82f158216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:25.707489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b6424048-512d-47ea-b607-66c82f158216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:25.709067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1239/2447] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:51:25 2022] DELETE /identity/v3/projects/a531892a5f9e4964aa9b35519ad72b68 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:25.713937 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae28ae4-be9e-4bcb-bc58-1928e3fcc380 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:25.714233 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae28ae4-be9e-4bcb-bc58-1928e3fcc380 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:25.714518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae28ae4-be9e-4bcb-bc58-1928e3fcc380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:25.733818 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-eae28ae4-be9e-4bcb-bc58-1928e3fcc380 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:25.734954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-eae28ae4-be9e-4bcb-bc58-1928e3fcc380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:25.795274 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1209/2448] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:25.803791 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9b533-d1a9-4370-9f1f-d6919e251662 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:25.804081 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9b533-d1a9-4370-9f1f-d6919e251662 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:25.804359 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9b533-d1a9-4370-9f1f-d6919e251662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:25.822521 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-51d9b533-d1a9-4370-9f1f-d6919e251662 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:25.823712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-51d9b533-d1a9-4370-9f1f-d6919e251662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:25.831460 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1240/2449] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:25.835492 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae28ae4-be9e-4bcb-bc58-1928e3fcc380 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:25.845549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae28ae4-be9e-4bcb-bc58-1928e3fcc380 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:25.849967 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fb59b-69e4-42ae-b8f4-e691eb1ea645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:25.850604 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fb59b-69e4-42ae-b8f4-e691eb1ea645 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:25.850885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fb59b-69e4-42ae-b8f4-e691eb1ea645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:25.851161 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fb59b-69e4-42ae-b8f4-e691eb1ea645 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:25.851923 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fb59b-69e4-42ae-b8f4-e691eb1ea645 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:51:25.852228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fb59b-69e4-42ae-b8f4-e691eb1ea645 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:25.853875 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fb59b-69e4-42ae-b8f4-e691eb1ea645 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:25.855290 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:25.867845 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1210/2450] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:51:25.871824 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9b533-d1a9-4370-9f1f-d6919e251662 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:25.880907 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9b533-d1a9-4370-9f1f-d6919e251662 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:25.885498 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e83ab-c708-444b-aaa2-dce45d5b60f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:25.886162 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e83ab-c708-444b-aaa2-dce45d5b60f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:25.886445 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e83ab-c708-444b-aaa2-dce45d5b60f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:25.886719 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e83ab-c708-444b-aaa2-dce45d5b60f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:25.887395 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e83ab-c708-444b-aaa2-dce45d5b60f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:25.889362 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e83ab-c708-444b-aaa2-dce45d5b60f0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:25.898925 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:25.916327 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1241/2451] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:25 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:25.921119 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fb59b-69e4-42ae-b8f4-e691eb1ea645 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:25.930705 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fb59b-69e4-42ae-b8f4-e691eb1ea645 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:25.986305 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5396f0e-cd3a-44d3-bd0f-ea31d900ea21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:25.986892 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5396f0e-cd3a-44d3-bd0f-ea31d900ea21 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:25.987176 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5396f0e-cd3a-44d3-bd0f-ea31d900ea21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:25.987450 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5396f0e-cd3a-44d3-bd0f-ea31d900ea21 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:25.988160 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5396f0e-cd3a-44d3-bd0f-ea31d900ea21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:25.990140 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5396f0e-cd3a-44d3-bd0f-ea31d900ea21 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:26.009121 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1211/2452] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:25 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:26.013135 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e83ab-c708-444b-aaa2-dce45d5b60f0 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:26.023404 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e83ab-c708-444b-aaa2-dce45d5b60f0 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:26.027949 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e45881-c553-4827-a896-c54df7fc0097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:26.028654 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e45881-c553-4827-a896-c54df7fc0097 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:26.028933 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e45881-c553-4827-a896-c54df7fc0097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:26.029207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e45881-c553-4827-a896-c54df7fc0097 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:26.030409 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e45881-c553-4827-a896-c54df7fc0097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:26.031985 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e45881-c553-4827-a896-c54df7fc0097 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:26.043181 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1242/2453] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:26.047094 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5396f0e-cd3a-44d3-bd0f-ea31d900ea21 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:26.057068 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5396f0e-cd3a-44d3-bd0f-ea31d900ea21 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:26.061729 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851737c-9548-40a9-a08b-bfe1001e1ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:26.062371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851737c-9548-40a9-a08b-bfe1001e1ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:26.062658 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851737c-9548-40a9-a08b-bfe1001e1ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:26.062937 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851737c-9548-40a9-a08b-bfe1001e1ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:26.063655 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851737c-9548-40a9-a08b-bfe1001e1ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:26.065303 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851737c-9548-40a9-a08b-bfe1001e1ba8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:26.075072 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1212/2454] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:26.079363 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e45881-c553-4827-a896-c54df7fc0097 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:26.089037 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e45881-c553-4827-a896-c54df7fc0097 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:26.094034 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5eab0e-5391-4c00-a0b0-bf24f4982a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:26.094880 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5eab0e-5391-4c00-a0b0-bf24f4982a6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:26.095155 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5eab0e-5391-4c00-a0b0-bf24f4982a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:26.095426 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5eab0e-5391-4c00-a0b0-bf24f4982a6f admin admin] PATH_INFO: `/v3/projects/ae43fd98d2b1407bb68f444a936d65cd/users/9ddd9836ac224c4fbea1b3443da4455e/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:26.109771 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5eab0e-5391-4c00-a0b0-bf24f4982a6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae43fd98d2b1407bb68f444a936d65cd, user_id=9ddd9836ac224c4fbea1b3443da4455e, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:26.112395 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5eab0e-5391-4c00-a0b0-bf24f4982a6f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:26.124880 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1243/2455] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:26 2022] PUT /identity/v3/projects/ae43fd98d2b1407bb68f444a936d65cd/users/9ddd9836ac224c4fbea1b3443da4455e/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:51:26.134886 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6501c7-78d9-41ed-94d3-2091038e7fff None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:26.135183 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6501c7-78d9-41ed-94d3-2091038e7fff None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:26.135465 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6501c7-78d9-41ed-94d3-2091038e7fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:26.162411 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7e6501c7-78d9-41ed-94d3-2091038e7fff None None] MFA Rules not processed for user `9ddd9836ac224c4fbea1b3443da4455e`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:26.163598 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7e6501c7-78d9-41ed-94d3-2091038e7fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:26.226720 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1213/2456] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:51:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:26.238055 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5eab0e-5391-4c00-a0b0-bf24f4982a6f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:26.239661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-af5eab0e-5391-4c00-a0b0-bf24f4982a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:26.312472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5eab0e-5391-4c00-a0b0-bf24f4982a6f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:26.317988 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd716bc-821c-4070-a57f-0910163e1166 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:26.318617 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd716bc-821c-4070-a57f-0910163e1166 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:26.318898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd716bc-821c-4070-a57f-0910163e1166 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:26.319174 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd716bc-821c-4070-a57f-0910163e1166 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:26.326872 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd716bc-821c-4070-a57f-0910163e1166 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:26.328447 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd716bc-821c-4070-a57f-0910163e1166 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:26.337079 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1244/2457] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:34.598873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6501c7-78d9-41ed-94d3-2091038e7fff None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:34.660045 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6501c7-78d9-41ed-94d3-2091038e7fff None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:34.664530 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7c08d-7348-4cb9-9a4c-51c1f2f3d169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:34.665383 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7c08d-7348-4cb9-9a4c-51c1f2f3d169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:34.665664 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7c08d-7348-4cb9-9a4c-51c1f2f3d169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:34.665938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7c08d-7348-4cb9-9a4c-51c1f2f3d169 admin admin] PATH_INFO: `/v3/users/9ddd9836ac224c4fbea1b3443da4455e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:34.667106 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7c08d-7348-4cb9-9a4c-51c1f2f3d169 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ddd9836ac224c4fbea1b3443da4455e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:34.669069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7c08d-7348-4cb9-9a4c-51c1f2f3d169 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:34.671807 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:34.715756 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-66b7c08d-7348-4cb9-9a4c-51c1f2f3d169 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ddd9836ac224c4fbea1b3443da4455e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:34.716406 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-66b7c08d-7348-4cb9-9a4c-51c1f2f3d169 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ddd9836ac224c4fbea1b3443da4455e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:34.723870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-66b7c08d-7348-4cb9-9a4c-51c1f2f3d169 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ddd9836ac224c4fbea1b3443da4455e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:34.724495 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-66b7c08d-7348-4cb9-9a4c-51c1f2f3d169 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ddd9836ac224c4fbea1b3443da4455e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:34.731693 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-66b7c08d-7348-4cb9-9a4c-51c1f2f3d169 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ddd9836ac224c4fbea1b3443da4455e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:34.749621 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1214/2458] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:51:34 2022] DELETE /identity/v3/users/9ddd9836ac224c4fbea1b3443da4455e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:34.754054 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac02492-aec2-47fa-b745-fa48a525295d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:34.754555 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac02492-aec2-47fa-b745-fa48a525295d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:34.754660 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac02492-aec2-47fa-b745-fa48a525295d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:34.771173 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-dac02492-aec2-47fa-b745-fa48a525295d None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:34.772331 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-dac02492-aec2-47fa-b745-fa48a525295d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:34.830401 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1245/2459] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:34.839888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7c08d-7348-4cb9-9a4c-51c1f2f3d169 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:34.841295 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-66b7c08d-7348-4cb9-9a4c-51c1f2f3d169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:34.898876 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7c08d-7348-4cb9-9a4c-51c1f2f3d169 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:34.902458 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171789c-2046-478c-a911-39ec5e65fc79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:34.903090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171789c-2046-478c-a911-39ec5e65fc79 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:34.903380 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171789c-2046-478c-a911-39ec5e65fc79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:34.903655 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171789c-2046-478c-a911-39ec5e65fc79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:34.912654 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171789c-2046-478c-a911-39ec5e65fc79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:34.914116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171789c-2046-478c-a911-39ec5e65fc79 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:34.925430 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1215/2460] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:35.196827 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac02492-aec2-47fa-b745-fa48a525295d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:35.198350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-dac02492-aec2-47fa-b745-fa48a525295d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:35.211388 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac02492-aec2-47fa-b745-fa48a525295d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:35.216217 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6fd4a-b03b-44f1-b8a5-a495a8c62732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:35.217734 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6fd4a-b03b-44f1-b8a5-a495a8c62732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:35.218020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6fd4a-b03b-44f1-b8a5-a495a8c62732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:35.218295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6fd4a-b03b-44f1-b8a5-a495a8c62732 admin admin] PATH_INFO: `/v3/projects/ae43fd98d2b1407bb68f444a936d65cd` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:35.219507 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6fd4a-b03b-44f1-b8a5-a495a8c62732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae43fd98d2b1407bb68f444a936d65cd)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:35.221494 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6fd4a-b03b-44f1-b8a5-a495a8c62732 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:35.265151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:35.275720 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-18f6fd4a-b03b-44f1-b8a5-a495a8c62732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae43fd98d2b1407bb68f444a936d65cd', 'request_id': 'req-18f6fd4a-b03b-44f1-b8a5-a495a8c62732'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:35.282797 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-18f6fd4a-b03b-44f1-b8a5-a495a8c62732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae43fd98d2b1407bb68f444a936d65cd', 'request_id': 'req-18f6fd4a-b03b-44f1-b8a5-a495a8c62732'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:35.289080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-18f6fd4a-b03b-44f1-b8a5-a495a8c62732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae43fd98d2b1407bb68f444a936d65cd', 'request_id': 'req-18f6fd4a-b03b-44f1-b8a5-a495a8c62732'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:35.299309 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-18f6fd4a-b03b-44f1-b8a5-a495a8c62732 admin admin] The token cache is being invalidate because project ae43fd98d2b1407bb68f444a936d65cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:51:35.299590 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-18f6fd4a-b03b-44f1-b8a5-a495a8c62732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:35.300208 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-18f6fd4a-b03b-44f1-b8a5-a495a8c62732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:35.301785 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1246/2461] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:51:35 2022] DELETE /identity/v3/projects/ae43fd98d2b1407bb68f444a936d65cd => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:35.306692 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd751ed4-88a2-43d2-aeb8-5975ef89d1d1 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:35.306982 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd751ed4-88a2-43d2-aeb8-5975ef89d1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:35.307287 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd751ed4-88a2-43d2-aeb8-5975ef89d1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:35.325197 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-cd751ed4-88a2-43d2-aeb8-5975ef89d1d1 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:35.326914 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cd751ed4-88a2-43d2-aeb8-5975ef89d1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:35.385257 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1216/2462] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:35.394524 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400405e-7303-49ce-8654-12fc6ef40346 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:35.394835 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400405e-7303-49ce-8654-12fc6ef40346 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:35.395120 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400405e-7303-49ce-8654-12fc6ef40346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:35.413553 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-7400405e-7303-49ce-8654-12fc6ef40346 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:35.414746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7400405e-7303-49ce-8654-12fc6ef40346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:35.422783 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1247/2463] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:35.426843 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd751ed4-88a2-43d2-aeb8-5975ef89d1d1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:35.437145 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd751ed4-88a2-43d2-aeb8-5975ef89d1d1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:35.441665 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f2599-562c-4489-a8a2-a1b64f3b6007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:35.442333 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f2599-562c-4489-a8a2-a1b64f3b6007 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:35.442612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f2599-562c-4489-a8a2-a1b64f3b6007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:35.442911 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f2599-562c-4489-a8a2-a1b64f3b6007 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:35.443618 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f2599-562c-4489-a8a2-a1b64f3b6007 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:51:35.443923 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f2599-562c-4489-a8a2-a1b64f3b6007 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:35.445542 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f2599-562c-4489-a8a2-a1b64f3b6007 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:35.457549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1217/2464] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:51:35.461475 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400405e-7303-49ce-8654-12fc6ef40346 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:35.470481 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400405e-7303-49ce-8654-12fc6ef40346 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:35.475088 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c4e46-98bf-4d69-b528-8ac50a85f8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:35.475722 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c4e46-98bf-4d69-b528-8ac50a85f8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:35.476003 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c4e46-98bf-4d69-b528-8ac50a85f8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:35.476280 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c4e46-98bf-4d69-b528-8ac50a85f8a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:35.477004 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c4e46-98bf-4d69-b528-8ac50a85f8a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:35.478900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c4e46-98bf-4d69-b528-8ac50a85f8a9 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:35.503951 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1248/2465] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:35 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:35.507756 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f2599-562c-4489-a8a2-a1b64f3b6007 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:35.518145 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f2599-562c-4489-a8a2-a1b64f3b6007 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:35.525709 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:35.577964 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d994634-7859-4b3b-802a-46b40d4e01f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:35.578638 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d994634-7859-4b3b-802a-46b40d4e01f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:35.578926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d994634-7859-4b3b-802a-46b40d4e01f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:35.579208 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d994634-7859-4b3b-802a-46b40d4e01f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:35.579901 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d994634-7859-4b3b-802a-46b40d4e01f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:35.581879 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d994634-7859-4b3b-802a-46b40d4e01f8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:35.601044 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1218/2466] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:35 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:35.605221 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c4e46-98bf-4d69-b528-8ac50a85f8a9 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:35.615544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c4e46-98bf-4d69-b528-8ac50a85f8a9 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:35.620121 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4386d5a-f3e2-4fee-8f6f-6bd43d3fddb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:35.620805 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4386d5a-f3e2-4fee-8f6f-6bd43d3fddb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:35.621087 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4386d5a-f3e2-4fee-8f6f-6bd43d3fddb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:35.621364 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4386d5a-f3e2-4fee-8f6f-6bd43d3fddb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:35.622085 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4386d5a-f3e2-4fee-8f6f-6bd43d3fddb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:35.624207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4386d5a-f3e2-4fee-8f6f-6bd43d3fddb0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:35.634386 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1249/2467] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:35.638220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d994634-7859-4b3b-802a-46b40d4e01f8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:35.648741 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d994634-7859-4b3b-802a-46b40d4e01f8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:35.653251 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc07b8-387c-4540-aa9c-7b81c6f85f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:35.653889 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc07b8-387c-4540-aa9c-7b81c6f85f74 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:35.654173 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc07b8-387c-4540-aa9c-7b81c6f85f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:35.654455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc07b8-387c-4540-aa9c-7b81c6f85f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:35.655307 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc07b8-387c-4540-aa9c-7b81c6f85f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:35.657056 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc07b8-387c-4540-aa9c-7b81c6f85f74 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:35.666779 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1219/2468] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:35.670684 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4386d5a-f3e2-4fee-8f6f-6bd43d3fddb0 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:35.680564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4386d5a-f3e2-4fee-8f6f-6bd43d3fddb0 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:35.685157 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89b50e-5c3a-48a6-beb4-75bf8c55df62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:35.686542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89b50e-5c3a-48a6-beb4-75bf8c55df62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:35.686821 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89b50e-5c3a-48a6-beb4-75bf8c55df62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:35.687098 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89b50e-5c3a-48a6-beb4-75bf8c55df62 admin admin] PATH_INFO: `/v3/projects/6ec654bdc0c24ff9a9bad630b33757c2/users/a3321fd3a71749bba3b01ba6b3a2d1a5/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:35.701206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f89b50e-5c3a-48a6-beb4-75bf8c55df62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ec654bdc0c24ff9a9bad630b33757c2, user_id=a3321fd3a71749bba3b01ba6b3a2d1a5, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:35.704558 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f89b50e-5c3a-48a6-beb4-75bf8c55df62 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:35.716944 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1250/2469] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:35 2022] PUT /identity/v3/projects/6ec654bdc0c24ff9a9bad630b33757c2/users/a3321fd3a71749bba3b01ba6b3a2d1a5/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:35.726944 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ae6d0-07b8-4657-90c5-68338553a0d7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:35.727264 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ae6d0-07b8-4657-90c5-68338553a0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:35.727540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ae6d0-07b8-4657-90c5-68338553a0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:35.753991 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-649ae6d0-07b8-4657-90c5-68338553a0d7 None None] MFA Rules not processed for user `a3321fd3a71749bba3b01ba6b3a2d1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:35.755176 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-649ae6d0-07b8-4657-90c5-68338553a0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:35.817216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1220/2470] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:51:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:35.821637 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89b50e-5c3a-48a6-beb4-75bf8c55df62 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:35.882641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89b50e-5c3a-48a6-beb4-75bf8c55df62 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:35.887214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a1771-e543-48d7-bfe0-30606256eab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:35.887858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a1771-e543-48d7-bfe0-30606256eab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:35.888141 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a1771-e543-48d7-bfe0-30606256eab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:35.888419 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a1771-e543-48d7-bfe0-30606256eab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:35.889784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a1771-e543-48d7-bfe0-30606256eab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:35.891699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a1771-e543-48d7-bfe0-30606256eab4 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:35.916817 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1251/2471] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:35 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:35.920861 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ae6d0-07b8-4657-90c5-68338553a0d7 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:35.931381 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ae6d0-07b8-4657-90c5-68338553a0d7 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:35.985745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e0433-ed37-41a5-be29-22a576b2d3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:35.986394 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e0433-ed37-41a5-be29-22a576b2d3b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:35.986676 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e0433-ed37-41a5-be29-22a576b2d3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:35.986952 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e0433-ed37-41a5-be29-22a576b2d3b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:35.987630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e0433-ed37-41a5-be29-22a576b2d3b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:35.989588 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e0433-ed37-41a5-be29-22a576b2d3b4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:36.007508 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1221/2472] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:35 2022] POST /identity/v3/users => generated 297 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:36.011531 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a1771-e543-48d7-bfe0-30606256eab4 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:36.022237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a1771-e543-48d7-bfe0-30606256eab4 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:36.026820 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288872a0-4870-47f8-af7a-e33d143b94a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:36.027464 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288872a0-4870-47f8-af7a-e33d143b94a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:36.027746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288872a0-4870-47f8-af7a-e33d143b94a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:36.028022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288872a0-4870-47f8-af7a-e33d143b94a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:36.028768 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288872a0-4870-47f8-af7a-e33d143b94a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:36.030953 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288872a0-4870-47f8-af7a-e33d143b94a0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:36.041347 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1252/2473] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:36.045200 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e0433-ed37-41a5-be29-22a576b2d3b4 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:36.054846 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e0433-ed37-41a5-be29-22a576b2d3b4 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:36.059342 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe9c20-e846-4879-bd7e-b4b9b8af2bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:36.060203 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe9c20-e846-4879-bd7e-b4b9b8af2bc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:36.060519 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe9c20-e846-4879-bd7e-b4b9b8af2bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:36.061169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe9c20-e846-4879-bd7e-b4b9b8af2bc6 admin admin] PATH_INFO: `/v3/projects/77c0e7a544bb48e6a4ffd759057c99ae/users/2b6721e90afa4bf1a61f5e86976a58c9/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:36.064246 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:36.077563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe9c20-e846-4879-bd7e-b4b9b8af2bc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77c0e7a544bb48e6a4ffd759057c99ae, user_id=2b6721e90afa4bf1a61f5e86976a58c9, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:36.080148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe9c20-e846-4879-bd7e-b4b9b8af2bc6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:36.093984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1222/2474] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:36 2022] PUT /identity/v3/projects/77c0e7a544bb48e6a4ffd759057c99ae/users/2b6721e90afa4bf1a61f5e86976a58c9/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:36.097875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288872a0-4870-47f8-af7a-e33d143b94a0 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:36.107805 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288872a0-4870-47f8-af7a-e33d143b94a0 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:36.141173 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:36.166963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c135d-3e4b-44c5-8b6a-7f6647354247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:36.167627 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c135d-3e4b-44c5-8b6a-7f6647354247 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:36.167914 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c135d-3e4b-44c5-8b6a-7f6647354247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:36.168194 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c135d-3e4b-44c5-8b6a-7f6647354247 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:36.168946 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c135d-3e4b-44c5-8b6a-7f6647354247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:36.170543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c135d-3e4b-44c5-8b6a-7f6647354247 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:36.180042 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1253/2475] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:36.184185 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe9c20-e846-4879-bd7e-b4b9b8af2bc6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:36.195229 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe9c20-e846-4879-bd7e-b4b9b8af2bc6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:36.200020 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad11f15-aea1-49cf-8c53-55da8991a8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:36.200930 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad11f15-aea1-49cf-8c53-55da8991a8c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:36.201213 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad11f15-aea1-49cf-8c53-55da8991a8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:36.202121 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad11f15-aea1-49cf-8c53-55da8991a8c2 admin admin] PATH_INFO: `/v3/projects/77c0e7a544bb48e6a4ffd759057c99ae/users/2b6721e90afa4bf1a61f5e86976a58c9/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:36.204077 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad11f15-aea1-49cf-8c53-55da8991a8c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77c0e7a544bb48e6a4ffd759057c99ae, user_id=2b6721e90afa4bf1a61f5e86976a58c9, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:36.206779 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad11f15-aea1-49cf-8c53-55da8991a8c2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:36.217567 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1223/2476] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:36 2022] PUT /identity/v3/projects/77c0e7a544bb48e6a4ffd759057c99ae/users/2b6721e90afa4bf1a61f5e86976a58c9/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:51:36.227696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb44949-9ea8-469c-96bc-2e1cb13f9c29 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:36.227990 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb44949-9ea8-469c-96bc-2e1cb13f9c29 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:36.228274 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb44949-9ea8-469c-96bc-2e1cb13f9c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:36.255054 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-3fb44949-9ea8-469c-96bc-2e1cb13f9c29 None None] MFA Rules not processed for user `2b6721e90afa4bf1a61f5e86976a58c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:36.256283 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3fb44949-9ea8-469c-96bc-2e1cb13f9c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:36.324452 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1254/2477] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:51:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:36.335609 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad11f15-aea1-49cf-8c53-55da8991a8c2 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:36.337330 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6ad11f15-aea1-49cf-8c53-55da8991a8c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:36.393650 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad11f15-aea1-49cf-8c53-55da8991a8c2 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:36.397299 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeea8c1-2043-4841-b73e-41c027a446b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:36.397929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeea8c1-2043-4841-b73e-41c027a446b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:36.398216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeea8c1-2043-4841-b73e-41c027a446b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:36.398495 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeea8c1-2043-4841-b73e-41c027a446b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:36.408195 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeea8c1-2043-4841-b73e-41c027a446b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:36.409706 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeea8c1-2043-4841-b73e-41c027a446b1 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:36.419162 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1224/2478] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:36.488214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb44949-9ea8-469c-96bc-2e1cb13f9c29 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:36.497618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb44949-9ea8-469c-96bc-2e1cb13f9c29 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:36.501681 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f412da3-5f54-47df-9fa0-fd62e467ccfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:36.502312 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f412da3-5f54-47df-9fa0-fd62e467ccfe service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:36.502594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f412da3-5f54-47df-9fa0-fd62e467ccfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:36.502872 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f412da3-5f54-47df-9fa0-fd62e467ccfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:36.556994 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f412da3-5f54-47df-9fa0-fd62e467ccfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:36.558408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f412da3-5f54-47df-9fa0-fd62e467ccfe service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:36.567780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1255/2479] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:46.415033 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=37,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:46.563813 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=75 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:47.360744 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeea8c1-2043-4841-b73e-41c027a446b1 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:47.421223 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeea8c1-2043-4841-b73e-41c027a446b1 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:47.425641 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca0f85-e76e-43c3-86cd-bd3eae0c50d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:47.426486 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca0f85-e76e-43c3-86cd-bd3eae0c50d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:47.426768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca0f85-e76e-43c3-86cd-bd3eae0c50d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:47.427044 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca0f85-e76e-43c3-86cd-bd3eae0c50d1 admin admin] PATH_INFO: `/v3/users/a3321fd3a71749bba3b01ba6b3a2d1a5` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:47.428228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca0f85-e76e-43c3-86cd-bd3eae0c50d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3321fd3a71749bba3b01ba6b3a2d1a5)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:47.430185 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca0f85-e76e-43c3-86cd-bd3eae0c50d1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:47.476431 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-32ca0f85-e76e-43c3-86cd-bd3eae0c50d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3321fd3a71749bba3b01ba6b3a2d1a5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:47.477062 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-32ca0f85-e76e-43c3-86cd-bd3eae0c50d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3321fd3a71749bba3b01ba6b3a2d1a5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:47.484354 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-32ca0f85-e76e-43c3-86cd-bd3eae0c50d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3321fd3a71749bba3b01ba6b3a2d1a5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:47.485024 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-32ca0f85-e76e-43c3-86cd-bd3eae0c50d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3321fd3a71749bba3b01ba6b3a2d1a5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:47.492075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-32ca0f85-e76e-43c3-86cd-bd3eae0c50d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3321fd3a71749bba3b01ba6b3a2d1a5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:47.509776 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1225/2480] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:51:47 2022] DELETE /identity/v3/users/a3321fd3a71749bba3b01ba6b3a2d1a5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:47.514830 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b366e6-bae4-47de-a9a6-02aa708b6549 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:47.515120 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b366e6-bae4-47de-a9a6-02aa708b6549 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:47.515403 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b366e6-bae4-47de-a9a6-02aa708b6549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:47.531930 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-59b366e6-bae4-47de-a9a6-02aa708b6549 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:47.533143 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-59b366e6-bae4-47de-a9a6-02aa708b6549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:47.591823 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1256/2481] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:47.601520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca0f85-e76e-43c3-86cd-bd3eae0c50d1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:47.603431 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-32ca0f85-e76e-43c3-86cd-bd3eae0c50d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:47.663778 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca0f85-e76e-43c3-86cd-bd3eae0c50d1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:47.667497 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbca14-fe81-497c-8116-9a82146a0e7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:47.668146 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbca14-fe81-497c-8116-9a82146a0e7d service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:47.668407 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbca14-fe81-497c-8116-9a82146a0e7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:47.668714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbca14-fe81-497c-8116-9a82146a0e7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:47.677701 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbca14-fe81-497c-8116-9a82146a0e7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:47.679126 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbca14-fe81-497c-8116-9a82146a0e7d service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:47.689018 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1226/2482] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:47.953465 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b366e6-bae4-47de-a9a6-02aa708b6549 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:47.955115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-59b366e6-bae4-47de-a9a6-02aa708b6549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:47.973296 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b366e6-bae4-47de-a9a6-02aa708b6549 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:47.977787 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11878d71-63e5-499c-8089-5cc6813fd737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:47.978673 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11878d71-63e5-499c-8089-5cc6813fd737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:47.978957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11878d71-63e5-499c-8089-5cc6813fd737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:47.979258 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11878d71-63e5-499c-8089-5cc6813fd737 admin admin] PATH_INFO: `/v3/projects/6ec654bdc0c24ff9a9bad630b33757c2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:47.980391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11878d71-63e5-499c-8089-5cc6813fd737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ec654bdc0c24ff9a9bad630b33757c2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:47.982361 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11878d71-63e5-499c-8089-5cc6813fd737 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:48.029241 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-11878d71-63e5-499c-8089-5cc6813fd737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ec654bdc0c24ff9a9bad630b33757c2', 'request_id': 'req-11878d71-63e5-499c-8089-5cc6813fd737'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:48.037372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-11878d71-63e5-499c-8089-5cc6813fd737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ec654bdc0c24ff9a9bad630b33757c2', 'request_id': 'req-11878d71-63e5-499c-8089-5cc6813fd737'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:48.043537 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-11878d71-63e5-499c-8089-5cc6813fd737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ec654bdc0c24ff9a9bad630b33757c2', 'request_id': 'req-11878d71-63e5-499c-8089-5cc6813fd737'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:48.054450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-11878d71-63e5-499c-8089-5cc6813fd737 admin admin] The token cache is being invalidate because project 6ec654bdc0c24ff9a9bad630b33757c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:51:48.054759 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-11878d71-63e5-499c-8089-5cc6813fd737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:48.055407 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-11878d71-63e5-499c-8089-5cc6813fd737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:48.056973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1257/2483] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:51:47 2022] DELETE /identity/v3/projects/6ec654bdc0c24ff9a9bad630b33757c2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:48.061761 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbca14-fe81-497c-8116-9a82146a0e7d service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:48.071314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbca14-fe81-497c-8116-9a82146a0e7d service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:48.088762 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:48.128476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8480888-5d6b-415e-ae48-21b722431ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:48.129350 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8480888-5d6b-415e-ae48-21b722431ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:48.129628 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8480888-5d6b-415e-ae48-21b722431ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:48.129899 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8480888-5d6b-415e-ae48-21b722431ff9 admin admin] PATH_INFO: `/v3/users/2b6721e90afa4bf1a61f5e86976a58c9` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:48.131044 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8480888-5d6b-415e-ae48-21b722431ff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b6721e90afa4bf1a61f5e86976a58c9)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:48.132994 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8480888-5d6b-415e-ae48-21b722431ff9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:48.177892 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a8480888-5d6b-415e-ae48-21b722431ff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b6721e90afa4bf1a61f5e86976a58c9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:48.178572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a8480888-5d6b-415e-ae48-21b722431ff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b6721e90afa4bf1a61f5e86976a58c9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:48.185455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a8480888-5d6b-415e-ae48-21b722431ff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b6721e90afa4bf1a61f5e86976a58c9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:48.186723 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a8480888-5d6b-415e-ae48-21b722431ff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b6721e90afa4bf1a61f5e86976a58c9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:48.193767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a8480888-5d6b-415e-ae48-21b722431ff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b6721e90afa4bf1a61f5e86976a58c9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:48.210562 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1227/2484] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:51:48 2022] DELETE /identity/v3/users/2b6721e90afa4bf1a61f5e86976a58c9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:51:48.473625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11878d71-63e5-499c-8089-5cc6813fd737 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:48.475064 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-11878d71-63e5-499c-8089-5cc6813fd737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:48.490119 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11878d71-63e5-499c-8089-5cc6813fd737 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:48.548192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3a2e6-6770-4403-8d2c-880d54393883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:48.549088 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3a2e6-6770-4403-8d2c-880d54393883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:48.549372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3a2e6-6770-4403-8d2c-880d54393883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:48.549645 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3a2e6-6770-4403-8d2c-880d54393883 admin admin] PATH_INFO: `/v3/projects/77c0e7a544bb48e6a4ffd759057c99ae` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:48.550832 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3a2e6-6770-4403-8d2c-880d54393883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77c0e7a544bb48e6a4ffd759057c99ae)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:48.552771 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3a2e6-6770-4403-8d2c-880d54393883 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:48.581912 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:48.599981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-06a3a2e6-6770-4403-8d2c-880d54393883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77c0e7a544bb48e6a4ffd759057c99ae', 'request_id': 'req-06a3a2e6-6770-4403-8d2c-880d54393883'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:48.607231 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-06a3a2e6-6770-4403-8d2c-880d54393883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77c0e7a544bb48e6a4ffd759057c99ae', 'request_id': 'req-06a3a2e6-6770-4403-8d2c-880d54393883'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:48.613627 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-06a3a2e6-6770-4403-8d2c-880d54393883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77c0e7a544bb48e6a4ffd759057c99ae', 'request_id': 'req-06a3a2e6-6770-4403-8d2c-880d54393883'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:48.623744 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-06a3a2e6-6770-4403-8d2c-880d54393883 admin admin] The token cache is being invalidate because project 77c0e7a544bb48e6a4ffd759057c99ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:51:48.624025 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-06a3a2e6-6770-4403-8d2c-880d54393883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:48.624687 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-06a3a2e6-6770-4403-8d2c-880d54393883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:48.626214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1258/2485] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:51:48 2022] DELETE /identity/v3/projects/77c0e7a544bb48e6a4ffd759057c99ae => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:48.631070 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740052a-d053-409e-823a-9fef395a9050 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:48.631514 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740052a-d053-409e-823a-9fef395a9050 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:48.631629 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740052a-d053-409e-823a-9fef395a9050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:48.649994 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4740052a-d053-409e-823a-9fef395a9050 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:48.651182 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4740052a-d053-409e-823a-9fef395a9050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:48.709263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1228/2486] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:48.717035 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c66162-41c6-4094-a7e0-4236fa5d4031 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:48.718157 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c66162-41c6-4094-a7e0-4236fa5d4031 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:48.718440 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c66162-41c6-4094-a7e0-4236fa5d4031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:48.736496 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-03c66162-41c6-4094-a7e0-4236fa5d4031 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:48.737715 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-03c66162-41c6-4094-a7e0-4236fa5d4031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:48.745519 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1259/2487] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:48.749740 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740052a-d053-409e-823a-9fef395a9050 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:48.762040 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740052a-d053-409e-823a-9fef395a9050 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:48.767931 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af45af-aee6-4c75-a8e9-3abb502c6d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:48.768665 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af45af-aee6-4c75-a8e9-3abb502c6d1e admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:48.768954 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af45af-aee6-4c75-a8e9-3abb502c6d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:48.769237 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af45af-aee6-4c75-a8e9-3abb502c6d1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:48.769956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af45af-aee6-4c75-a8e9-3abb502c6d1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:51:48.770270 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af45af-aee6-4c75-a8e9-3abb502c6d1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:48.771887 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af45af-aee6-4c75-a8e9-3abb502c6d1e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:48.784052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1229/2488] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:51:48.788285 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c66162-41c6-4094-a7e0-4236fa5d4031 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:48.797492 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c66162-41c6-4094-a7e0-4236fa5d4031 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:48.802121 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cd061-3733-48a3-9673-7f733d1fd516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:48.802797 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cd061-3733-48a3-9673-7f733d1fd516 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:48.803087 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cd061-3733-48a3-9673-7f733d1fd516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:48.803365 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cd061-3733-48a3-9673-7f733d1fd516 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:48.804056 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cd061-3733-48a3-9673-7f733d1fd516 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:48.805989 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cd061-3733-48a3-9673-7f733d1fd516 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:48.831144 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1260/2489] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:48 2022] POST /identity/v3/projects => generated 363 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:51:48.834955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af45af-aee6-4c75-a8e9-3abb502c6d1e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:48.845570 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af45af-aee6-4c75-a8e9-3abb502c6d1e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:48.871688 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:48.904402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c70d5b-eeab-466f-8e92-d25c258ca15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:48.905639 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c70d5b-eeab-466f-8e92-d25c258ca15c admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:48.905924 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c70d5b-eeab-466f-8e92-d25c258ca15c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:48.906207 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c70d5b-eeab-466f-8e92-d25c258ca15c admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:48.906880 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c70d5b-eeab-466f-8e92-d25c258ca15c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:48.908862 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c70d5b-eeab-466f-8e92-d25c258ca15c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:48.931544 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1230/2490] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:48 2022] POST /identity/v3/users => generated 282 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:48.935405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cd061-3733-48a3-9673-7f733d1fd516 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:48.946070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cd061-3733-48a3-9673-7f733d1fd516 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:48.950676 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01b399-14d6-4395-9e86-1fade9d5d716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:48.951322 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01b399-14d6-4395-9e86-1fade9d5d716 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:48.952197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01b399-14d6-4395-9e86-1fade9d5d716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:48.952476 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01b399-14d6-4395-9e86-1fade9d5d716 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:48.953229 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01b399-14d6-4395-9e86-1fade9d5d716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:48.954822 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01b399-14d6-4395-9e86-1fade9d5d716 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:48.965540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1261/2491] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:48.969131 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c70d5b-eeab-466f-8e92-d25c258ca15c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:48.978814 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c70d5b-eeab-466f-8e92-d25c258ca15c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:48.983287 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdea92-4d51-4035-8a7d-3d01df5fb38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:48.984183 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdea92-4d51-4035-8a7d-3d01df5fb38c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:48.984461 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdea92-4d51-4035-8a7d-3d01df5fb38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:48.984829 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdea92-4d51-4035-8a7d-3d01df5fb38c admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:48.985540 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdea92-4d51-4035-8a7d-3d01df5fb38c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:48.987123 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdea92-4d51-4035-8a7d-3d01df5fb38c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:48.996877 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1231/2492] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:49.001209 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01b399-14d6-4395-9e86-1fade9d5d716 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:49.019325 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01b399-14d6-4395-9e86-1fade9d5d716 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:49.023937 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195562ca-3b94-47d6-aab4-d56e4de317fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:49.024845 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195562ca-3b94-47d6-aab4-d56e4de317fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:49.025129 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195562ca-3b94-47d6-aab4-d56e4de317fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:49.025412 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195562ca-3b94-47d6-aab4-d56e4de317fe admin admin] PATH_INFO: `/v3/projects/8632d01816794605a88c7a4cec400571/users/117538848a824a01a8fbe40a8419adcf/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:49.040014 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195562ca-3b94-47d6-aab4-d56e4de317fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8632d01816794605a88c7a4cec400571, user_id=117538848a824a01a8fbe40a8419adcf, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:49.042688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195562ca-3b94-47d6-aab4-d56e4de317fe admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:49.055125 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1262/2493] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:49 2022] PUT /identity/v3/projects/8632d01816794605a88c7a4cec400571/users/117538848a824a01a8fbe40a8419adcf/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:49.065743 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bab9f6-4bbe-4392-9225-0328f10928c4 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:49.066034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bab9f6-4bbe-4392-9225-0328f10928c4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:49.066315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bab9f6-4bbe-4392-9225-0328f10928c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:49.092398 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e5bab9f6-4bbe-4392-9225-0328f10928c4 None None] MFA Rules not processed for user `117538848a824a01a8fbe40a8419adcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:49.093580 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e5bab9f6-4bbe-4392-9225-0328f10928c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:49.157610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1232/2494] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:51:49 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:49.162214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195562ca-3b94-47d6-aab4-d56e4de317fe admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:49.224557 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195562ca-3b94-47d6-aab4-d56e4de317fe admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:49.229163 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c3a0c-aabb-4af9-bec4-dfd8898c9464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:49.229814 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c3a0c-aabb-4af9-bec4-dfd8898c9464 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:49.230095 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c3a0c-aabb-4af9-bec4-dfd8898c9464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:49.230369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c3a0c-aabb-4af9-bec4-dfd8898c9464 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:49.231114 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c3a0c-aabb-4af9-bec4-dfd8898c9464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:49.233123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c3a0c-aabb-4af9-bec4-dfd8898c9464 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:49.262529 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1263/2495] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:49 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:49.268333 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bab9f6-4bbe-4392-9225-0328f10928c4 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:49.279244 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bab9f6-4bbe-4392-9225-0328f10928c4 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:49.334384 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d57f2-bb12-4dc7-a63d-ddc5d1aa6bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:49.335047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d57f2-bb12-4dc7-a63d-ddc5d1aa6bf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:49.335332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d57f2-bb12-4dc7-a63d-ddc5d1aa6bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:49.335607 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d57f2-bb12-4dc7-a63d-ddc5d1aa6bf2 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:49.336291 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d57f2-bb12-4dc7-a63d-ddc5d1aa6bf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:49.338261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d57f2-bb12-4dc7-a63d-ddc5d1aa6bf2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:49.358264 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1233/2496] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:49 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:51:49.362826 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c3a0c-aabb-4af9-bec4-dfd8898c9464 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:49.373011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c3a0c-aabb-4af9-bec4-dfd8898c9464 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:49.378166 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5e161-4fb3-4d68-aa91-f97a63ee88e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:49.378815 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5e161-4fb3-4d68-aa91-f97a63ee88e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:49.379098 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5e161-4fb3-4d68-aa91-f97a63ee88e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:49.379378 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5e161-4fb3-4d68-aa91-f97a63ee88e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:49.380091 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5e161-4fb3-4d68-aa91-f97a63ee88e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:49.381715 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5e161-4fb3-4d68-aa91-f97a63ee88e5 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:49.392269 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1264/2497] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:49.396186 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d57f2-bb12-4dc7-a63d-ddc5d1aa6bf2 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:49.406103 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d57f2-bb12-4dc7-a63d-ddc5d1aa6bf2 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:49.410710 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c6ff6-4a09-4881-8ccd-c87d10e72f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:49.411567 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c6ff6-4a09-4881-8ccd-c87d10e72f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:49.411851 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c6ff6-4a09-4881-8ccd-c87d10e72f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:49.412157 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c6ff6-4a09-4881-8ccd-c87d10e72f62 admin admin] PATH_INFO: `/v3/projects/60064daeabb14f7dac070c1247409fba/users/5320f1d7002f4fec8cfbd193d8d0856b/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:49.427118 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c6ff6-4a09-4881-8ccd-c87d10e72f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60064daeabb14f7dac070c1247409fba, user_id=5320f1d7002f4fec8cfbd193d8d0856b, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:49.429899 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c6ff6-4a09-4881-8ccd-c87d10e72f62 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:49.443941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1234/2498] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:49 2022] PUT /identity/v3/projects/60064daeabb14f7dac070c1247409fba/users/5320f1d7002f4fec8cfbd193d8d0856b/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:49.447802 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5e161-4fb3-4d68-aa91-f97a63ee88e5 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:49.457676 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5e161-4fb3-4d68-aa91-f97a63ee88e5 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:49.477132 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:49.514730 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d618b-6a24-445d-a952-a9464312b2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:49.515381 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d618b-6a24-445d-a952-a9464312b2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:49.515664 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d618b-6a24-445d-a952-a9464312b2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:49.515941 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d618b-6a24-445d-a952-a9464312b2a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:49.516675 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d618b-6a24-445d-a952-a9464312b2a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:49.518272 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d618b-6a24-445d-a952-a9464312b2a7 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:49.527685 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1265/2499] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:49.531764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c6ff6-4a09-4881-8ccd-c87d10e72f62 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:49.537274 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:49.544548 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c6ff6-4a09-4881-8ccd-c87d10e72f62 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:49.549767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d287c-62e3-4e40-90be-2438db7be61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:49.550649 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d287c-62e3-4e40-90be-2438db7be61e admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:49.550935 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d287c-62e3-4e40-90be-2438db7be61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:49.551217 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d287c-62e3-4e40-90be-2438db7be61e admin admin] PATH_INFO: `/v3/projects/60064daeabb14f7dac070c1247409fba/users/5320f1d7002f4fec8cfbd193d8d0856b/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:49.553244 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d287c-62e3-4e40-90be-2438db7be61e admin admin] RBAC: Authorizing `identity:create_grant(project_id=60064daeabb14f7dac070c1247409fba, user_id=5320f1d7002f4fec8cfbd193d8d0856b, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:49.556014 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d287c-62e3-4e40-90be-2438db7be61e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:49.568633 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1235/2500] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:49 2022] PUT /identity/v3/projects/60064daeabb14f7dac070c1247409fba/users/5320f1d7002f4fec8cfbd193d8d0856b/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:49.581700 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff3f50-f6a5-42ee-9d7e-a4d832d01f11 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:49.581997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff3f50-f6a5-42ee-9d7e-a4d832d01f11 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:49.582283 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff3f50-f6a5-42ee-9d7e-a4d832d01f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:49.613151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-7aff3f50-f6a5-42ee-9d7e-a4d832d01f11 None None] MFA Rules not processed for user `5320f1d7002f4fec8cfbd193d8d0856b`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:49.614338 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7aff3f50-f6a5-42ee-9d7e-a4d832d01f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:49.683396 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1266/2501] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:51:49 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:49.695433 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d287c-62e3-4e40-90be-2438db7be61e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:49.697239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-130d287c-62e3-4e40-90be-2438db7be61e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:49.756085 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d287c-62e3-4e40-90be-2438db7be61e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:49.759709 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcbe96-ef83-43d8-8faa-402134348ab1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:49.760331 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcbe96-ef83-43d8-8faa-402134348ab1 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:49.760642 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcbe96-ef83-43d8-8faa-402134348ab1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:49.760973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcbe96-ef83-43d8-8faa-402134348ab1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:49.769903 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafcbe96-ef83-43d8-8faa-402134348ab1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:49.771403 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafcbe96-ef83-43d8-8faa-402134348ab1 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:49.781112 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1236/2502] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:49 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:49.851522 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff3f50-f6a5-42ee-9d7e-a4d832d01f11 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:49.862181 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff3f50-f6a5-42ee-9d7e-a4d832d01f11 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:49.866464 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949caa7-de87-41ee-a87c-a6e5da5972dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:49.867105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949caa7-de87-41ee-a87c-a6e5da5972dc service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:49.867374 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949caa7-de87-41ee-a87c-a6e5da5972dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:49.867671 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949caa7-de87-41ee-a87c-a6e5da5972dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:49.924727 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949caa7-de87-41ee-a87c-a6e5da5972dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:49.926182 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949caa7-de87-41ee-a87c-a6e5da5972dc service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:49.935356 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1267/2503] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:49 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:52.618046 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcbe96-ef83-43d8-8faa-402134348ab1 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:52.680809 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcbe96-ef83-43d8-8faa-402134348ab1 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:52.685324 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc71e6-c4ed-4df0-a186-52ec3f0fcc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:52.686678 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc71e6-c4ed-4df0-a186-52ec3f0fcc83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:52.686957 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc71e6-c4ed-4df0-a186-52ec3f0fcc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:52.687227 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc71e6-c4ed-4df0-a186-52ec3f0fcc83 admin admin] PATH_INFO: `/v3/users/117538848a824a01a8fbe40a8419adcf` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:52.688419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc71e6-c4ed-4df0-a186-52ec3f0fcc83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=117538848a824a01a8fbe40a8419adcf)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:52.690370 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc71e6-c4ed-4df0-a186-52ec3f0fcc83 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:52.735185 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9fdc71e6-c4ed-4df0-a186-52ec3f0fcc83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '117538848a824a01a8fbe40a8419adcf'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:52.735864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9fdc71e6-c4ed-4df0-a186-52ec3f0fcc83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '117538848a824a01a8fbe40a8419adcf'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:52.743245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9fdc71e6-c4ed-4df0-a186-52ec3f0fcc83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '117538848a824a01a8fbe40a8419adcf'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:52.743953 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9fdc71e6-c4ed-4df0-a186-52ec3f0fcc83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '117538848a824a01a8fbe40a8419adcf'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:52.751770 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9fdc71e6-c4ed-4df0-a186-52ec3f0fcc83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '117538848a824a01a8fbe40a8419adcf'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:52.770258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1237/2504] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:51:52 2022] DELETE /identity/v3/users/117538848a824a01a8fbe40a8419adcf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:52.774731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f49894-49cc-495a-b6cc-bc070bebedfa None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:52.775207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f49894-49cc-495a-b6cc-bc070bebedfa None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:52.775331 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f49894-49cc-495a-b6cc-bc070bebedfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:52.791814 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-95f49894-49cc-495a-b6cc-bc070bebedfa None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:52.793058 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-95f49894-49cc-495a-b6cc-bc070bebedfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:52.834804 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:52.853624 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1268/2505] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:52.863584 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc71e6-c4ed-4df0-a186-52ec3f0fcc83 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:52.865040 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9fdc71e6-c4ed-4df0-a186-52ec3f0fcc83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:52.879132 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:52.925608 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc71e6-c4ed-4df0-a186-52ec3f0fcc83 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:52.929237 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f0bb7-e363-4edc-a4ec-0856406ffbd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:52.929873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f0bb7-e363-4edc-a4ec-0856406ffbd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:52.930157 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f0bb7-e363-4edc-a4ec-0856406ffbd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:52.930433 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f0bb7-e363-4edc-a4ec-0856406ffbd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:52.939745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f0bb7-e363-4edc-a4ec-0856406ffbd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:52.941211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f0bb7-e363-4edc-a4ec-0856406ffbd8 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:52.950484 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1238/2506] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:53.213217 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f49894-49cc-495a-b6cc-bc070bebedfa None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:53.214643 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-95f49894-49cc-495a-b6cc-bc070bebedfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:53.228380 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f49894-49cc-495a-b6cc-bc070bebedfa None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:53.233379 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70184298-41e2-4668-b1b0-4935e9115112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:53.234487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70184298-41e2-4668-b1b0-4935e9115112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:53.234764 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70184298-41e2-4668-b1b0-4935e9115112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:53.235032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70184298-41e2-4668-b1b0-4935e9115112 admin admin] PATH_INFO: `/v3/projects/8632d01816794605a88c7a4cec400571` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:53.236200 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70184298-41e2-4668-b1b0-4935e9115112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8632d01816794605a88c7a4cec400571)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:53.238141 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70184298-41e2-4668-b1b0-4935e9115112 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:53.287371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-70184298-41e2-4668-b1b0-4935e9115112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8632d01816794605a88c7a4cec400571', 'request_id': 'req-70184298-41e2-4668-b1b0-4935e9115112'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:53.294717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-70184298-41e2-4668-b1b0-4935e9115112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8632d01816794605a88c7a4cec400571', 'request_id': 'req-70184298-41e2-4668-b1b0-4935e9115112'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:53.301467 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-70184298-41e2-4668-b1b0-4935e9115112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8632d01816794605a88c7a4cec400571', 'request_id': 'req-70184298-41e2-4668-b1b0-4935e9115112'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:53.312160 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-70184298-41e2-4668-b1b0-4935e9115112 admin admin] The token cache is being invalidate because project 8632d01816794605a88c7a4cec400571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:51:53.312439 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-70184298-41e2-4668-b1b0-4935e9115112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:53.313092 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-70184298-41e2-4668-b1b0-4935e9115112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:53.314632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1269/2507] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:51:53 2022] DELETE /identity/v3/projects/8632d01816794605a88c7a4cec400571 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:53.318564 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f0bb7-e363-4edc-a4ec-0856406ffbd8 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:53.327987 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f0bb7-e363-4edc-a4ec-0856406ffbd8 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:53.382714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c6e9e-aa4e-4ade-b1f9-b76c2ee53a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:53.383561 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c6e9e-aa4e-4ade-b1f9-b76c2ee53a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:53.383845 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c6e9e-aa4e-4ade-b1f9-b76c2ee53a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:53.384120 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c6e9e-aa4e-4ade-b1f9-b76c2ee53a49 admin admin] PATH_INFO: `/v3/users/5320f1d7002f4fec8cfbd193d8d0856b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:53.385321 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c6e9e-aa4e-4ade-b1f9-b76c2ee53a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5320f1d7002f4fec8cfbd193d8d0856b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:53.387253 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c6e9e-aa4e-4ade-b1f9-b76c2ee53a49 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:53.431848 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-605c6e9e-aa4e-4ade-b1f9-b76c2ee53a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5320f1d7002f4fec8cfbd193d8d0856b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:53.432529 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-605c6e9e-aa4e-4ade-b1f9-b76c2ee53a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5320f1d7002f4fec8cfbd193d8d0856b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:53.440038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-605c6e9e-aa4e-4ade-b1f9-b76c2ee53a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5320f1d7002f4fec8cfbd193d8d0856b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:53.440703 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-605c6e9e-aa4e-4ade-b1f9-b76c2ee53a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5320f1d7002f4fec8cfbd193d8d0856b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:53.448076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-605c6e9e-aa4e-4ade-b1f9-b76c2ee53a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5320f1d7002f4fec8cfbd193d8d0856b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:53.466126 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1239/2508] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:51:53 2022] DELETE /identity/v3/users/5320f1d7002f4fec8cfbd193d8d0856b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:53.737667 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70184298-41e2-4668-b1b0-4935e9115112 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:53.739115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-70184298-41e2-4668-b1b0-4935e9115112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:53.752374 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70184298-41e2-4668-b1b0-4935e9115112 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:53.810398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042bc76-48d5-4c7a-9cb2-b523c48ad949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:53.811809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042bc76-48d5-4c7a-9cb2-b523c48ad949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:53.812094 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042bc76-48d5-4c7a-9cb2-b523c48ad949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:53.812365 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042bc76-48d5-4c7a-9cb2-b523c48ad949 admin admin] PATH_INFO: `/v3/projects/60064daeabb14f7dac070c1247409fba` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:53.813545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042bc76-48d5-4c7a-9cb2-b523c48ad949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60064daeabb14f7dac070c1247409fba)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:53.815430 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042bc76-48d5-4c7a-9cb2-b523c48ad949 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:53.860303 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7042bc76-48d5-4c7a-9cb2-b523c48ad949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60064daeabb14f7dac070c1247409fba', 'request_id': 'req-7042bc76-48d5-4c7a-9cb2-b523c48ad949'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:53.868945 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7042bc76-48d5-4c7a-9cb2-b523c48ad949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60064daeabb14f7dac070c1247409fba', 'request_id': 'req-7042bc76-48d5-4c7a-9cb2-b523c48ad949'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:53.875606 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7042bc76-48d5-4c7a-9cb2-b523c48ad949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60064daeabb14f7dac070c1247409fba', 'request_id': 'req-7042bc76-48d5-4c7a-9cb2-b523c48ad949'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:53.881881 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:53.886668 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7042bc76-48d5-4c7a-9cb2-b523c48ad949 admin admin] The token cache is being invalidate because project 60064daeabb14f7dac070c1247409fba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:51:53.887148 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7042bc76-48d5-4c7a-9cb2-b523c48ad949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:53.888237 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7042bc76-48d5-4c7a-9cb2-b523c48ad949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:51:53.890430 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1270/2509] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:51:53 2022] DELETE /identity/v3/projects/60064daeabb14f7dac070c1247409fba => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:53.895112 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7281a-07fe-4304-8f75-1f3b3636d124 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:53.895587 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7281a-07fe-4304-8f75-1f3b3636d124 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:53.895693 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7281a-07fe-4304-8f75-1f3b3636d124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:53.913568 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b7f7281a-07fe-4304-8f75-1f3b3636d124 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:53.914782 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b7f7281a-07fe-4304-8f75-1f3b3636d124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:53.945371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:53.976072 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1240/2510] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:53.985220 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c4ba5-4236-47a5-90b1-bedd7f226e14 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:53.985506 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c4ba5-4236-47a5-90b1-bedd7f226e14 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:53.985780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c4ba5-4236-47a5-90b1-bedd7f226e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:54.004287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-970c4ba5-4236-47a5-90b1-bedd7f226e14 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:54.005524 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-970c4ba5-4236-47a5-90b1-bedd7f226e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:54.013346 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1271/2511] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:54.017450 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7281a-07fe-4304-8f75-1f3b3636d124 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:54.026933 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7281a-07fe-4304-8f75-1f3b3636d124 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:54.031498 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090b229-a2e8-420c-b485-473018bc132e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:54.032138 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090b229-a2e8-420c-b485-473018bc132e admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:54.032454 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090b229-a2e8-420c-b485-473018bc132e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:54.032761 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090b229-a2e8-420c-b485-473018bc132e admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:54.033478 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090b229-a2e8-420c-b485-473018bc132e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:51:54.033784 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090b229-a2e8-420c-b485-473018bc132e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:54.035398 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090b229-a2e8-420c-b485-473018bc132e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:54.047227 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1241/2512] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:51:54.052560 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c4ba5-4236-47a5-90b1-bedd7f226e14 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:54.063454 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c4ba5-4236-47a5-90b1-bedd7f226e14 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:54.068007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6b7a4-a6ca-4cc9-b7f0-bf93322c2c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:54.068685 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6b7a4-a6ca-4cc9-b7f0-bf93322c2c51 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:54.068972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6b7a4-a6ca-4cc9-b7f0-bf93322c2c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:54.069252 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6b7a4-a6ca-4cc9-b7f0-bf93322c2c51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:54.069932 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6b7a4-a6ca-4cc9-b7f0-bf93322c2c51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:54.071833 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6b7a4-a6ca-4cc9-b7f0-bf93322c2c51 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:54.100837 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1272/2513] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:54 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:54.101973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090b229-a2e8-420c-b485-473018bc132e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:54.112592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090b229-a2e8-420c-b485-473018bc132e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:54.167754 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5b2f7-c93b-4a3d-84c7-00911c6b40d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:54.168413 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5b2f7-c93b-4a3d-84c7-00911c6b40d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:54.168728 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5b2f7-c93b-4a3d-84c7-00911c6b40d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:54.169004 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5b2f7-c93b-4a3d-84c7-00911c6b40d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:54.169674 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5b2f7-c93b-4a3d-84c7-00911c6b40d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:54.172085 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5b2f7-c93b-4a3d-84c7-00911c6b40d6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:54.191504 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1242/2514] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:54 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:51:54.195371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6b7a4-a6ca-4cc9-b7f0-bf93322c2c51 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:54.205323 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6b7a4-a6ca-4cc9-b7f0-bf93322c2c51 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:54.209779 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101b3b8-bb0a-4909-ab46-95d0fa954847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:54.210421 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101b3b8-bb0a-4909-ab46-95d0fa954847 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:54.210699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101b3b8-bb0a-4909-ab46-95d0fa954847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:54.210982 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101b3b8-bb0a-4909-ab46-95d0fa954847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:54.211701 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d101b3b8-bb0a-4909-ab46-95d0fa954847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:54.213307 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d101b3b8-bb0a-4909-ab46-95d0fa954847 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:54.223784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1273/2515] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:54.227498 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5b2f7-c93b-4a3d-84c7-00911c6b40d6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:54.238300 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5b2f7-c93b-4a3d-84c7-00911c6b40d6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:54.242894 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb669638-52c5-45a4-9da1-e926a7c6f30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:54.243535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb669638-52c5-45a4-9da1-e926a7c6f30a admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:54.243824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb669638-52c5-45a4-9da1-e926a7c6f30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:54.244106 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb669638-52c5-45a4-9da1-e926a7c6f30a admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:54.244860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb669638-52c5-45a4-9da1-e926a7c6f30a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:54.246463 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb669638-52c5-45a4-9da1-e926a7c6f30a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:54.257558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1243/2516] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:54.261826 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101b3b8-bb0a-4909-ab46-95d0fa954847 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:54.271962 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101b3b8-bb0a-4909-ab46-95d0fa954847 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:54.276420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ed871-4441-4727-a4c4-a8630cd52214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:54.277415 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ed871-4441-4727-a4c4-a8630cd52214 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:54.277737 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ed871-4441-4727-a4c4-a8630cd52214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:54.278102 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ed871-4441-4727-a4c4-a8630cd52214 admin admin] PATH_INFO: `/v3/projects/c37389f5c9494648aa49ec804cd13ebe/users/e835028b54164fef862232f445e82dd3/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:54.293046 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ed871-4441-4727-a4c4-a8630cd52214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c37389f5c9494648aa49ec804cd13ebe, user_id=e835028b54164fef862232f445e82dd3, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:54.296307 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ed871-4441-4727-a4c4-a8630cd52214 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:54.308947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1274/2517] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:54 2022] PUT /identity/v3/projects/c37389f5c9494648aa49ec804cd13ebe/users/e835028b54164fef862232f445e82dd3/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:54.319120 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08a98a-3770-429c-857b-9e12db0c7e4d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:54.319361 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08a98a-3770-429c-857b-9e12db0c7e4d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:54.319642 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08a98a-3770-429c-857b-9e12db0c7e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:54.346846 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ac08a98a-3770-429c-857b-9e12db0c7e4d None None] MFA Rules not processed for user `e835028b54164fef862232f445e82dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:54.348051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ac08a98a-3770-429c-857b-9e12db0c7e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:54.413013 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1244/2518] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:51:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:54.417672 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ed871-4441-4727-a4c4-a8630cd52214 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:54.477155 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ed871-4441-4727-a4c4-a8630cd52214 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:54.481708 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8314a-839b-4942-ba7b-0fc1af60c326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:54.482348 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8314a-839b-4942-ba7b-0fc1af60c326 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:54.482630 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8314a-839b-4942-ba7b-0fc1af60c326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:54.483503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8314a-839b-4942-ba7b-0fc1af60c326 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:54.484448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d8314a-839b-4942-ba7b-0fc1af60c326 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:54.486381 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d8314a-839b-4942-ba7b-0fc1af60c326 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:54.510651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1275/2519] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:54 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:54.514635 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08a98a-3770-429c-857b-9e12db0c7e4d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:54.525280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08a98a-3770-429c-857b-9e12db0c7e4d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:54.551438 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:54.582760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f9aee-027a-413c-838a-095d94fc3682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:54.583355 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f9aee-027a-413c-838a-095d94fc3682 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:54.583640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f9aee-027a-413c-838a-095d94fc3682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:54.583943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f9aee-027a-413c-838a-095d94fc3682 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:54.584642 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f9aee-027a-413c-838a-095d94fc3682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:54.586577 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f9aee-027a-413c-838a-095d94fc3682 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:54.606193 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1245/2520] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:54 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:51:54.610356 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8314a-839b-4942-ba7b-0fc1af60c326 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:54.620421 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8314a-839b-4942-ba7b-0fc1af60c326 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:54.625030 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103b1e9-cbcb-46f5-b88a-420e1b7360af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:54.625674 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103b1e9-cbcb-46f5-b88a-420e1b7360af admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:54.625955 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103b1e9-cbcb-46f5-b88a-420e1b7360af admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:54.626232 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103b1e9-cbcb-46f5-b88a-420e1b7360af admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:54.626945 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103b1e9-cbcb-46f5-b88a-420e1b7360af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:54.628666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103b1e9-cbcb-46f5-b88a-420e1b7360af admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:54.638850 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1276/2521] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:54.643221 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f9aee-027a-413c-838a-095d94fc3682 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:54.653115 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f9aee-027a-413c-838a-095d94fc3682 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:54.658299 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba79aa-f712-4cf2-8a63-d6cc878c1174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:54.658936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba79aa-f712-4cf2-8a63-d6cc878c1174 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:54.659220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba79aa-f712-4cf2-8a63-d6cc878c1174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:54.659499 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba79aa-f712-4cf2-8a63-d6cc878c1174 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:54.660244 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba79aa-f712-4cf2-8a63-d6cc878c1174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:54.661917 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba79aa-f712-4cf2-8a63-d6cc878c1174 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:54.671638 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1246/2522] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:54.675532 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103b1e9-cbcb-46f5-b88a-420e1b7360af admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:54.685615 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103b1e9-cbcb-46f5-b88a-420e1b7360af admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:54.690388 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9a45c-c7ae-4c0e-8e2f-2ed3843f065a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:54.691251 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9a45c-c7ae-4c0e-8e2f-2ed3843f065a admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:54.691533 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9a45c-c7ae-4c0e-8e2f-2ed3843f065a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:54.691810 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9a45c-c7ae-4c0e-8e2f-2ed3843f065a admin admin] PATH_INFO: `/v3/projects/050633505349449288d29ff8f1b62d4b/users/d67e7dd718c04c95a9390e996d0769ef/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:54.707877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9a45c-c7ae-4c0e-8e2f-2ed3843f065a admin admin] RBAC: Authorizing `identity:create_grant(project_id=050633505349449288d29ff8f1b62d4b, user_id=d67e7dd718c04c95a9390e996d0769ef, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:54.710639 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9a45c-c7ae-4c0e-8e2f-2ed3843f065a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:54.724116 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1277/2523] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:54 2022] PUT /identity/v3/projects/050633505349449288d29ff8f1b62d4b/users/d67e7dd718c04c95a9390e996d0769ef/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:54.735419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba138a-2bb0-491d-9a2c-7f4a7105aa77 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:54.735715 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba138a-2bb0-491d-9a2c-7f4a7105aa77 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:54.736000 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba138a-2bb0-491d-9a2c-7f4a7105aa77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:54.762710 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ceba138a-2bb0-491d-9a2c-7f4a7105aa77 None None] MFA Rules not processed for user `d67e7dd718c04c95a9390e996d0769ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:54.764414 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ceba138a-2bb0-491d-9a2c-7f4a7105aa77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:54.828563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1247/2524] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:51:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:54.833196 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9a45c-c7ae-4c0e-8e2f-2ed3843f065a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:54.877110 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:54.894452 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9a45c-c7ae-4c0e-8e2f-2ed3843f065a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:54.899008 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463506dd-c857-4a2a-8a0b-9103f9a3d7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:54.899644 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463506dd-c857-4a2a-8a0b-9103f9a3d7c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:54.899922 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463506dd-c857-4a2a-8a0b-9103f9a3d7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:54.900190 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463506dd-c857-4a2a-8a0b-9103f9a3d7c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:54.900908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463506dd-c857-4a2a-8a0b-9103f9a3d7c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:54.902786 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463506dd-c857-4a2a-8a0b-9103f9a3d7c9 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:54.933725 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1278/2525] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:51:54 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:54.934820 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba138a-2bb0-491d-9a2c-7f4a7105aa77 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:54.946897 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba138a-2bb0-491d-9a2c-7f4a7105aa77 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:55.003318 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e8875-19e8-4c32-9b58-124f37c1119c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:55.004095 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e8875-19e8-4c32-9b58-124f37c1119c admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:55.004388 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e8875-19e8-4c32-9b58-124f37c1119c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:55.004702 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e8875-19e8-4c32-9b58-124f37c1119c admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:55.005432 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e8875-19e8-4c32-9b58-124f37c1119c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:55.007374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e8875-19e8-4c32-9b58-124f37c1119c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:55.027162 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1248/2526] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:51:54 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:51:55.031188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463506dd-c857-4a2a-8a0b-9103f9a3d7c9 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:55.041240 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463506dd-c857-4a2a-8a0b-9103f9a3d7c9 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:55.045782 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b06280-8701-449f-9774-7b1970e4404a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:55.046432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b06280-8701-449f-9774-7b1970e4404a admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:55.046718 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b06280-8701-449f-9774-7b1970e4404a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:55.046998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b06280-8701-449f-9774-7b1970e4404a admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:55.047720 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b06280-8701-449f-9774-7b1970e4404a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:55.049361 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b06280-8701-449f-9774-7b1970e4404a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:55.064258 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1279/2527] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:55.065608 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e8875-19e8-4c32-9b58-124f37c1119c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:55.075523 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e8875-19e8-4c32-9b58-124f37c1119c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:55.080748 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1da9c-a2de-4a56-8bbe-831ef7e6e562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:55.081612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1da9c-a2de-4a56-8bbe-831ef7e6e562 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:55.081894 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1da9c-a2de-4a56-8bbe-831ef7e6e562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:55.082173 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1da9c-a2de-4a56-8bbe-831ef7e6e562 admin admin] PATH_INFO: `/v3/projects/817f61cf5e3247bd832bba7ccdf9b7ae/users/bb7e9c709a554342b51cf7474a15898e/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:55.099734 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1da9c-a2de-4a56-8bbe-831ef7e6e562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=817f61cf5e3247bd832bba7ccdf9b7ae, user_id=bb7e9c709a554342b51cf7474a15898e, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:55.102370 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1da9c-a2de-4a56-8bbe-831ef7e6e562 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:55.115130 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1249/2528] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:55 2022] PUT /identity/v3/projects/817f61cf5e3247bd832bba7ccdf9b7ae/users/bb7e9c709a554342b51cf7474a15898e/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:55.119203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b06280-8701-449f-9774-7b1970e4404a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:55.129465 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b06280-8701-449f-9774-7b1970e4404a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:55.184520 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c518c-4fa4-49a3-95b7-f2057ba7064a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:55.185192 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c518c-4fa4-49a3-95b7-f2057ba7064a admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:55.185478 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c518c-4fa4-49a3-95b7-f2057ba7064a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:55.186259 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c518c-4fa4-49a3-95b7-f2057ba7064a admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:55.186971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c518c-4fa4-49a3-95b7-f2057ba7064a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:55.188600 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c518c-4fa4-49a3-95b7-f2057ba7064a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:55.198166 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1280/2529] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:51:55.203039 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1da9c-a2de-4a56-8bbe-831ef7e6e562 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:55.208416 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:55.215037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1da9c-a2de-4a56-8bbe-831ef7e6e562 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:55.219927 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3029301-3232-487f-a4fc-c7df8545622f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:55.220839 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3029301-3232-487f-a4fc-c7df8545622f admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:55.221129 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3029301-3232-487f-a4fc-c7df8545622f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:55.221408 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3029301-3232-487f-a4fc-c7df8545622f admin admin] PATH_INFO: `/v3/projects/817f61cf5e3247bd832bba7ccdf9b7ae/users/bb7e9c709a554342b51cf7474a15898e/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:55.223365 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3029301-3232-487f-a4fc-c7df8545622f admin admin] RBAC: Authorizing `identity:create_grant(project_id=817f61cf5e3247bd832bba7ccdf9b7ae, user_id=bb7e9c709a554342b51cf7474a15898e, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:55.226092 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3029301-3232-487f-a4fc-c7df8545622f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:55.236355 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1250/2530] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:51:55 2022] PUT /identity/v3/projects/817f61cf5e3247bd832bba7ccdf9b7ae/users/bb7e9c709a554342b51cf7474a15898e/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:51:55.246242 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4182a-8976-46a8-897a-79fdda1b801c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:55.246554 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4182a-8976-46a8-897a-79fdda1b801c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:55.246884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4182a-8976-46a8-897a-79fdda1b801c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:55.275624 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-1bc4182a-8976-46a8-897a-79fdda1b801c None None] MFA Rules not processed for user `bb7e9c709a554342b51cf7474a15898e`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:51:55.276887 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1bc4182a-8976-46a8-897a-79fdda1b801c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:55.342982 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1281/2531] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:51:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:51:55.353708 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3029301-3232-487f-a4fc-c7df8545622f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:55.355362 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f3029301-3232-487f-a4fc-c7df8545622f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:55.412572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3029301-3232-487f-a4fc-c7df8545622f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:55.416161 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2af06e-00e9-4c7f-8907-37172924383b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:55.416829 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2af06e-00e9-4c7f-8907-37172924383b service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:55.417120 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2af06e-00e9-4c7f-8907-37172924383b service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:55.417404 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2af06e-00e9-4c7f-8907-37172924383b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:55.426760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2af06e-00e9-4c7f-8907-37172924383b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:55.428205 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2af06e-00e9-4c7f-8907-37172924383b service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:55.438201 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1251/2532] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:51:55.921318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4182a-8976-46a8-897a-79fdda1b801c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:51:55.922689 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1bc4182a-8976-46a8-897a-79fdda1b801c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:51:55.934437 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4182a-8976-46a8-897a-79fdda1b801c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:51:55.937954 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260d87a-ff03-4ac6-91d6-8b65b2d5567f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:51:55.938578 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260d87a-ff03-4ac6-91d6-8b65b2d5567f service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:51:55.938853 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260d87a-ff03-4ac6-91d6-8b65b2d5567f service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:51:55.939122 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260d87a-ff03-4ac6-91d6-8b65b2d5567f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:51:55.976474 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:51:55.996818 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260d87a-ff03-4ac6-91d6-8b65b2d5567f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:51:55.998255 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260d87a-ff03-4ac6-91d6-8b65b2d5567f service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:51:56.007073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1282/2533] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:51:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:00.018655 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2af06e-00e9-4c7f-8907-37172924383b service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:00.028302 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2af06e-00e9-4c7f-8907-37172924383b service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:00.032747 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51dae2-bad8-4fce-9b89-dc6fa6251044 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:00.033426 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51dae2-bad8-4fce-9b89-dc6fa6251044 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:00.033717 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51dae2-bad8-4fce-9b89-dc6fa6251044 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:00.034115 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51dae2-bad8-4fce-9b89-dc6fa6251044 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:00.100152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51dae2-bad8-4fce-9b89-dc6fa6251044 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:00.101699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51dae2-bad8-4fce-9b89-dc6fa6251044 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:00.112537 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1252/2534] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:02.141690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260d87a-ff03-4ac6-91d6-8b65b2d5567f service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:02.202999 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260d87a-ff03-4ac6-91d6-8b65b2d5567f service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:02.207420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad51f0-62d3-490f-b70b-6f6fed1863fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:02.208292 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad51f0-62d3-490f-b70b-6f6fed1863fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:02.208606 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad51f0-62d3-490f-b70b-6f6fed1863fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:02.208883 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad51f0-62d3-490f-b70b-6f6fed1863fb admin admin] PATH_INFO: `/v3/users/e835028b54164fef862232f445e82dd3` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:02.210062 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad51f0-62d3-490f-b70b-6f6fed1863fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e835028b54164fef862232f445e82dd3)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:02.211984 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad51f0-62d3-490f-b70b-6f6fed1863fb admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:02.276959 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-efad51f0-62d3-490f-b70b-6f6fed1863fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e835028b54164fef862232f445e82dd3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:02.306306 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-efad51f0-62d3-490f-b70b-6f6fed1863fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e835028b54164fef862232f445e82dd3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:02.307111 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-efad51f0-62d3-490f-b70b-6f6fed1863fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e835028b54164fef862232f445e82dd3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:02.315656 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-efad51f0-62d3-490f-b70b-6f6fed1863fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e835028b54164fef862232f445e82dd3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:02.316564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-efad51f0-62d3-490f-b70b-6f6fed1863fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e835028b54164fef862232f445e82dd3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:02.332001 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1283/2535] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:02 2022] DELETE /identity/v3/users/e835028b54164fef862232f445e82dd3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:02.336294 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93bbee-372d-4f22-bd7e-bec1ab1a5a2c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:02.336843 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93bbee-372d-4f22-bd7e-bec1ab1a5a2c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:02.336972 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93bbee-372d-4f22-bd7e-bec1ab1a5a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:02.356896 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0e93bbee-372d-4f22-bd7e-bec1ab1a5a2c None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:02.357535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0e93bbee-372d-4f22-bd7e-bec1ab1a5a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:02.426304 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1253/2536] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:02.436710 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad51f0-62d3-490f-b70b-6f6fed1863fb admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:02.438263 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-efad51f0-62d3-490f-b70b-6f6fed1863fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:02.496305 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad51f0-62d3-490f-b70b-6f6fed1863fb admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:02.500644 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ec901-59cf-4a52-ac3f-e0cf0970671f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:02.501287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ec901-59cf-4a52-ac3f-e0cf0970671f service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:02.501597 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ec901-59cf-4a52-ac3f-e0cf0970671f service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:02.501887 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ec901-59cf-4a52-ac3f-e0cf0970671f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:02.511373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ec901-59cf-4a52-ac3f-e0cf0970671f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:02.512848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ec901-59cf-4a52-ac3f-e0cf0970671f service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:02.518738 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:02.535062 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1284/2537] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:02.870928 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93bbee-372d-4f22-bd7e-bec1ab1a5a2c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:02.872408 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0e93bbee-372d-4f22-bd7e-bec1ab1a5a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:02.884483 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93bbee-372d-4f22-bd7e-bec1ab1a5a2c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:02.890044 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23447d86-e64e-4647-aadc-2ded2fb545a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:02.890867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23447d86-e64e-4647-aadc-2ded2fb545a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:02.891152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23447d86-e64e-4647-aadc-2ded2fb545a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:02.891502 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23447d86-e64e-4647-aadc-2ded2fb545a1 admin admin] PATH_INFO: `/v3/projects/c37389f5c9494648aa49ec804cd13ebe` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:02.892632 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23447d86-e64e-4647-aadc-2ded2fb545a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c37389f5c9494648aa49ec804cd13ebe)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:02.894560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23447d86-e64e-4647-aadc-2ded2fb545a1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:02.925732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:02.944161 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-23447d86-e64e-4647-aadc-2ded2fb545a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c37389f5c9494648aa49ec804cd13ebe', 'request_id': 'req-23447d86-e64e-4647-aadc-2ded2fb545a1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:02.952455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-23447d86-e64e-4647-aadc-2ded2fb545a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c37389f5c9494648aa49ec804cd13ebe', 'request_id': 'req-23447d86-e64e-4647-aadc-2ded2fb545a1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:02.957910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-23447d86-e64e-4647-aadc-2ded2fb545a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c37389f5c9494648aa49ec804cd13ebe', 'request_id': 'req-23447d86-e64e-4647-aadc-2ded2fb545a1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:02.969307 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-23447d86-e64e-4647-aadc-2ded2fb545a1 admin admin] The token cache is being invalidate because project c37389f5c9494648aa49ec804cd13ebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:02.969593 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-23447d86-e64e-4647-aadc-2ded2fb545a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:02.970218 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-23447d86-e64e-4647-aadc-2ded2fb545a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:02.971741 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1254/2538] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:02 2022] DELETE /identity/v3/projects/c37389f5c9494648aa49ec804cd13ebe => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:02.975759 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ec901-59cf-4a52-ac3f-e0cf0970671f service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:02.985876 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ec901-59cf-4a52-ac3f-e0cf0970671f service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:03.041526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1565298-9964-43d4-9485-6c543ff40518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:03.042393 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1565298-9964-43d4-9485-6c543ff40518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:03.042674 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1565298-9964-43d4-9485-6c543ff40518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:03.042948 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1565298-9964-43d4-9485-6c543ff40518 admin admin] PATH_INFO: `/v3/users/d67e7dd718c04c95a9390e996d0769ef` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:03.044116 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1565298-9964-43d4-9485-6c543ff40518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d67e7dd718c04c95a9390e996d0769ef)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:03.046071 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1565298-9964-43d4-9485-6c543ff40518 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:03.091671 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b1565298-9964-43d4-9485-6c543ff40518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd67e7dd718c04c95a9390e996d0769ef'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:03.103746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b1565298-9964-43d4-9485-6c543ff40518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd67e7dd718c04c95a9390e996d0769ef'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:03.104404 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b1565298-9964-43d4-9485-6c543ff40518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd67e7dd718c04c95a9390e996d0769ef'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:03.111382 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b1565298-9964-43d4-9485-6c543ff40518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd67e7dd718c04c95a9390e996d0769ef'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:03.112006 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b1565298-9964-43d4-9485-6c543ff40518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd67e7dd718c04c95a9390e996d0769ef'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:03.124324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1285/2539] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:02 2022] DELETE /identity/v3/users/d67e7dd718c04c95a9390e996d0769ef => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:03.398480 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23447d86-e64e-4647-aadc-2ded2fb545a1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:03.399947 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-23447d86-e64e-4647-aadc-2ded2fb545a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:03.414563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23447d86-e64e-4647-aadc-2ded2fb545a1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:03.483519 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e2cdb-1867-4b5c-94dc-873d4545209c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:03.484686 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e2cdb-1867-4b5c-94dc-873d4545209c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:03.484967 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e2cdb-1867-4b5c-94dc-873d4545209c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:03.485241 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e2cdb-1867-4b5c-94dc-873d4545209c admin admin] PATH_INFO: `/v3/projects/050633505349449288d29ff8f1b62d4b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:03.486426 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e2cdb-1867-4b5c-94dc-873d4545209c admin admin] RBAC: Authorizing `identity:delete_project(project_id=050633505349449288d29ff8f1b62d4b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:03.488339 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e2cdb-1867-4b5c-94dc-873d4545209c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:03.535262 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ec0e2cdb-1867-4b5c-94dc-873d4545209c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '050633505349449288d29ff8f1b62d4b', 'request_id': 'req-ec0e2cdb-1867-4b5c-94dc-873d4545209c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:03.542908 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ec0e2cdb-1867-4b5c-94dc-873d4545209c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '050633505349449288d29ff8f1b62d4b', 'request_id': 'req-ec0e2cdb-1867-4b5c-94dc-873d4545209c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:03.549118 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ec0e2cdb-1867-4b5c-94dc-873d4545209c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '050633505349449288d29ff8f1b62d4b', 'request_id': 'req-ec0e2cdb-1867-4b5c-94dc-873d4545209c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:03.561242 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ec0e2cdb-1867-4b5c-94dc-873d4545209c admin admin] The token cache is being invalidate because project 050633505349449288d29ff8f1b62d4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:03.561683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ec0e2cdb-1867-4b5c-94dc-873d4545209c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:03.562330 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ec0e2cdb-1867-4b5c-94dc-873d4545209c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:03.564175 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1255/2540] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:03 2022] DELETE /identity/v3/projects/050633505349449288d29ff8f1b62d4b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:03.567871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1565298-9964-43d4-9485-6c543ff40518 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:03.569332 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b1565298-9964-43d4-9485-6c543ff40518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:03.582663 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1565298-9964-43d4-9485-6c543ff40518 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:03.637589 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c86b4a-1a4f-42cc-9128-dbde9782035a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:03.638446 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c86b4a-1a4f-42cc-9128-dbde9782035a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:03.638796 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c86b4a-1a4f-42cc-9128-dbde9782035a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:03.639078 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c86b4a-1a4f-42cc-9128-dbde9782035a admin admin] PATH_INFO: `/v3/users/bb7e9c709a554342b51cf7474a15898e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:03.640270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c86b4a-1a4f-42cc-9128-dbde9782035a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb7e9c709a554342b51cf7474a15898e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:03.642224 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c86b4a-1a4f-42cc-9128-dbde9782035a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:03.662712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:03.687654 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-08c86b4a-1a4f-42cc-9128-dbde9782035a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb7e9c709a554342b51cf7474a15898e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:03.699198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-08c86b4a-1a4f-42cc-9128-dbde9782035a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb7e9c709a554342b51cf7474a15898e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:03.699843 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-08c86b4a-1a4f-42cc-9128-dbde9782035a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb7e9c709a554342b51cf7474a15898e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:03.706631 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-08c86b4a-1a4f-42cc-9128-dbde9782035a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb7e9c709a554342b51cf7474a15898e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:03.707250 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-08c86b4a-1a4f-42cc-9128-dbde9782035a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb7e9c709a554342b51cf7474a15898e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:03.719462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1286/2541] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:03 2022] DELETE /identity/v3/users/bb7e9c709a554342b51cf7474a15898e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:04.065338 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e2cdb-1867-4b5c-94dc-873d4545209c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:04.066877 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ec0e2cdb-1867-4b5c-94dc-873d4545209c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:04.079959 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e2cdb-1867-4b5c-94dc-873d4545209c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:04.124533 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:04.140340 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f788afb-d5fb-4a87-b2f1-f7bae334ed15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:04.141217 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f788afb-d5fb-4a87-b2f1-f7bae334ed15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:04.141503 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f788afb-d5fb-4a87-b2f1-f7bae334ed15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:04.141782 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f788afb-d5fb-4a87-b2f1-f7bae334ed15 admin admin] PATH_INFO: `/v3/projects/817f61cf5e3247bd832bba7ccdf9b7ae` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:04.142955 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f788afb-d5fb-4a87-b2f1-f7bae334ed15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=817f61cf5e3247bd832bba7ccdf9b7ae)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:04.144947 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f788afb-d5fb-4a87-b2f1-f7bae334ed15 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:04.191060 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1f788afb-d5fb-4a87-b2f1-f7bae334ed15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '817f61cf5e3247bd832bba7ccdf9b7ae', 'request_id': 'req-1f788afb-d5fb-4a87-b2f1-f7bae334ed15'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:04.197853 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1f788afb-d5fb-4a87-b2f1-f7bae334ed15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '817f61cf5e3247bd832bba7ccdf9b7ae', 'request_id': 'req-1f788afb-d5fb-4a87-b2f1-f7bae334ed15'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:04.203281 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1f788afb-d5fb-4a87-b2f1-f7bae334ed15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '817f61cf5e3247bd832bba7ccdf9b7ae', 'request_id': 'req-1f788afb-d5fb-4a87-b2f1-f7bae334ed15'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:04.214243 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1f788afb-d5fb-4a87-b2f1-f7bae334ed15 admin admin] The token cache is being invalidate because project 817f61cf5e3247bd832bba7ccdf9b7ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:04.214526 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1f788afb-d5fb-4a87-b2f1-f7bae334ed15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:04.215148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1f788afb-d5fb-4a87-b2f1-f7bae334ed15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:04.216693 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1256/2542] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:04 2022] DELETE /identity/v3/projects/817f61cf5e3247bd832bba7ccdf9b7ae => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:04.223157 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca3a60-ee8c-41ce-b0ee-7cf200d7efe4 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:04.223447 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca3a60-ee8c-41ce-b0ee-7cf200d7efe4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:04.223722 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca3a60-ee8c-41ce-b0ee-7cf200d7efe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:04.242669 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a5ca3a60-ee8c-41ce-b0ee-7cf200d7efe4 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:04.243857 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a5ca3a60-ee8c-41ce-b0ee-7cf200d7efe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:04.308189 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1287/2543] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:04.317638 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b7c67-e9cc-4078-ada3-68a366296bfc None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:04.317936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b7c67-e9cc-4078-ada3-68a366296bfc None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:04.318221 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b7c67-e9cc-4078-ada3-68a366296bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:04.338185 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4a1b7c67-e9cc-4078-ada3-68a366296bfc None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:04.339407 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4a1b7c67-e9cc-4078-ada3-68a366296bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:04.348213 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1257/2544] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:04.353216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca3a60-ee8c-41ce-b0ee-7cf200d7efe4 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:04.363151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca3a60-ee8c-41ce-b0ee-7cf200d7efe4 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:04.367986 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7fcf7-c515-4bcb-84a0-a6bf6c8b346d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:04.368673 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7fcf7-c515-4bcb-84a0-a6bf6c8b346d admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:04.368961 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7fcf7-c515-4bcb-84a0-a6bf6c8b346d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:04.369236 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7fcf7-c515-4bcb-84a0-a6bf6c8b346d admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:04.370083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7fcf7-c515-4bcb-84a0-a6bf6c8b346d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:52:04.370398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7fcf7-c515-4bcb-84a0-a6bf6c8b346d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:04.371997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7fcf7-c515-4bcb-84a0-a6bf6c8b346d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:04.385552 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1288/2545] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:52:04.390201 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b7c67-e9cc-4078-ada3-68a366296bfc None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:04.399374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b7c67-e9cc-4078-ada3-68a366296bfc None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:04.404247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d027eb2-8b04-49da-8224-9647ac60a320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:04.405776 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d027eb2-8b04-49da-8224-9647ac60a320 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:04.406103 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d027eb2-8b04-49da-8224-9647ac60a320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:04.406387 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d027eb2-8b04-49da-8224-9647ac60a320 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:04.407076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d027eb2-8b04-49da-8224-9647ac60a320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:04.409076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d027eb2-8b04-49da-8224-9647ac60a320 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:04.442568 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1258/2546] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:04 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:52:04.443633 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7fcf7-c515-4bcb-84a0-a6bf6c8b346d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:04.455523 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7fcf7-c515-4bcb-84a0-a6bf6c8b346d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:04.512847 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff3cea-9601-48d2-9bc4-c008b2f6aa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:04.513519 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff3cea-9601-48d2-9bc4-c008b2f6aa3f admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:04.514298 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff3cea-9601-48d2-9bc4-c008b2f6aa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:04.514573 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff3cea-9601-48d2-9bc4-c008b2f6aa3f admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:04.515262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff3cea-9601-48d2-9bc4-c008b2f6aa3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:04.517221 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff3cea-9601-48d2-9bc4-c008b2f6aa3f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:04.538075 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1289/2547] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:04 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:04.542118 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d027eb2-8b04-49da-8224-9647ac60a320 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:04.552625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d027eb2-8b04-49da-8224-9647ac60a320 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:04.557413 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747f038-319e-4be2-8dc9-8ccebe79fe87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:04.558066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747f038-319e-4be2-8dc9-8ccebe79fe87 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:04.558350 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747f038-319e-4be2-8dc9-8ccebe79fe87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:04.558630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747f038-319e-4be2-8dc9-8ccebe79fe87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:04.559345 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747f038-319e-4be2-8dc9-8ccebe79fe87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:04.561052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747f038-319e-4be2-8dc9-8ccebe79fe87 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:04.572253 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1259/2548] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:04.576117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff3cea-9601-48d2-9bc4-c008b2f6aa3f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:04.587207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff3cea-9601-48d2-9bc4-c008b2f6aa3f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:04.593405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92d8b4-3f14-4440-916e-90225b8a8c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:04.594067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92d8b4-3f14-4440-916e-90225b8a8c3c admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:04.594346 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92d8b4-3f14-4440-916e-90225b8a8c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:04.595104 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92d8b4-3f14-4440-916e-90225b8a8c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:04.595823 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92d8b4-3f14-4440-916e-90225b8a8c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:04.597465 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92d8b4-3f14-4440-916e-90225b8a8c3c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:04.610654 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1290/2549] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:52:04.614685 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747f038-319e-4be2-8dc9-8ccebe79fe87 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:04.625680 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747f038-319e-4be2-8dc9-8ccebe79fe87 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:04.630979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb707b-5c41-4cea-9d4c-10a43b3a11cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:04.632089 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb707b-5c41-4cea-9d4c-10a43b3a11cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:04.632616 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb707b-5c41-4cea-9d4c-10a43b3a11cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:04.633282 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb707b-5c41-4cea-9d4c-10a43b3a11cc admin admin] PATH_INFO: `/v3/projects/6828b06d24b8444fb37e358de26d9289/users/a578e1dd9d6640c887879cb27d9fbf5f/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:04.656299 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb707b-5c41-4cea-9d4c-10a43b3a11cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6828b06d24b8444fb37e358de26d9289, user_id=a578e1dd9d6640c887879cb27d9fbf5f, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:04.659032 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb707b-5c41-4cea-9d4c-10a43b3a11cc admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:04.680377 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1260/2550] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:04 2022] PUT /identity/v3/projects/6828b06d24b8444fb37e358de26d9289/users/a578e1dd9d6640c887879cb27d9fbf5f/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:52:04.693438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384310d-923e-4bde-9d80-3c5012c20a98 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:04.694121 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384310d-923e-4bde-9d80-3c5012c20a98 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:04.694406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384310d-923e-4bde-9d80-3c5012c20a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:04.703687 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:04.728123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0384310d-923e-4bde-9d80-3c5012c20a98 None None] MFA Rules not processed for user `a578e1dd9d6640c887879cb27d9fbf5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:04.732253 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0384310d-923e-4bde-9d80-3c5012c20a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:04.803485 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1291/2551] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:04.807715 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb707b-5c41-4cea-9d4c-10a43b3a11cc admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:04.881700 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb707b-5c41-4cea-9d4c-10a43b3a11cc admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:04.886455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51107c10-1e5b-4ca5-b811-3698ef3e2934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:04.887116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51107c10-1e5b-4ca5-b811-3698ef3e2934 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:04.887411 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51107c10-1e5b-4ca5-b811-3698ef3e2934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:04.887687 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51107c10-1e5b-4ca5-b811-3698ef3e2934 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:04.888385 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51107c10-1e5b-4ca5-b811-3698ef3e2934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:04.890603 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51107c10-1e5b-4ca5-b811-3698ef3e2934 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:04.905495 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:04.926967 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1261/2552] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:04 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:04.931215 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384310d-923e-4bde-9d80-3c5012c20a98 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:04.942196 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384310d-923e-4bde-9d80-3c5012c20a98 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:05.007301 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a9509-76ec-4f74-bdd0-7b69b4bda9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:05.007973 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a9509-76ec-4f74-bdd0-7b69b4bda9f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:05.008270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a9509-76ec-4f74-bdd0-7b69b4bda9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:05.008658 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a9509-76ec-4f74-bdd0-7b69b4bda9f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:05.009354 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a9509-76ec-4f74-bdd0-7b69b4bda9f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:05.011403 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a9509-76ec-4f74-bdd0-7b69b4bda9f7 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:05.034893 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1292/2553] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:04 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:52:05.038767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51107c10-1e5b-4ca5-b811-3698ef3e2934 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:05.050714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51107c10-1e5b-4ca5-b811-3698ef3e2934 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:05.055650 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6f8db-d8bb-4d92-8710-29148a90204d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:05.056343 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6f8db-d8bb-4d92-8710-29148a90204d admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:05.056664 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6f8db-d8bb-4d92-8710-29148a90204d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:05.056946 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6f8db-d8bb-4d92-8710-29148a90204d admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:05.057702 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6f8db-d8bb-4d92-8710-29148a90204d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:05.059530 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6f8db-d8bb-4d92-8710-29148a90204d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:05.071525 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1262/2554] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:05.075957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a9509-76ec-4f74-bdd0-7b69b4bda9f7 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:05.089443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a9509-76ec-4f74-bdd0-7b69b4bda9f7 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:05.095547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb32ac-bff2-40fe-8f48-1bbac76947ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:05.096640 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb32ac-bff2-40fe-8f48-1bbac76947ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:05.098697 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb32ac-bff2-40fe-8f48-1bbac76947ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:05.099115 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb32ac-bff2-40fe-8f48-1bbac76947ff admin admin] PATH_INFO: `/v3/projects/51092f4cb26943949f1a86770ef3ca69/users/b89c68f399714958a9074a18eacd954d/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:05.119932 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb32ac-bff2-40fe-8f48-1bbac76947ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=51092f4cb26943949f1a86770ef3ca69, user_id=b89c68f399714958a9074a18eacd954d, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:05.123643 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb32ac-bff2-40fe-8f48-1bbac76947ff admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:05.155776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1293/2555] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:05 2022] PUT /identity/v3/projects/51092f4cb26943949f1a86770ef3ca69/users/b89c68f399714958a9074a18eacd954d/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:05.160907 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6f8db-d8bb-4d92-8710-29148a90204d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:05.172730 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6f8db-d8bb-4d92-8710-29148a90204d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:05.274106 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1b257-154d-457b-aaa9-f6ceb7f8af55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:05.275096 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1b257-154d-457b-aaa9-f6ceb7f8af55 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:05.275590 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1b257-154d-457b-aaa9-f6ceb7f8af55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:05.276033 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1b257-154d-457b-aaa9-f6ceb7f8af55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:05.276967 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1b257-154d-457b-aaa9-f6ceb7f8af55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:05.278923 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1b257-154d-457b-aaa9-f6ceb7f8af55 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:05.296244 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1263/2556] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:05.302209 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb32ac-bff2-40fe-8f48-1bbac76947ff admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:05.315530 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb32ac-bff2-40fe-8f48-1bbac76947ff admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:05.322434 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561eb9cd-f337-4a1c-b547-d8e6d47976ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:05.323477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561eb9cd-f337-4a1c-b547-d8e6d47976ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:05.323827 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561eb9cd-f337-4a1c-b547-d8e6d47976ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:05.324169 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561eb9cd-f337-4a1c-b547-d8e6d47976ee admin admin] PATH_INFO: `/v3/projects/51092f4cb26943949f1a86770ef3ca69/users/b89c68f399714958a9074a18eacd954d/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:05.336546 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561eb9cd-f337-4a1c-b547-d8e6d47976ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=51092f4cb26943949f1a86770ef3ca69, user_id=b89c68f399714958a9074a18eacd954d, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:05.344553 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561eb9cd-f337-4a1c-b547-d8e6d47976ee admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:05.365063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1294/2557] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:05 2022] PUT /identity/v3/projects/51092f4cb26943949f1a86770ef3ca69/users/b89c68f399714958a9074a18eacd954d/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:05.375453 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61347e14-9faa-445e-9be8-da0e5d70d2f5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:05.376012 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61347e14-9faa-445e-9be8-da0e5d70d2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:05.376491 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61347e14-9faa-445e-9be8-da0e5d70d2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:05.408688 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-61347e14-9faa-445e-9be8-da0e5d70d2f5 None None] MFA Rules not processed for user `b89c68f399714958a9074a18eacd954d`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:05.410025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-61347e14-9faa-445e-9be8-da0e5d70d2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:05.488071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1264/2558] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:05.500449 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561eb9cd-f337-4a1c-b547-d8e6d47976ee admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:05.502153 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-561eb9cd-f337-4a1c-b547-d8e6d47976ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:05.553570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:05.560348 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561eb9cd-f337-4a1c-b547-d8e6d47976ee admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:05.565656 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afdd37-cee5-4ce6-af1a-461f7130b7b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:05.566311 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afdd37-cee5-4ce6-af1a-461f7130b7b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:05.566595 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afdd37-cee5-4ce6-af1a-461f7130b7b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:05.566871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afdd37-cee5-4ce6-af1a-461f7130b7b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:05.578093 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afdd37-cee5-4ce6-af1a-461f7130b7b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:05.579559 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afdd37-cee5-4ce6-af1a-461f7130b7b3 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:05.599570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1295/2559] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:05.710321 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61347e14-9faa-445e-9be8-da0e5d70d2f5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:05.721053 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61347e14-9faa-445e-9be8-da0e5d70d2f5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:05.724962 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40860deb-0ee2-46d0-b0c6-01d7c475917c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:05.725604 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40860deb-0ee2-46d0-b0c6-01d7c475917c service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:05.725889 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40860deb-0ee2-46d0-b0c6-01d7c475917c service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:05.726171 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40860deb-0ee2-46d0-b0c6-01d7c475917c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:05.789809 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40860deb-0ee2-46d0-b0c6-01d7c475917c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:05.791460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40860deb-0ee2-46d0-b0c6-01d7c475917c service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:05.807509 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1265/2560] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:08.422104 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afdd37-cee5-4ce6-af1a-461f7130b7b3 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:08.486436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afdd37-cee5-4ce6-af1a-461f7130b7b3 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:08.491059 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d455582-5b77-4aaa-bda9-2556a2e1296d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:08.491922 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d455582-5b77-4aaa-bda9-2556a2e1296d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:08.492201 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d455582-5b77-4aaa-bda9-2556a2e1296d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:08.492629 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d455582-5b77-4aaa-bda9-2556a2e1296d admin admin] PATH_INFO: `/v3/users/a578e1dd9d6640c887879cb27d9fbf5f` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:08.493833 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d455582-5b77-4aaa-bda9-2556a2e1296d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a578e1dd9d6640c887879cb27d9fbf5f)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:08.495832 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d455582-5b77-4aaa-bda9-2556a2e1296d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:08.542926 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8d455582-5b77-4aaa-bda9-2556a2e1296d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a578e1dd9d6640c887879cb27d9fbf5f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:08.554332 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8d455582-5b77-4aaa-bda9-2556a2e1296d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a578e1dd9d6640c887879cb27d9fbf5f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:08.555008 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8d455582-5b77-4aaa-bda9-2556a2e1296d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a578e1dd9d6640c887879cb27d9fbf5f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:08.562213 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8d455582-5b77-4aaa-bda9-2556a2e1296d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a578e1dd9d6640c887879cb27d9fbf5f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:08.562835 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8d455582-5b77-4aaa-bda9-2556a2e1296d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a578e1dd9d6640c887879cb27d9fbf5f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:08.575217 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1296/2561] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:08 2022] DELETE /identity/v3/users/a578e1dd9d6640c887879cb27d9fbf5f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:08.580155 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11ebcf-84ed-4e82-a072-f511d7d4691f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:08.580667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11ebcf-84ed-4e82-a072-f511d7d4691f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:08.580770 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11ebcf-84ed-4e82-a072-f511d7d4691f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:08.587350 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:08.598276 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-bb11ebcf-84ed-4e82-a072-f511d7d4691f None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:08.599467 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-bb11ebcf-84ed-4e82-a072-f511d7d4691f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:08.659987 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1266/2562] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:08.671070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d455582-5b77-4aaa-bda9-2556a2e1296d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:08.672731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8d455582-5b77-4aaa-bda9-2556a2e1296d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:08.733249 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d455582-5b77-4aaa-bda9-2556a2e1296d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:08.737188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cf1d0-8774-455d-8f58-3373db9ae64b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:08.737839 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cf1d0-8774-455d-8f58-3373db9ae64b service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:08.738122 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cf1d0-8774-455d-8f58-3373db9ae64b service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:08.738401 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cf1d0-8774-455d-8f58-3373db9ae64b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:08.747411 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cf1d0-8774-455d-8f58-3373db9ae64b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:08.749382 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cf1d0-8774-455d-8f58-3373db9ae64b service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:08.758778 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1297/2563] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:09.023850 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11ebcf-84ed-4e82-a072-f511d7d4691f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:09.025324 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-bb11ebcf-84ed-4e82-a072-f511d7d4691f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:09.037389 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11ebcf-84ed-4e82-a072-f511d7d4691f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:09.041957 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50de4f-514e-4d6e-937b-ac31f8407faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:09.042802 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50de4f-514e-4d6e-937b-ac31f8407faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:09.043080 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50de4f-514e-4d6e-937b-ac31f8407faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:09.043355 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50de4f-514e-4d6e-937b-ac31f8407faa admin admin] PATH_INFO: `/v3/projects/6828b06d24b8444fb37e358de26d9289` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:09.044529 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50de4f-514e-4d6e-937b-ac31f8407faa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6828b06d24b8444fb37e358de26d9289)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:09.046959 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50de4f-514e-4d6e-937b-ac31f8407faa admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:09.093253 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9a50de4f-514e-4d6e-937b-ac31f8407faa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6828b06d24b8444fb37e358de26d9289', 'request_id': 'req-9a50de4f-514e-4d6e-937b-ac31f8407faa'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:09.101389 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9a50de4f-514e-4d6e-937b-ac31f8407faa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6828b06d24b8444fb37e358de26d9289', 'request_id': 'req-9a50de4f-514e-4d6e-937b-ac31f8407faa'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:09.108334 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9a50de4f-514e-4d6e-937b-ac31f8407faa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6828b06d24b8444fb37e358de26d9289', 'request_id': 'req-9a50de4f-514e-4d6e-937b-ac31f8407faa'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:09.119599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9a50de4f-514e-4d6e-937b-ac31f8407faa admin admin] The token cache is being invalidate because project 6828b06d24b8444fb37e358de26d9289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:09.119888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9a50de4f-514e-4d6e-937b-ac31f8407faa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:09.120547 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9a50de4f-514e-4d6e-937b-ac31f8407faa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:09.122080 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1267/2564] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:09 2022] DELETE /identity/v3/projects/6828b06d24b8444fb37e358de26d9289 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:09.126156 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cf1d0-8774-455d-8f58-3373db9ae64b service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:09.135628 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cf1d0-8774-455d-8f58-3373db9ae64b service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:09.146160 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:09.196488 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fba41-340c-4510-8534-b5972e66737a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:09.197398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fba41-340c-4510-8534-b5972e66737a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:09.197677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fba41-340c-4510-8534-b5972e66737a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:09.197947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fba41-340c-4510-8534-b5972e66737a admin admin] PATH_INFO: `/v3/users/b89c68f399714958a9074a18eacd954d` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:09.199153 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fba41-340c-4510-8534-b5972e66737a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b89c68f399714958a9074a18eacd954d)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:09.201077 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fba41-340c-4510-8534-b5972e66737a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:09.247404 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c71fba41-340c-4510-8534-b5972e66737a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b89c68f399714958a9074a18eacd954d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:09.259134 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c71fba41-340c-4510-8534-b5972e66737a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b89c68f399714958a9074a18eacd954d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:09.259929 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c71fba41-340c-4510-8534-b5972e66737a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b89c68f399714958a9074a18eacd954d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:09.266832 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c71fba41-340c-4510-8534-b5972e66737a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b89c68f399714958a9074a18eacd954d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:09.267465 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c71fba41-340c-4510-8534-b5972e66737a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b89c68f399714958a9074a18eacd954d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:09.280948 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1298/2565] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:09 2022] DELETE /identity/v3/users/b89c68f399714958a9074a18eacd954d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:09.559816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50de4f-514e-4d6e-937b-ac31f8407faa admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:09.561402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9a50de4f-514e-4d6e-937b-ac31f8407faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:09.570731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fba41-340c-4510-8534-b5972e66737a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:09.572564 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c71fba41-340c-4510-8534-b5972e66737a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:09.626429 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50de4f-514e-4d6e-937b-ac31f8407faa admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:09.645076 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fba41-340c-4510-8534-b5972e66737a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:09.649692 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546f9b9-b65b-42d7-aaeb-2d5b4e2f32cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:09.650572 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546f9b9-b65b-42d7-aaeb-2d5b4e2f32cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:09.650851 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546f9b9-b65b-42d7-aaeb-2d5b4e2f32cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:09.651431 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546f9b9-b65b-42d7-aaeb-2d5b4e2f32cd admin admin] PATH_INFO: `/v3/projects/51092f4cb26943949f1a86770ef3ca69` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:09.652315 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546f9b9-b65b-42d7-aaeb-2d5b4e2f32cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=51092f4cb26943949f1a86770ef3ca69)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:09.654867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546f9b9-b65b-42d7-aaeb-2d5b4e2f32cd admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:09.668522 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:09.678195 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c4d85-c8b3-4a1e-a81f-9892543a319d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:09.679000 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c4d85-c8b3-4a1e-a81f-9892543a319d service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:09.679478 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c4d85-c8b3-4a1e-a81f-9892543a319d service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:09.679760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c4d85-c8b3-4a1e-a81f-9892543a319d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:09.682073 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-020c4d85-c8b3-4a1e-a81f-9892543a319d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:09.689239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:09.695372 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c4d85-c8b3-4a1e-a81f-9892543a319d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:09.697035 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c4d85-c8b3-4a1e-a81f-9892543a319d service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:09.704323 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1546f9b9-b65b-42d7-aaeb-2d5b4e2f32cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51092f4cb26943949f1a86770ef3ca69', 'request_id': 'req-1546f9b9-b65b-42d7-aaeb-2d5b4e2f32cd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:09.707401 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1268/2566] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:09.712570 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1546f9b9-b65b-42d7-aaeb-2d5b4e2f32cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51092f4cb26943949f1a86770ef3ca69', 'request_id': 'req-1546f9b9-b65b-42d7-aaeb-2d5b4e2f32cd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:09.718900 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1546f9b9-b65b-42d7-aaeb-2d5b4e2f32cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51092f4cb26943949f1a86770ef3ca69', 'request_id': 'req-1546f9b9-b65b-42d7-aaeb-2d5b4e2f32cd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:09.730155 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1546f9b9-b65b-42d7-aaeb-2d5b4e2f32cd admin admin] The token cache is being invalidate because project 51092f4cb26943949f1a86770ef3ca69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:09.730438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1546f9b9-b65b-42d7-aaeb-2d5b4e2f32cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:09.731074 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1546f9b9-b65b-42d7-aaeb-2d5b4e2f32cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:09.733194 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1299/2567] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:09 2022] DELETE /identity/v3/projects/51092f4cb26943949f1a86770ef3ca69 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:52:09.738299 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6efd34-8499-4fa0-9de3-506ad47fabc6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:09.738661 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6efd34-8499-4fa0-9de3-506ad47fabc6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:09.739010 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6efd34-8499-4fa0-9de3-506ad47fabc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:09.757363 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8f6efd34-8499-4fa0-9de3-506ad47fabc6 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:09.758656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8f6efd34-8499-4fa0-9de3-506ad47fabc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:09.819914 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1269/2568] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:09.885134 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f65a4-4983-4930-bf36-4d667697dfc4 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:09.885523 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f65a4-4983-4930-bf36-4d667697dfc4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:09.885801 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f65a4-4983-4930-bf36-4d667697dfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:09.905294 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-313f65a4-4983-4930-bf36-4d667697dfc4 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:09.906498 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-313f65a4-4983-4930-bf36-4d667697dfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:09.914315 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1300/2569] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:09.918570 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6efd34-8499-4fa0-9de3-506ad47fabc6 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:09.928308 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6efd34-8499-4fa0-9de3-506ad47fabc6 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:09.933035 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b65f5-7ddd-4a45-a05e-0d0ae27f5f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:09.933715 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b65f5-7ddd-4a45-a05e-0d0ae27f5f40 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:09.934001 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b65f5-7ddd-4a45-a05e-0d0ae27f5f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:09.934280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b65f5-7ddd-4a45-a05e-0d0ae27f5f40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:09.935008 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b65f5-7ddd-4a45-a05e-0d0ae27f5f40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:52:09.935318 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b65f5-7ddd-4a45-a05e-0d0ae27f5f40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:09.937476 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b65f5-7ddd-4a45-a05e-0d0ae27f5f40 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:09.953052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1270/2570] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:52:09.954178 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f65a4-4983-4930-bf36-4d667697dfc4 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:09.963370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f65a4-4983-4930-bf36-4d667697dfc4 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:09.968066 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e212c3-a343-4d53-b78a-1b8a80b46a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:09.968738 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e212c3-a343-4d53-b78a-1b8a80b46a4a admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:09.969024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e212c3-a343-4d53-b78a-1b8a80b46a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:09.969307 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e212c3-a343-4d53-b78a-1b8a80b46a4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:09.969997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e212c3-a343-4d53-b78a-1b8a80b46a4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:09.971907 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e212c3-a343-4d53-b78a-1b8a80b46a4a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:09.998963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1301/2571] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:09 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:10.003175 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b65f5-7ddd-4a45-a05e-0d0ae27f5f40 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:10.014610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b65f5-7ddd-4a45-a05e-0d0ae27f5f40 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:10.070917 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f3f8f-c041-427f-a71b-1962c9467807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:10.071574 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f3f8f-c041-427f-a71b-1962c9467807 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:10.071856 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f3f8f-c041-427f-a71b-1962c9467807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:10.072132 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f3f8f-c041-427f-a71b-1962c9467807 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:10.072844 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f3f8f-c041-427f-a71b-1962c9467807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:10.074764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f3f8f-c041-427f-a71b-1962c9467807 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:10.095139 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1271/2572] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:10 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:10.099481 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e212c3-a343-4d53-b78a-1b8a80b46a4a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:10.109993 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e212c3-a343-4d53-b78a-1b8a80b46a4a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:10.114523 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559ad94-73cb-48ef-ab0d-ce4e415dd483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:10.115245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559ad94-73cb-48ef-ab0d-ce4e415dd483 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:10.115527 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559ad94-73cb-48ef-ab0d-ce4e415dd483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:10.115798 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559ad94-73cb-48ef-ab0d-ce4e415dd483 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:10.116543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559ad94-73cb-48ef-ab0d-ce4e415dd483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:10.118243 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559ad94-73cb-48ef-ab0d-ce4e415dd483 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:10.129250 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1302/2573] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:52:10.133373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f3f8f-c041-427f-a71b-1962c9467807 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:10.144579 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f3f8f-c041-427f-a71b-1962c9467807 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:10.149139 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201ce81-6646-449f-96f5-b87d45b3096e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:10.149799 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201ce81-6646-449f-96f5-b87d45b3096e admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:10.150089 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201ce81-6646-449f-96f5-b87d45b3096e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:10.150373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201ce81-6646-449f-96f5-b87d45b3096e admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:10.151128 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201ce81-6646-449f-96f5-b87d45b3096e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:10.152787 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201ce81-6646-449f-96f5-b87d45b3096e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:10.163139 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1272/2574] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:10.167576 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559ad94-73cb-48ef-ab0d-ce4e415dd483 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:10.177746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559ad94-73cb-48ef-ab0d-ce4e415dd483 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:10.182285 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55caffa-5cc5-40c6-aaca-92b8757373dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:10.183158 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55caffa-5cc5-40c6-aaca-92b8757373dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:10.183441 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55caffa-5cc5-40c6-aaca-92b8757373dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:10.183717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55caffa-5cc5-40c6-aaca-92b8757373dc admin admin] PATH_INFO: `/v3/projects/1c6ece898cf24ae8aec78ff612cd01a4/users/963fee1261a9484e9f82dd584a3538f7/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:10.198871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55caffa-5cc5-40c6-aaca-92b8757373dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6ece898cf24ae8aec78ff612cd01a4, user_id=963fee1261a9484e9f82dd584a3538f7, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:10.202246 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55caffa-5cc5-40c6-aaca-92b8757373dc admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:10.216224 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1303/2575] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:10 2022] PUT /identity/v3/projects/1c6ece898cf24ae8aec78ff612cd01a4/users/963fee1261a9484e9f82dd584a3538f7/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:10.226549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276059e-d29f-423f-9d1d-1b262f51ba9d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:10.226856 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276059e-d29f-423f-9d1d-1b262f51ba9d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:10.227184 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276059e-d29f-423f-9d1d-1b262f51ba9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:10.255717 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-5276059e-d29f-423f-9d1d-1b262f51ba9d None None] MFA Rules not processed for user `963fee1261a9484e9f82dd584a3538f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:10.256650 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5276059e-d29f-423f-9d1d-1b262f51ba9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:10.301311 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:10.327058 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1273/2576] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:10.337926 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55caffa-5cc5-40c6-aaca-92b8757373dc admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:10.339634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d55caffa-5cc5-40c6-aaca-92b8757373dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:10.397169 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55caffa-5cc5-40c6-aaca-92b8757373dc admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:10.400750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a9050-fcb8-45b1-a6c7-9783c43a35b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:10.401393 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a9050-fcb8-45b1-a6c7-9783c43a35b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:10.401681 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a9050-fcb8-45b1-a6c7-9783c43a35b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:10.401960 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a9050-fcb8-45b1-a6c7-9783c43a35b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:10.410947 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a9050-fcb8-45b1-a6c7-9783c43a35b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:10.412373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a9050-fcb8-45b1-a6c7-9783c43a35b9 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:10.421817 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1304/2577] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:12.947948 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276059e-d29f-423f-9d1d-1b262f51ba9d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:12.949521 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5276059e-d29f-423f-9d1d-1b262f51ba9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:13.014606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276059e-d29f-423f-9d1d-1b262f51ba9d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:13.019097 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f8308-6643-48a1-88d3-a8c3657cea6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:13.019957 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f8308-6643-48a1-88d3-a8c3657cea6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:13.020245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f8308-6643-48a1-88d3-a8c3657cea6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:13.020549 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f8308-6643-48a1-88d3-a8c3657cea6d admin admin] PATH_INFO: `/v3/users/f5003e984d58440a80d98405d187eab0` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:13.022041 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f8308-6643-48a1-88d3-a8c3657cea6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5003e984d58440a80d98405d187eab0)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:13.023987 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f8308-6643-48a1-88d3-a8c3657cea6d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:13.072233 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-196f8308-6643-48a1-88d3-a8c3657cea6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5003e984d58440a80d98405d187eab0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:13.072830 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-196f8308-6643-48a1-88d3-a8c3657cea6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5003e984d58440a80d98405d187eab0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:13.080615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-196f8308-6643-48a1-88d3-a8c3657cea6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5003e984d58440a80d98405d187eab0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:13.081386 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-196f8308-6643-48a1-88d3-a8c3657cea6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5003e984d58440a80d98405d187eab0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:13.089834 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-196f8308-6643-48a1-88d3-a8c3657cea6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5003e984d58440a80d98405d187eab0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:13.107579 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1274/2578] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:12 2022] DELETE /identity/v3/users/f5003e984d58440a80d98405d187eab0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:52:13.289839 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a9050-fcb8-45b1-a6c7-9783c43a35b9 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:13.302646 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a9050-fcb8-45b1-a6c7-9783c43a35b9 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:13.363718 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca1838-f341-4ec0-baa8-38403cb9daee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:13.364619 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca1838-f341-4ec0-baa8-38403cb9daee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:13.364927 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca1838-f341-4ec0-baa8-38403cb9daee admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:13.365162 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca1838-f341-4ec0-baa8-38403cb9daee admin admin] PATH_INFO: `/v3/projects/2346c16770124c9a86bc6e30880f8bde` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:13.366352 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca1838-f341-4ec0-baa8-38403cb9daee admin admin] RBAC: Authorizing `identity:delete_project(project_id=2346c16770124c9a86bc6e30880f8bde)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:13.368269 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca1838-f341-4ec0-baa8-38403cb9daee admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:13.369781 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:13.418292 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b2ca1838-f341-4ec0-baa8-38403cb9daee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2346c16770124c9a86bc6e30880f8bde', 'request_id': 'req-b2ca1838-f341-4ec0-baa8-38403cb9daee'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:13.426711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b2ca1838-f341-4ec0-baa8-38403cb9daee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2346c16770124c9a86bc6e30880f8bde', 'request_id': 'req-b2ca1838-f341-4ec0-baa8-38403cb9daee'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:13.433802 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b2ca1838-f341-4ec0-baa8-38403cb9daee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2346c16770124c9a86bc6e30880f8bde', 'request_id': 'req-b2ca1838-f341-4ec0-baa8-38403cb9daee'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:13.444526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b2ca1838-f341-4ec0-baa8-38403cb9daee admin admin] The token cache is being invalidate because project 2346c16770124c9a86bc6e30880f8bde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:13.444827 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b2ca1838-f341-4ec0-baa8-38403cb9daee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:13.445462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b2ca1838-f341-4ec0-baa8-38403cb9daee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:13.447006 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1305/2579] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:13 2022] DELETE /identity/v3/projects/2346c16770124c9a86bc6e30880f8bde => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:13.451960 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbaa32-1510-4a9b-9a55-1a857b81b6b8 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:13.452532 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbaa32-1510-4a9b-9a55-1a857b81b6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:13.452532 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbaa32-1510-4a9b-9a55-1a857b81b6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:13.470719 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b8bbaa32-1510-4a9b-9a55-1a857b81b6b8 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:13.472031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b8bbaa32-1510-4a9b-9a55-1a857b81b6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:13.538500 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1275/2580] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:13.547499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecaaba-7f5e-4a5d-8052-8691b8cf04e9 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:13.547856 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecaaba-7f5e-4a5d-8052-8691b8cf04e9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:13.548129 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecaaba-7f5e-4a5d-8052-8691b8cf04e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:13.571005 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-07ecaaba-7f5e-4a5d-8052-8691b8cf04e9 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:13.572229 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-07ecaaba-7f5e-4a5d-8052-8691b8cf04e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:13.582007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1306/2581] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:13.589421 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbaa32-1510-4a9b-9a55-1a857b81b6b8 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:13.594564 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:13.602799 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbaa32-1510-4a9b-9a55-1a857b81b6b8 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:13.609938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32197c-fae2-4b33-a48f-216f8ece473a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:13.610640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32197c-fae2-4b33-a48f-216f8ece473a admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:13.610971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32197c-fae2-4b33-a48f-216f8ece473a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:13.611379 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32197c-fae2-4b33-a48f-216f8ece473a admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:13.612113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32197c-fae2-4b33-a48f-216f8ece473a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:52:13.612422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32197c-fae2-4b33-a48f-216f8ece473a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:13.614137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32197c-fae2-4b33-a48f-216f8ece473a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:13.628402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1276/2582] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:52:13.632708 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecaaba-7f5e-4a5d-8052-8691b8cf04e9 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:13.642561 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecaaba-7f5e-4a5d-8052-8691b8cf04e9 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:13.648082 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e850168-b51b-49d9-9e4e-fc0318ad0b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:13.648784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e850168-b51b-49d9-9e4e-fc0318ad0b8c admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:13.649067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e850168-b51b-49d9-9e4e-fc0318ad0b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:13.649347 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e850168-b51b-49d9-9e4e-fc0318ad0b8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:13.651162 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e850168-b51b-49d9-9e4e-fc0318ad0b8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:13.656786 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e850168-b51b-49d9-9e4e-fc0318ad0b8c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:13.685391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1307/2583] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:13 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:13.689885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32197c-fae2-4b33-a48f-216f8ece473a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:13.700034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32197c-fae2-4b33-a48f-216f8ece473a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:13.772595 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2820354-d642-4820-aabd-a1017cafcab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:13.773271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2820354-d642-4820-aabd-a1017cafcab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:13.773553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2820354-d642-4820-aabd-a1017cafcab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:13.774025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2820354-d642-4820-aabd-a1017cafcab4 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:13.774774 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2820354-d642-4820-aabd-a1017cafcab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:13.776723 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2820354-d642-4820-aabd-a1017cafcab4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:13.797106 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1277/2584] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:13 2022] POST /identity/v3/users => generated 284 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:13.801423 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e850168-b51b-49d9-9e4e-fc0318ad0b8c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:13.811858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e850168-b51b-49d9-9e4e-fc0318ad0b8c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:13.816533 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a145bfb-5877-4627-bb41-a062ab39d6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:13.817195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a145bfb-5877-4627-bb41-a062ab39d6cf admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:13.817475 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a145bfb-5877-4627-bb41-a062ab39d6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:13.817775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a145bfb-5877-4627-bb41-a062ab39d6cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:13.818484 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a145bfb-5877-4627-bb41-a062ab39d6cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:13.820060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a145bfb-5877-4627-bb41-a062ab39d6cf admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:13.830414 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1308/2585] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:13.834035 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2820354-d642-4820-aabd-a1017cafcab4 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:13.844149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2820354-d642-4820-aabd-a1017cafcab4 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:13.848836 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a4d76-9a4b-4463-9515-2033a2178995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:13.849473 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a4d76-9a4b-4463-9515-2033a2178995 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:13.849755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a4d76-9a4b-4463-9515-2033a2178995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:13.850029 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a4d76-9a4b-4463-9515-2033a2178995 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:13.850769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a4d76-9a4b-4463-9515-2033a2178995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:13.852352 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a4d76-9a4b-4463-9515-2033a2178995 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:13.862998 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1278/2586] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:13.867035 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a145bfb-5877-4627-bb41-a062ab39d6cf admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:13.876912 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a145bfb-5877-4627-bb41-a062ab39d6cf admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:13.881640 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f36aa-d6ff-4f01-ba46-cc1ad871873d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:13.882507 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f36aa-d6ff-4f01-ba46-cc1ad871873d admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:13.882787 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f36aa-d6ff-4f01-ba46-cc1ad871873d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:13.883061 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f36aa-d6ff-4f01-ba46-cc1ad871873d admin admin] PATH_INFO: `/v3/projects/a2ffe26fa0694820aa7fc09b66d569df/users/c554f8be7c534d6f9de81166280f7cd6/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:13.897266 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f36aa-d6ff-4f01-ba46-cc1ad871873d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ffe26fa0694820aa7fc09b66d569df, user_id=c554f8be7c534d6f9de81166280f7cd6, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:13.899914 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f36aa-d6ff-4f01-ba46-cc1ad871873d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:13.913244 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1309/2587] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:13 2022] PUT /identity/v3/projects/a2ffe26fa0694820aa7fc09b66d569df/users/c554f8be7c534d6f9de81166280f7cd6/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:13.924694 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad3c5b-0f4b-425d-b5f9-411a3c4e0e2b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:13.924924 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad3c5b-0f4b-425d-b5f9-411a3c4e0e2b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:13.925204 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad3c5b-0f4b-425d-b5f9-411a3c4e0e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:13.950712 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a8ad3c5b-0f4b-425d-b5f9-411a3c4e0e2b None None] MFA Rules not processed for user `c554f8be7c534d6f9de81166280f7cd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:13.951893 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a8ad3c5b-0f4b-425d-b5f9-411a3c4e0e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:14.015536 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1279/2588] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:13 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:14.019909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f36aa-d6ff-4f01-ba46-cc1ad871873d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:14.080751 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f36aa-d6ff-4f01-ba46-cc1ad871873d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:14.085274 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a2da9-6501-49a0-a96c-cc117221785e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:14.085914 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a2da9-6501-49a0-a96c-cc117221785e admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:14.086194 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a2da9-6501-49a0-a96c-cc117221785e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:14.086467 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a2da9-6501-49a0-a96c-cc117221785e admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:14.087152 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a2da9-6501-49a0-a96c-cc117221785e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:14.089082 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a2da9-6501-49a0-a96c-cc117221785e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:14.113560 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1310/2589] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:14 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:14.117458 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad3c5b-0f4b-425d-b5f9-411a3c4e0e2b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:14.127883 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad3c5b-0f4b-425d-b5f9-411a3c4e0e2b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:14.178133 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:14.185271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e205641-75cc-4f7e-8802-41e62ca8bc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:14.185934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e205641-75cc-4f7e-8802-41e62ca8bc7c admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:14.186219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e205641-75cc-4f7e-8802-41e62ca8bc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:14.186497 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e205641-75cc-4f7e-8802-41e62ca8bc7c admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:14.187191 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e205641-75cc-4f7e-8802-41e62ca8bc7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:14.189154 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e205641-75cc-4f7e-8802-41e62ca8bc7c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:14.211858 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1280/2590] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:14 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:52:14.213086 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a2da9-6501-49a0-a96c-cc117221785e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:14.223842 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a2da9-6501-49a0-a96c-cc117221785e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:14.228477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537e601-9cd1-413c-b847-c26d62f2d34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:14.229168 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537e601-9cd1-413c-b847-c26d62f2d34e admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:14.229454 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537e601-9cd1-413c-b847-c26d62f2d34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:14.229736 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537e601-9cd1-413c-b847-c26d62f2d34e admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:14.230452 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4537e601-9cd1-413c-b847-c26d62f2d34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:14.232050 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4537e601-9cd1-413c-b847-c26d62f2d34e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:14.238376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:14.245489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1311/2591] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:14.249575 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e205641-75cc-4f7e-8802-41e62ca8bc7c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:14.260597 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e205641-75cc-4f7e-8802-41e62ca8bc7c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:14.266067 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4293a2d-7a10-464c-965e-50c04f33ea74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:14.267080 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4293a2d-7a10-464c-965e-50c04f33ea74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:14.267365 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4293a2d-7a10-464c-965e-50c04f33ea74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:14.267643 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4293a2d-7a10-464c-965e-50c04f33ea74 admin admin] PATH_INFO: `/v3/projects/1109d68b2e9647a98a68b07151c3d283/users/ac43cddf4e8b46a286531e6b52236042/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:14.283675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4293a2d-7a10-464c-965e-50c04f33ea74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1109d68b2e9647a98a68b07151c3d283, user_id=ac43cddf4e8b46a286531e6b52236042, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:14.286494 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4293a2d-7a10-464c-965e-50c04f33ea74 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:14.300690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1281/2592] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:14 2022] PUT /identity/v3/projects/1109d68b2e9647a98a68b07151c3d283/users/ac43cddf4e8b46a286531e6b52236042/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:52:14.304678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537e601-9cd1-413c-b847-c26d62f2d34e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:14.314974 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537e601-9cd1-413c-b847-c26d62f2d34e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:14.371604 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7b1d7-6044-437c-b024-156ad411a1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:14.372276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7b1d7-6044-437c-b024-156ad411a1fd admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:14.372586 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7b1d7-6044-437c-b024-156ad411a1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:14.372869 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7b1d7-6044-437c-b024-156ad411a1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:14.373625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb7b1d7-6044-437c-b024-156ad411a1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:14.375220 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb7b1d7-6044-437c-b024-156ad411a1fd admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:14.385617 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1312/2593] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:14.390292 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4293a2d-7a10-464c-965e-50c04f33ea74 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:14.400847 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4293a2d-7a10-464c-965e-50c04f33ea74 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:14.406145 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae19ed5-3ff3-44ed-89c8-089fdc237b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:14.407048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae19ed5-3ff3-44ed-89c8-089fdc237b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:14.407332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae19ed5-3ff3-44ed-89c8-089fdc237b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:14.407611 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae19ed5-3ff3-44ed-89c8-089fdc237b97 admin admin] PATH_INFO: `/v3/projects/1109d68b2e9647a98a68b07151c3d283/users/ac43cddf4e8b46a286531e6b52236042/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:14.409651 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae19ed5-3ff3-44ed-89c8-089fdc237b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1109d68b2e9647a98a68b07151c3d283, user_id=ac43cddf4e8b46a286531e6b52236042, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:14.412322 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae19ed5-3ff3-44ed-89c8-089fdc237b97 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:14.422453 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1282/2594] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:14 2022] PUT /identity/v3/projects/1109d68b2e9647a98a68b07151c3d283/users/ac43cddf4e8b46a286531e6b52236042/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:52:14.432219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff9800-0cbb-4a4c-8dde-40477228612c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:14.432459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff9800-0cbb-4a4c-8dde-40477228612c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:14.432784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff9800-0cbb-4a4c-8dde-40477228612c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:14.459162 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ebff9800-0cbb-4a4c-8dde-40477228612c None None] MFA Rules not processed for user `ac43cddf4e8b46a286531e6b52236042`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:14.460355 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ebff9800-0cbb-4a4c-8dde-40477228612c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:14.528526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1313/2595] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:14 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:14.539560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae19ed5-3ff3-44ed-89c8-089fdc237b97 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:14.541269 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9ae19ed5-3ff3-44ed-89c8-089fdc237b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:14.598118 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae19ed5-3ff3-44ed-89c8-089fdc237b97 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:14.601721 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed1969-f01a-4202-a45f-dae9425550f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:14.602348 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed1969-f01a-4202-a45f-dae9425550f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:14.602631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed1969-f01a-4202-a45f-dae9425550f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:14.602912 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed1969-f01a-4202-a45f-dae9425550f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:14.612014 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed1969-f01a-4202-a45f-dae9425550f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:14.613470 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed1969-f01a-4202-a45f-dae9425550f9 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:14.622765 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1283/2596] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:16.051963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff9800-0cbb-4a4c-8dde-40477228612c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:16.122660 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff9800-0cbb-4a4c-8dde-40477228612c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:16.127421 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f19d4-4e1c-4b0c-9400-cf26df367d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:16.128422 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f19d4-4e1c-4b0c-9400-cf26df367d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:16.128826 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f19d4-4e1c-4b0c-9400-cf26df367d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:16.129177 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f19d4-4e1c-4b0c-9400-cf26df367d77 admin admin] PATH_INFO: `/v3/users/c554f8be7c534d6f9de81166280f7cd6` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:16.130575 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f19d4-4e1c-4b0c-9400-cf26df367d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c554f8be7c534d6f9de81166280f7cd6)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:16.133054 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f19d4-4e1c-4b0c-9400-cf26df367d77 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:16.166625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:16.206224 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-297f19d4-4e1c-4b0c-9400-cf26df367d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c554f8be7c534d6f9de81166280f7cd6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:16.220144 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-297f19d4-4e1c-4b0c-9400-cf26df367d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c554f8be7c534d6f9de81166280f7cd6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:16.220335 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-297f19d4-4e1c-4b0c-9400-cf26df367d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c554f8be7c534d6f9de81166280f7cd6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:16.228153 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-297f19d4-4e1c-4b0c-9400-cf26df367d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c554f8be7c534d6f9de81166280f7cd6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:16.229048 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-297f19d4-4e1c-4b0c-9400-cf26df367d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c554f8be7c534d6f9de81166280f7cd6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:16.244003 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1314/2597] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:16 2022] DELETE /identity/v3/users/c554f8be7c534d6f9de81166280f7cd6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:16.248848 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d280d7-cadf-4341-b060-736210b6c3a9 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:16.248848 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d280d7-cadf-4341-b060-736210b6c3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:16.249436 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d280d7-cadf-4341-b060-736210b6c3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:16.267659 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-33d280d7-cadf-4341-b060-736210b6c3a9 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:16.268911 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-33d280d7-cadf-4341-b060-736210b6c3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:16.330440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1284/2598] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:16.340233 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f19d4-4e1c-4b0c-9400-cf26df367d77 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:16.342372 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-297f19d4-4e1c-4b0c-9400-cf26df367d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:16.400962 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f19d4-4e1c-4b0c-9400-cf26df367d77 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:16.405252 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38665a7-831a-4d27-ac6d-a78e47218892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:16.405898 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38665a7-831a-4d27-ac6d-a78e47218892 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:16.406180 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38665a7-831a-4d27-ac6d-a78e47218892 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:16.406456 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38665a7-831a-4d27-ac6d-a78e47218892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:16.415732 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38665a7-831a-4d27-ac6d-a78e47218892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:16.417195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38665a7-831a-4d27-ac6d-a78e47218892 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:16.426764 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1315/2599] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:52:16.729920 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d280d7-cadf-4341-b060-736210b6c3a9 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:16.731900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-33d280d7-cadf-4341-b060-736210b6c3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:16.745175 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d280d7-cadf-4341-b060-736210b6c3a9 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:16.751183 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f26297-26e9-444d-a859-87111d5dd93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:16.752305 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f26297-26e9-444d-a859-87111d5dd93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:16.752839 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f26297-26e9-444d-a859-87111d5dd93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:16.753347 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f26297-26e9-444d-a859-87111d5dd93d admin admin] PATH_INFO: `/v3/projects/a2ffe26fa0694820aa7fc09b66d569df` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:16.755525 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f26297-26e9-444d-a859-87111d5dd93d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2ffe26fa0694820aa7fc09b66d569df)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:16.757820 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f26297-26e9-444d-a859-87111d5dd93d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:16.829159 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:16.830818 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-09f26297-26e9-444d-a859-87111d5dd93d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2ffe26fa0694820aa7fc09b66d569df', 'request_id': 'req-09f26297-26e9-444d-a859-87111d5dd93d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:16.844622 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-09f26297-26e9-444d-a859-87111d5dd93d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2ffe26fa0694820aa7fc09b66d569df', 'request_id': 'req-09f26297-26e9-444d-a859-87111d5dd93d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:16.852245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-09f26297-26e9-444d-a859-87111d5dd93d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2ffe26fa0694820aa7fc09b66d569df', 'request_id': 'req-09f26297-26e9-444d-a859-87111d5dd93d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:16.866019 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-09f26297-26e9-444d-a859-87111d5dd93d admin admin] The token cache is being invalidate because project a2ffe26fa0694820aa7fc09b66d569df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:16.866565 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-09f26297-26e9-444d-a859-87111d5dd93d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:16.867963 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-09f26297-26e9-444d-a859-87111d5dd93d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:16.870024 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1285/2600] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:16 2022] DELETE /identity/v3/projects/a2ffe26fa0694820aa7fc09b66d569df => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:16.875171 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38665a7-831a-4d27-ac6d-a78e47218892 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:16.886798 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38665a7-831a-4d27-ac6d-a78e47218892 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:16.963295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953fb9b-690a-45e1-86ae-a2da51239915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:16.964439 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953fb9b-690a-45e1-86ae-a2da51239915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:16.965023 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953fb9b-690a-45e1-86ae-a2da51239915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:16.965023 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953fb9b-690a-45e1-86ae-a2da51239915 admin admin] PATH_INFO: `/v3/users/ac43cddf4e8b46a286531e6b52236042` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:16.966502 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953fb9b-690a-45e1-86ae-a2da51239915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac43cddf4e8b46a286531e6b52236042)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:16.970008 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953fb9b-690a-45e1-86ae-a2da51239915 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:17.031442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:17.035919 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7953fb9b-690a-45e1-86ae-a2da51239915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac43cddf4e8b46a286531e6b52236042'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:17.054409 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7953fb9b-690a-45e1-86ae-a2da51239915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac43cddf4e8b46a286531e6b52236042'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:17.055389 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7953fb9b-690a-45e1-86ae-a2da51239915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac43cddf4e8b46a286531e6b52236042'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:17.083662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7953fb9b-690a-45e1-86ae-a2da51239915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac43cddf4e8b46a286531e6b52236042'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:17.083662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-7953fb9b-690a-45e1-86ae-a2da51239915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac43cddf4e8b46a286531e6b52236042'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:17.096044 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1316/2601] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:16 2022] DELETE /identity/v3/users/ac43cddf4e8b46a286531e6b52236042 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:17.398367 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f26297-26e9-444d-a859-87111d5dd93d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:17.399861 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-09f26297-26e9-444d-a859-87111d5dd93d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:17.414470 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f26297-26e9-444d-a859-87111d5dd93d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:17.471255 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f031326-b3ec-432f-ae95-7b6f7e965772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:17.472137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f031326-b3ec-432f-ae95-7b6f7e965772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:17.472422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f031326-b3ec-432f-ae95-7b6f7e965772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:17.472730 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f031326-b3ec-432f-ae95-7b6f7e965772 admin admin] PATH_INFO: `/v3/projects/1109d68b2e9647a98a68b07151c3d283` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:17.473906 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f031326-b3ec-432f-ae95-7b6f7e965772 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1109d68b2e9647a98a68b07151c3d283)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:17.475835 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f031326-b3ec-432f-ae95-7b6f7e965772 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:17.523357 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0f031326-b3ec-432f-ae95-7b6f7e965772 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1109d68b2e9647a98a68b07151c3d283', 'request_id': 'req-0f031326-b3ec-432f-ae95-7b6f7e965772'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:17.530453 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0f031326-b3ec-432f-ae95-7b6f7e965772 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1109d68b2e9647a98a68b07151c3d283', 'request_id': 'req-0f031326-b3ec-432f-ae95-7b6f7e965772'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:17.536047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0f031326-b3ec-432f-ae95-7b6f7e965772 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1109d68b2e9647a98a68b07151c3d283', 'request_id': 'req-0f031326-b3ec-432f-ae95-7b6f7e965772'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:17.546760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0f031326-b3ec-432f-ae95-7b6f7e965772 admin admin] The token cache is being invalidate because project 1109d68b2e9647a98a68b07151c3d283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:17.547040 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0f031326-b3ec-432f-ae95-7b6f7e965772 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:17.547653 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0f031326-b3ec-432f-ae95-7b6f7e965772 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:17.549201 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1286/2602] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:17 2022] DELETE /identity/v3/projects/1109d68b2e9647a98a68b07151c3d283 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:17.554103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f942cf-b924-4759-871e-86bb36fe7164 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:17.554395 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f942cf-b924-4759-871e-86bb36fe7164 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:17.554678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f942cf-b924-4759-871e-86bb36fe7164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:17.572265 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-92f942cf-b924-4759-871e-86bb36fe7164 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:17.573509 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-92f942cf-b924-4759-871e-86bb36fe7164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:17.632265 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1317/2603] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:17.640905 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39e499-feaa-4fbf-8f9e-b0c91506d85f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:17.641204 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39e499-feaa-4fbf-8f9e-b0c91506d85f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:17.641479 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39e499-feaa-4fbf-8f9e-b0c91506d85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:17.659291 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4f39e499-feaa-4fbf-8f9e-b0c91506d85f None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:17.660481 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4f39e499-feaa-4fbf-8f9e-b0c91506d85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:17.668217 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1287/2604] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:17.672326 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f942cf-b924-4759-871e-86bb36fe7164 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:17.682011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f942cf-b924-4759-871e-86bb36fe7164 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:17.687489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b68a3-9e09-43e8-aceb-0bf7db71d329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:17.688336 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b68a3-9e09-43e8-aceb-0bf7db71d329 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:17.688648 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b68a3-9e09-43e8-aceb-0bf7db71d329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:17.688926 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b68a3-9e09-43e8-aceb-0bf7db71d329 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:17.689642 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b68a3-9e09-43e8-aceb-0bf7db71d329 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:52:17.689978 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b68a3-9e09-43e8-aceb-0bf7db71d329 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:17.691821 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b68a3-9e09-43e8-aceb-0bf7db71d329 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:17.705002 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1318/2605] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:52:17.709483 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39e499-feaa-4fbf-8f9e-b0c91506d85f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:17.719330 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39e499-feaa-4fbf-8f9e-b0c91506d85f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:17.723909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c64746-d65d-436c-94b1-55bb9315d2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:17.724585 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c64746-d65d-436c-94b1-55bb9315d2a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:17.724872 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c64746-d65d-436c-94b1-55bb9315d2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:17.725152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c64746-d65d-436c-94b1-55bb9315d2a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:17.725907 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c64746-d65d-436c-94b1-55bb9315d2a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:17.728395 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c64746-d65d-436c-94b1-55bb9315d2a7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:17.753241 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1288/2606] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:17 2022] POST /identity/v3/projects => generated 393 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:17.757268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b68a3-9e09-43e8-aceb-0bf7db71d329 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:17.767594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b68a3-9e09-43e8-aceb-0bf7db71d329 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:17.824414 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda76dcc-fff9-46f8-8e3c-b5d5976c5cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:17.825029 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda76dcc-fff9-46f8-8e3c-b5d5976c5cda admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:17.825309 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda76dcc-fff9-46f8-8e3c-b5d5976c5cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:17.825573 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda76dcc-fff9-46f8-8e3c-b5d5976c5cda admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:17.826342 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda76dcc-fff9-46f8-8e3c-b5d5976c5cda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:17.828246 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda76dcc-fff9-46f8-8e3c-b5d5976c5cda admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:17.848908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1319/2607] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:17 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:52:17.852900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c64746-d65d-436c-94b1-55bb9315d2a7 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:17.863887 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c64746-d65d-436c-94b1-55bb9315d2a7 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:17.868627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4babc7d-1602-42dd-97f7-f9f7ad1d437f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:17.869300 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4babc7d-1602-42dd-97f7-f9f7ad1d437f admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:17.869578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4babc7d-1602-42dd-97f7-f9f7ad1d437f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:17.869851 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4babc7d-1602-42dd-97f7-f9f7ad1d437f admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:17.870584 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4babc7d-1602-42dd-97f7-f9f7ad1d437f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:17.872240 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4babc7d-1602-42dd-97f7-f9f7ad1d437f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:17.883949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1289/2608] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:17.888008 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda76dcc-fff9-46f8-8e3c-b5d5976c5cda admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:17.898033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda76dcc-fff9-46f8-8e3c-b5d5976c5cda admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:17.903011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0beb7-ef57-4066-b144-ecb0e391be81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:17.903664 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0beb7-ef57-4066-b144-ecb0e391be81 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:17.903950 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0beb7-ef57-4066-b144-ecb0e391be81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:17.904227 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0beb7-ef57-4066-b144-ecb0e391be81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:17.904986 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0beb7-ef57-4066-b144-ecb0e391be81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:17.906573 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0beb7-ef57-4066-b144-ecb0e391be81 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:17.916748 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1320/2609] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:17.921121 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4babc7d-1602-42dd-97f7-f9f7ad1d437f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:17.930966 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4babc7d-1602-42dd-97f7-f9f7ad1d437f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:17.936244 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4829bf4-14fa-4cb9-9eb2-b7bc179c9fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:17.937142 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4829bf4-14fa-4cb9-9eb2-b7bc179c9fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:17.937426 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4829bf4-14fa-4cb9-9eb2-b7bc179c9fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:17.937703 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4829bf4-14fa-4cb9-9eb2-b7bc179c9fe9 admin admin] PATH_INFO: `/v3/projects/74d0f70f0fd94ebb86970a3cdb532b4b/users/9eef050f7afa4f85bd805d698a22ca1b/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:17.951981 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4829bf4-14fa-4cb9-9eb2-b7bc179c9fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74d0f70f0fd94ebb86970a3cdb532b4b, user_id=9eef050f7afa4f85bd805d698a22ca1b, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:17.954670 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4829bf4-14fa-4cb9-9eb2-b7bc179c9fe9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:17.967846 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1290/2610] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:17 2022] PUT /identity/v3/projects/74d0f70f0fd94ebb86970a3cdb532b4b/users/9eef050f7afa4f85bd805d698a22ca1b/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:17.979200 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f2a44-89cb-4280-b473-846ab1107cdb None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:17.979491 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f2a44-89cb-4280-b473-846ab1107cdb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:17.979770 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f2a44-89cb-4280-b473-846ab1107cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:18.007454 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-734f2a44-89cb-4280-b473-846ab1107cdb None None] MFA Rules not processed for user `9eef050f7afa4f85bd805d698a22ca1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:18.008722 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-734f2a44-89cb-4280-b473-846ab1107cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:18.024841 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:18.072754 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1321/2611] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:18.077224 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4829bf4-14fa-4cb9-9eb2-b7bc179c9fe9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:18.081670 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:18.143337 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4829bf4-14fa-4cb9-9eb2-b7bc179c9fe9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:18.149172 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23676ba-bb14-44b4-9dc3-e8cfa4baa967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:18.149827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23676ba-bb14-44b4-9dc3-e8cfa4baa967 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:18.150108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23676ba-bb14-44b4-9dc3-e8cfa4baa967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:18.150385 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23676ba-bb14-44b4-9dc3-e8cfa4baa967 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:18.151060 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23676ba-bb14-44b4-9dc3-e8cfa4baa967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:18.152994 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23676ba-bb14-44b4-9dc3-e8cfa4baa967 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:18.178131 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1291/2612] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:18 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:18.182125 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f2a44-89cb-4280-b473-846ab1107cdb None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:18.193287 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f2a44-89cb-4280-b473-846ab1107cdb None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:18.255316 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63693b0d-2ef7-4c69-8d63-6a3875e422d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:18.256608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63693b0d-2ef7-4c69-8d63-6a3875e422d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:18.257197 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63693b0d-2ef7-4c69-8d63-6a3875e422d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:18.257632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63693b0d-2ef7-4c69-8d63-6a3875e422d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:18.258625 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63693b0d-2ef7-4c69-8d63-6a3875e422d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:18.262333 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63693b0d-2ef7-4c69-8d63-6a3875e422d6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:18.288075 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1322/2613] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:18 2022] POST /identity/v3/users => generated 303 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:52:18.291675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23676ba-bb14-44b4-9dc3-e8cfa4baa967 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:18.303782 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23676ba-bb14-44b4-9dc3-e8cfa4baa967 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:18.309599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9e486-6f5c-4c0f-8a41-263ea23e180c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:18.310270 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9e486-6f5c-4c0f-8a41-263ea23e180c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:18.311082 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9e486-6f5c-4c0f-8a41-263ea23e180c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:18.311364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9e486-6f5c-4c0f-8a41-263ea23e180c admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:18.312094 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9e486-6f5c-4c0f-8a41-263ea23e180c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:18.314006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9e486-6f5c-4c0f-8a41-263ea23e180c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:18.332320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1292/2614] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:18.334103 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63693b0d-2ef7-4c69-8d63-6a3875e422d6 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:18.345838 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63693b0d-2ef7-4c69-8d63-6a3875e422d6 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:18.351271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb124291-9d1a-4952-b952-d76426cde1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:18.352262 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb124291-9d1a-4952-b952-d76426cde1f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:18.352703 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb124291-9d1a-4952-b952-d76426cde1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:18.353022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb124291-9d1a-4952-b952-d76426cde1f1 admin admin] PATH_INFO: `/v3/projects/27d6b5ba67824db082b141eab3840187/users/597eae4732c9498dae845cb3d0e57b76/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:18.369695 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb124291-9d1a-4952-b952-d76426cde1f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d6b5ba67824db082b141eab3840187, user_id=597eae4732c9498dae845cb3d0e57b76, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:18.376093 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb124291-9d1a-4952-b952-d76426cde1f1 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:18.391663 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1323/2615] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:18 2022] PUT /identity/v3/projects/27d6b5ba67824db082b141eab3840187/users/597eae4732c9498dae845cb3d0e57b76/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:18.396273 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9e486-6f5c-4c0f-8a41-263ea23e180c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:18.407539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9e486-6f5c-4c0f-8a41-263ea23e180c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:18.484934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fa24a-e56f-4c35-a7a0-672be0c54759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:18.485609 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fa24a-e56f-4c35-a7a0-672be0c54759 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:18.485896 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fa24a-e56f-4c35-a7a0-672be0c54759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:18.486175 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fa24a-e56f-4c35-a7a0-672be0c54759 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:18.486908 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806fa24a-e56f-4c35-a7a0-672be0c54759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:18.488586 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806fa24a-e56f-4c35-a7a0-672be0c54759 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:18.502615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1293/2616] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:18.506749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb124291-9d1a-4952-b952-d76426cde1f1 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:18.524289 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb124291-9d1a-4952-b952-d76426cde1f1 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:18.530135 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38028b-e776-4fbc-9680-18bc67486e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:18.531049 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38028b-e776-4fbc-9680-18bc67486e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:18.531334 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38028b-e776-4fbc-9680-18bc67486e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:18.531616 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38028b-e776-4fbc-9680-18bc67486e96 admin admin] PATH_INFO: `/v3/projects/27d6b5ba67824db082b141eab3840187/users/597eae4732c9498dae845cb3d0e57b76/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:18.533722 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38028b-e776-4fbc-9680-18bc67486e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d6b5ba67824db082b141eab3840187, user_id=597eae4732c9498dae845cb3d0e57b76, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:18.536405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38028b-e776-4fbc-9680-18bc67486e96 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:18.548204 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1324/2617] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:18 2022] PUT /identity/v3/projects/27d6b5ba67824db082b141eab3840187/users/597eae4732c9498dae845cb3d0e57b76/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:18.558674 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746766a0-f7a9-46bc-b033-c422e0a6b1ad None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:18.558971 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746766a0-f7a9-46bc-b033-c422e0a6b1ad None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:18.559253 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746766a0-f7a9-46bc-b033-c422e0a6b1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:18.586877 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-746766a0-f7a9-46bc-b033-c422e0a6b1ad None None] MFA Rules not processed for user `597eae4732c9498dae845cb3d0e57b76`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:18.588114 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-746766a0-f7a9-46bc-b033-c422e0a6b1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:18.653206 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:18.659545 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1294/2618] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:18.670673 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38028b-e776-4fbc-9680-18bc67486e96 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:18.672404 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9d38028b-e776-4fbc-9680-18bc67486e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:18.729145 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38028b-e776-4fbc-9680-18bc67486e96 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:18.733305 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6721f9e-80ce-45b9-8f3d-42d2b8743a5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:18.733935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6721f9e-80ce-45b9-8f3d-42d2b8743a5b service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:18.734219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6721f9e-80ce-45b9-8f3d-42d2b8743a5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:18.734777 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6721f9e-80ce-45b9-8f3d-42d2b8743a5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:18.743710 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6721f9e-80ce-45b9-8f3d-42d2b8743a5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:18.745179 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6721f9e-80ce-45b9-8f3d-42d2b8743a5b service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:18.755146 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1325/2619] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:18.802384 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746766a0-f7a9-46bc-b033-c422e0a6b1ad None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:18.813172 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746766a0-f7a9-46bc-b033-c422e0a6b1ad None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:18.817018 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df04648-e735-4f65-88f9-c3544e654b7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:18.817653 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df04648-e735-4f65-88f9-c3544e654b7a service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:18.817941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df04648-e735-4f65-88f9-c3544e654b7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:18.818225 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df04648-e735-4f65-88f9-c3544e654b7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:18.876763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df04648-e735-4f65-88f9-c3544e654b7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:18.878218 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df04648-e735-4f65-88f9-c3544e654b7a service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:18.887065 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1295/2620] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:20.537871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6721f9e-80ce-45b9-8f3d-42d2b8743a5b service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:20.539291 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d6721f9e-80ce-45b9-8f3d-42d2b8743a5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:20.553942 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:20.612658 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6721f9e-80ce-45b9-8f3d-42d2b8743a5b service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:20.617576 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018887b-d10f-47e6-be25-69d3d7fa69ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:20.618832 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018887b-d10f-47e6-be25-69d3d7fa69ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:20.619165 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018887b-d10f-47e6-be25-69d3d7fa69ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:20.619446 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018887b-d10f-47e6-be25-69d3d7fa69ec admin admin] PATH_INFO: `/v3/users/963fee1261a9484e9f82dd584a3538f7` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:20.620676 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018887b-d10f-47e6-be25-69d3d7fa69ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=963fee1261a9484e9f82dd584a3538f7)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:20.622712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018887b-d10f-47e6-be25-69d3d7fa69ec admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:20.669547 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2018887b-d10f-47e6-be25-69d3d7fa69ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '963fee1261a9484e9f82dd584a3538f7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:20.681980 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2018887b-d10f-47e6-be25-69d3d7fa69ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '963fee1261a9484e9f82dd584a3538f7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:20.682658 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2018887b-d10f-47e6-be25-69d3d7fa69ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '963fee1261a9484e9f82dd584a3538f7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:20.692002 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2018887b-d10f-47e6-be25-69d3d7fa69ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '963fee1261a9484e9f82dd584a3538f7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:20.692783 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2018887b-d10f-47e6-be25-69d3d7fa69ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '963fee1261a9484e9f82dd584a3538f7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:20.708101 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1326/2621] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:20 2022] DELETE /identity/v3/users/963fee1261a9484e9f82dd584a3538f7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:20.713250 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1f55f-a09c-46a6-94f7-3ff996dae700 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:20.713785 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1f55f-a09c-46a6-94f7-3ff996dae700 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:20.713785 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1f55f-a09c-46a6-94f7-3ff996dae700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:20.736959 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a0d1f55f-a09c-46a6-94f7-3ff996dae700 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:20.738952 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a0d1f55f-a09c-46a6-94f7-3ff996dae700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:20.806716 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1296/2622] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:20.816244 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018887b-d10f-47e6-be25-69d3d7fa69ec admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:20.817729 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2018887b-d10f-47e6-be25-69d3d7fa69ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:20.879317 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018887b-d10f-47e6-be25-69d3d7fa69ec admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:20.882989 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eef207-d116-40c8-9d18-ba93894589d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:20.883656 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eef207-d116-40c8-9d18-ba93894589d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:20.883939 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eef207-d116-40c8-9d18-ba93894589d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:20.884219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eef207-d116-40c8-9d18-ba93894589d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:20.893887 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eef207-d116-40c8-9d18-ba93894589d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:20.895297 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eef207-d116-40c8-9d18-ba93894589d1 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:20.907795 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1327/2623] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:21.188627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1f55f-a09c-46a6-94f7-3ff996dae700 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:21.190128 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a0d1f55f-a09c-46a6-94f7-3ff996dae700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:21.204862 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1f55f-a09c-46a6-94f7-3ff996dae700 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:21.209770 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c775447-17d6-4ccb-a4a4-dac59f511a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:21.210781 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c775447-17d6-4ccb-a4a4-dac59f511a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:21.211100 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c775447-17d6-4ccb-a4a4-dac59f511a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:21.211438 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c775447-17d6-4ccb-a4a4-dac59f511a5d admin admin] PATH_INFO: `/v3/projects/1c6ece898cf24ae8aec78ff612cd01a4` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:21.212714 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c775447-17d6-4ccb-a4a4-dac59f511a5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c6ece898cf24ae8aec78ff612cd01a4)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:21.214745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c775447-17d6-4ccb-a4a4-dac59f511a5d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:21.261783 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3c775447-17d6-4ccb-a4a4-dac59f511a5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c6ece898cf24ae8aec78ff612cd01a4', 'request_id': 'req-3c775447-17d6-4ccb-a4a4-dac59f511a5d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:21.270114 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3c775447-17d6-4ccb-a4a4-dac59f511a5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c6ece898cf24ae8aec78ff612cd01a4', 'request_id': 'req-3c775447-17d6-4ccb-a4a4-dac59f511a5d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:21.276993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3c775447-17d6-4ccb-a4a4-dac59f511a5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c6ece898cf24ae8aec78ff612cd01a4', 'request_id': 'req-3c775447-17d6-4ccb-a4a4-dac59f511a5d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:21.288265 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3c775447-17d6-4ccb-a4a4-dac59f511a5d admin admin] The token cache is being invalidate because project 1c6ece898cf24ae8aec78ff612cd01a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:21.288581 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3c775447-17d6-4ccb-a4a4-dac59f511a5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:21.289205 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3c775447-17d6-4ccb-a4a4-dac59f511a5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:21.290763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1297/2624] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:21 2022] DELETE /identity/v3/projects/1c6ece898cf24ae8aec78ff612cd01a4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:21.295957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccb631-2c54-4a38-9377-d483781bf23a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:21.296247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccb631-2c54-4a38-9377-d483781bf23a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:21.296554 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccb631-2c54-4a38-9377-d483781bf23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:21.314420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a9ccb631-2c54-4a38-9377-d483781bf23a None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:21.315617 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a9ccb631-2c54-4a38-9377-d483781bf23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:21.352738 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:21.383363 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1328/2625] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:21.392671 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db215226-81f9-43eb-91bb-5995a1c4ee43 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:21.393150 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db215226-81f9-43eb-91bb-5995a1c4ee43 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:21.393428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db215226-81f9-43eb-91bb-5995a1c4ee43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:21.411276 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-db215226-81f9-43eb-91bb-5995a1c4ee43 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:21.412455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-db215226-81f9-43eb-91bb-5995a1c4ee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:21.420099 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1298/2626] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:21.424276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccb631-2c54-4a38-9377-d483781bf23a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:21.433780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccb631-2c54-4a38-9377-d483781bf23a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:21.438731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0c90f-7cd0-40a9-a900-f48a70f2fc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:21.439367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0c90f-7cd0-40a9-a900-f48a70f2fc25 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:21.439651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0c90f-7cd0-40a9-a900-f48a70f2fc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:21.439926 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0c90f-7cd0-40a9-a900-f48a70f2fc25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:21.440668 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0c90f-7cd0-40a9-a900-f48a70f2fc25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:52:21.440978 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0c90f-7cd0-40a9-a900-f48a70f2fc25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:21.442549 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0c90f-7cd0-40a9-a900-f48a70f2fc25 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:21.454384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1329/2627] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:52:21.458635 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db215226-81f9-43eb-91bb-5995a1c4ee43 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:21.467903 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db215226-81f9-43eb-91bb-5995a1c4ee43 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:21.472541 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbfbad-23b5-41f7-813d-db77f3e40f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:21.473182 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbfbad-23b5-41f7-813d-db77f3e40f40 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:21.473467 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbfbad-23b5-41f7-813d-db77f3e40f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:21.473746 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbfbad-23b5-41f7-813d-db77f3e40f40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:21.474428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbfbad-23b5-41f7-813d-db77f3e40f40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:21.476381 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbfbad-23b5-41f7-813d-db77f3e40f40 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:21.486287 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:21.503512 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1299/2628] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:21 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:21.507540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0c90f-7cd0-40a9-a900-f48a70f2fc25 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:21.517998 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0c90f-7cd0-40a9-a900-f48a70f2fc25 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:21.573745 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f8407-af3d-422a-9855-206b42a0386d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:21.574417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f8407-af3d-422a-9855-206b42a0386d admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:21.574667 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f8407-af3d-422a-9855-206b42a0386d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:21.574983 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f8407-af3d-422a-9855-206b42a0386d admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:21.575630 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f8407-af3d-422a-9855-206b42a0386d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:21.577683 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f8407-af3d-422a-9855-206b42a0386d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:21.597251 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1330/2629] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:21 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:21.601417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbfbad-23b5-41f7-813d-db77f3e40f40 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:21.612519 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbfbad-23b5-41f7-813d-db77f3e40f40 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:21.617066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af1a40-5086-4053-b0ad-60c1fe4af8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:21.617716 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af1a40-5086-4053-b0ad-60c1fe4af8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:21.618005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af1a40-5086-4053-b0ad-60c1fe4af8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:21.618284 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af1a40-5086-4053-b0ad-60c1fe4af8c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:21.619003 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af1a40-5086-4053-b0ad-60c1fe4af8c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:21.620641 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af1a40-5086-4053-b0ad-60c1fe4af8c6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:21.631500 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1300/2630] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:21.635305 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f8407-af3d-422a-9855-206b42a0386d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:21.645574 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f8407-af3d-422a-9855-206b42a0386d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:21.650191 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea583fff-a757-4379-b8a6-77d1e05ae0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:21.650909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea583fff-a757-4379-b8a6-77d1e05ae0ab admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:21.651222 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea583fff-a757-4379-b8a6-77d1e05ae0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:21.651494 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea583fff-a757-4379-b8a6-77d1e05ae0ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:21.652205 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea583fff-a757-4379-b8a6-77d1e05ae0ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:21.653821 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea583fff-a757-4379-b8a6-77d1e05ae0ab admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:21.663957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1331/2631] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:21.668258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af1a40-5086-4053-b0ad-60c1fe4af8c6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:21.681641 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af1a40-5086-4053-b0ad-60c1fe4af8c6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:21.687158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2d4fa-b2d2-4a40-8670-255e7f8f8035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:21.688166 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2d4fa-b2d2-4a40-8670-255e7f8f8035 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:21.688475 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2d4fa-b2d2-4a40-8670-255e7f8f8035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:21.688785 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2d4fa-b2d2-4a40-8670-255e7f8f8035 admin admin] PATH_INFO: `/v3/projects/8819274ed13f4f3f848fb7be9e295815/users/8453bd18330b40af9efac8d72d749141/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:21.703222 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2d4fa-b2d2-4a40-8670-255e7f8f8035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8819274ed13f4f3f848fb7be9e295815, user_id=8453bd18330b40af9efac8d72d749141, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:21.705990 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2d4fa-b2d2-4a40-8670-255e7f8f8035 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:21.719085 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1301/2632] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:21 2022] PUT /identity/v3/projects/8819274ed13f4f3f848fb7be9e295815/users/8453bd18330b40af9efac8d72d749141/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:21.724105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7b5ba-0c70-41cf-b429-92762cc29672 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:21.724394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7b5ba-0c70-41cf-b429-92762cc29672 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:21.724704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7b5ba-0c70-41cf-b429-92762cc29672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:21.742852 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-cda7b5ba-0c70-41cf-b429-92762cc29672 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:21.744043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-cda7b5ba-0c70-41cf-b429-92762cc29672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:21.801669 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1332/2633] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:21.811350 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2d4fa-b2d2-4a40-8670-255e7f8f8035 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:21.813093 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-77f2d4fa-b2d2-4a40-8670-255e7f8f8035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:21.869877 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2d4fa-b2d2-4a40-8670-255e7f8f8035 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:21.874118 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9f370-e56a-40ae-95ee-4380e2baeb1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:21.874751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9f370-e56a-40ae-95ee-4380e2baeb1f service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:21.875037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9f370-e56a-40ae-95ee-4380e2baeb1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:21.875318 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9f370-e56a-40ae-95ee-4380e2baeb1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:21.884625 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9f370-e56a-40ae-95ee-4380e2baeb1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:21.886067 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9f370-e56a-40ae-95ee-4380e2baeb1f service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:21.895586 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1302/2634] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:22.150265 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7b5ba-0c70-41cf-b429-92762cc29672 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:22.152828 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-cda7b5ba-0c70-41cf-b429-92762cc29672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:22.165392 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7b5ba-0c70-41cf-b429-92762cc29672 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:22.172739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0adb2-a9ec-483f-97f0-4f44846760e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:22.173578 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0adb2-a9ec-483f-97f0-4f44846760e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:22.173861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0adb2-a9ec-483f-97f0-4f44846760e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:22.174137 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0adb2-a9ec-483f-97f0-4f44846760e4 admin admin] PATH_INFO: `/v3/users/9eef050f7afa4f85bd805d698a22ca1b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:22.175327 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0adb2-a9ec-483f-97f0-4f44846760e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eef050f7afa4f85bd805d698a22ca1b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:22.177349 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0adb2-a9ec-483f-97f0-4f44846760e4 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:22.225905 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:22.241116 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ebb0adb2-a9ec-483f-97f0-4f44846760e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eef050f7afa4f85bd805d698a22ca1b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:22.259182 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ebb0adb2-a9ec-483f-97f0-4f44846760e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eef050f7afa4f85bd805d698a22ca1b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:22.265466 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ebb0adb2-a9ec-483f-97f0-4f44846760e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eef050f7afa4f85bd805d698a22ca1b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:22.276712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ebb0adb2-a9ec-483f-97f0-4f44846760e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eef050f7afa4f85bd805d698a22ca1b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:22.277458 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ebb0adb2-a9ec-483f-97f0-4f44846760e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eef050f7afa4f85bd805d698a22ca1b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:22.293119 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1333/2635] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:22 2022] DELETE /identity/v3/users/9eef050f7afa4f85bd805d698a22ca1b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:22.298703 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3491c-780d-4897-8916-194ef363d107 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:22.299110 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3491c-780d-4897-8916-194ef363d107 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:22.299397 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3491c-780d-4897-8916-194ef363d107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:22.317770 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d2a3491c-780d-4897-8916-194ef363d107 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:22.318964 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d2a3491c-780d-4897-8916-194ef363d107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:22.384382 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1303/2636] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:22.396037 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0adb2-a9ec-483f-97f0-4f44846760e4 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:22.397637 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ebb0adb2-a9ec-483f-97f0-4f44846760e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:22.458630 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0adb2-a9ec-483f-97f0-4f44846760e4 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:22.462551 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d8687-8f86-4817-b0a8-1375da8fc4e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:22.463066 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d8687-8f86-4817-b0a8-1375da8fc4e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:22.463356 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d8687-8f86-4817-b0a8-1375da8fc4e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:22.463624 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d8687-8f86-4817-b0a8-1375da8fc4e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:22.473102 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d8687-8f86-4817-b0a8-1375da8fc4e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:22.474537 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d8687-8f86-4817-b0a8-1375da8fc4e7 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:22.487399 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1334/2637] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:52:22.798790 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3491c-780d-4897-8916-194ef363d107 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:22.800397 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d2a3491c-780d-4897-8916-194ef363d107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:22.814900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3491c-780d-4897-8916-194ef363d107 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:22.820628 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2ae32-f05d-4b24-b008-f1ff5c1a8208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:22.821653 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2ae32-f05d-4b24-b008-f1ff5c1a8208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:22.822048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2ae32-f05d-4b24-b008-f1ff5c1a8208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:22.822525 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2ae32-f05d-4b24-b008-f1ff5c1a8208 admin admin] PATH_INFO: `/v3/projects/74d0f70f0fd94ebb86970a3cdb532b4b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:22.823845 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2ae32-f05d-4b24-b008-f1ff5c1a8208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74d0f70f0fd94ebb86970a3cdb532b4b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:22.826062 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2ae32-f05d-4b24-b008-f1ff5c1a8208 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:22.877758 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dcc2ae32-f05d-4b24-b008-f1ff5c1a8208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74d0f70f0fd94ebb86970a3cdb532b4b', 'request_id': 'req-dcc2ae32-f05d-4b24-b008-f1ff5c1a8208'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:22.881938 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:22.887507 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dcc2ae32-f05d-4b24-b008-f1ff5c1a8208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74d0f70f0fd94ebb86970a3cdb532b4b', 'request_id': 'req-dcc2ae32-f05d-4b24-b008-f1ff5c1a8208'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:22.899101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dcc2ae32-f05d-4b24-b008-f1ff5c1a8208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74d0f70f0fd94ebb86970a3cdb532b4b', 'request_id': 'req-dcc2ae32-f05d-4b24-b008-f1ff5c1a8208'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:22.914518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dcc2ae32-f05d-4b24-b008-f1ff5c1a8208 admin admin] The token cache is being invalidate because project 74d0f70f0fd94ebb86970a3cdb532b4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:22.914826 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dcc2ae32-f05d-4b24-b008-f1ff5c1a8208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:22.915472 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dcc2ae32-f05d-4b24-b008-f1ff5c1a8208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:22.917076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1304/2638] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:22 2022] DELETE /identity/v3/projects/74d0f70f0fd94ebb86970a3cdb532b4b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:22.921285 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d8687-8f86-4817-b0a8-1375da8fc4e7 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:22.934739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d8687-8f86-4817-b0a8-1375da8fc4e7 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:22.999303 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901c70d-e0ab-4d0e-a63d-dea8501ccf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:23.000188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901c70d-e0ab-4d0e-a63d-dea8501ccf32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:23.000465 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901c70d-e0ab-4d0e-a63d-dea8501ccf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:23.000767 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901c70d-e0ab-4d0e-a63d-dea8501ccf32 admin admin] PATH_INFO: `/v3/users/597eae4732c9498dae845cb3d0e57b76` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:23.002744 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901c70d-e0ab-4d0e-a63d-dea8501ccf32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=597eae4732c9498dae845cb3d0e57b76)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:23.005373 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901c70d-e0ab-4d0e-a63d-dea8501ccf32 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:23.071645 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a901c70d-e0ab-4d0e-a63d-dea8501ccf32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '597eae4732c9498dae845cb3d0e57b76'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:23.085075 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:23.089135 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a901c70d-e0ab-4d0e-a63d-dea8501ccf32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '597eae4732c9498dae845cb3d0e57b76'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:23.090639 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a901c70d-e0ab-4d0e-a63d-dea8501ccf32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '597eae4732c9498dae845cb3d0e57b76'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:23.102756 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a901c70d-e0ab-4d0e-a63d-dea8501ccf32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '597eae4732c9498dae845cb3d0e57b76'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:23.103899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a901c70d-e0ab-4d0e-a63d-dea8501ccf32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '597eae4732c9498dae845cb3d0e57b76'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:23.122204 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1335/2639] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:22 2022] DELETE /identity/v3/users/597eae4732c9498dae845cb3d0e57b76 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:23.485374 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2ae32-f05d-4b24-b008-f1ff5c1a8208 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:23.487514 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dcc2ae32-f05d-4b24-b008-f1ff5c1a8208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:23.517071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2ae32-f05d-4b24-b008-f1ff5c1a8208 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:23.594228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91648926-e6fc-4a09-b810-6759314df9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:23.596471 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91648926-e6fc-4a09-b810-6759314df9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:23.597543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91648926-e6fc-4a09-b810-6759314df9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:23.598254 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91648926-e6fc-4a09-b810-6759314df9e8 admin admin] PATH_INFO: `/v3/projects/27d6b5ba67824db082b141eab3840187` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:23.599941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91648926-e6fc-4a09-b810-6759314df9e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d6b5ba67824db082b141eab3840187)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:23.602135 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91648926-e6fc-4a09-b810-6759314df9e8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:23.674077 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-91648926-e6fc-4a09-b810-6759314df9e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d6b5ba67824db082b141eab3840187', 'request_id': 'req-91648926-e6fc-4a09-b810-6759314df9e8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:23.683846 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-91648926-e6fc-4a09-b810-6759314df9e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d6b5ba67824db082b141eab3840187', 'request_id': 'req-91648926-e6fc-4a09-b810-6759314df9e8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:23.690017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-91648926-e6fc-4a09-b810-6759314df9e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d6b5ba67824db082b141eab3840187', 'request_id': 'req-91648926-e6fc-4a09-b810-6759314df9e8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:23.701458 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-91648926-e6fc-4a09-b810-6759314df9e8 admin admin] The token cache is being invalidate because project 27d6b5ba67824db082b141eab3840187 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:23.701740 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-91648926-e6fc-4a09-b810-6759314df9e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:23.702388 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-91648926-e6fc-4a09-b810-6759314df9e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:23.706048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1305/2640] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:23 2022] DELETE /identity/v3/projects/27d6b5ba67824db082b141eab3840187 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:23.711275 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea833b-2300-47f8-bc24-5a18d595dcdd None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:23.711666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea833b-2300-47f8-bc24-5a18d595dcdd None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:23.712015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea833b-2300-47f8-bc24-5a18d595dcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:23.731764 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c9ea833b-2300-47f8-bc24-5a18d595dcdd None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:23.733759 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c9ea833b-2300-47f8-bc24-5a18d595dcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:23.817397 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1336/2641] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:23.827433 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48ca0b-39e0-45ba-b550-98c7e8317a8b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:23.828493 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48ca0b-39e0-45ba-b550-98c7e8317a8b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:23.828968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48ca0b-39e0-45ba-b550-98c7e8317a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:23.853408 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6c48ca0b-39e0-45ba-b550-98c7e8317a8b None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:23.854661 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6c48ca0b-39e0-45ba-b550-98c7e8317a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:23.864556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1306/2642] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:23.868434 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea833b-2300-47f8-bc24-5a18d595dcdd None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:23.878744 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea833b-2300-47f8-bc24-5a18d595dcdd None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:23.883608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd30f6-a760-4b2a-84c1-9635a40a9d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:23.884369 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd30f6-a760-4b2a-84c1-9635a40a9d2f admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:23.884922 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd30f6-a760-4b2a-84c1-9635a40a9d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:23.885702 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd30f6-a760-4b2a-84c1-9635a40a9d2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:23.886057 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd30f6-a760-4b2a-84c1-9635a40a9d2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:52:23.886432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd30f6-a760-4b2a-84c1-9635a40a9d2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:23.889130 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd30f6-a760-4b2a-84c1-9635a40a9d2f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:23.908420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1337/2643] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:52:23.913087 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48ca0b-39e0-45ba-b550-98c7e8317a8b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:23.927332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48ca0b-39e0-45ba-b550-98c7e8317a8b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:23.932371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195b35c-1f5e-495c-9c7f-8d945e0b6d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:23.933188 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195b35c-1f5e-495c-9c7f-8d945e0b6d5d admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:23.933547 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195b35c-1f5e-495c-9c7f-8d945e0b6d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:23.933901 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195b35c-1f5e-495c-9c7f-8d945e0b6d5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:23.934669 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195b35c-1f5e-495c-9c7f-8d945e0b6d5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:23.936903 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195b35c-1f5e-495c-9c7f-8d945e0b6d5d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:23.969719 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1307/2644] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:23 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:23.973389 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd30f6-a760-4b2a-84c1-9635a40a9d2f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:23.984939 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd30f6-a760-4b2a-84c1-9635a40a9d2f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:24.056380 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec89447-a961-4fb6-8a51-ce3261e5c5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:24.057161 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec89447-a961-4fb6-8a51-ce3261e5c5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:24.057463 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec89447-a961-4fb6-8a51-ce3261e5c5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:24.057727 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec89447-a961-4fb6-8a51-ce3261e5c5a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:24.058463 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec89447-a961-4fb6-8a51-ce3261e5c5a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:24.061379 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec89447-a961-4fb6-8a51-ce3261e5c5a3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:24.084043 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1338/2645] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:23 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:52:24.088061 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195b35c-1f5e-495c-9c7f-8d945e0b6d5d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:24.100077 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195b35c-1f5e-495c-9c7f-8d945e0b6d5d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:24.105142 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d09ae-524b-4cf6-9c1b-3278e2072206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:24.105852 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d09ae-524b-4cf6-9c1b-3278e2072206 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:24.106314 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d09ae-524b-4cf6-9c1b-3278e2072206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:24.106592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d09ae-524b-4cf6-9c1b-3278e2072206 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:24.107362 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d09ae-524b-4cf6-9c1b-3278e2072206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:24.109150 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d09ae-524b-4cf6-9c1b-3278e2072206 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:24.124161 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1308/2646] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:24.125677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec89447-a961-4fb6-8a51-ce3261e5c5a3 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:24.136027 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec89447-a961-4fb6-8a51-ce3261e5c5a3 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:24.142283 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26dc6a-a6e6-4c18-8863-adafeef506d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:24.142967 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26dc6a-a6e6-4c18-8863-adafeef506d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:24.143803 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26dc6a-a6e6-4c18-8863-adafeef506d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:24.143803 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26dc6a-a6e6-4c18-8863-adafeef506d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:24.144421 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26dc6a-a6e6-4c18-8863-adafeef506d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:24.146087 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26dc6a-a6e6-4c18-8863-adafeef506d5 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:24.158739 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1339/2647] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:24.162822 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d09ae-524b-4cf6-9c1b-3278e2072206 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:24.173609 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d09ae-524b-4cf6-9c1b-3278e2072206 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:24.179706 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92de50-5911-4e99-86f2-204dd5e8cdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:24.181357 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92de50-5911-4e99-86f2-204dd5e8cdfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:24.181560 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92de50-5911-4e99-86f2-204dd5e8cdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:24.181840 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92de50-5911-4e99-86f2-204dd5e8cdfb admin admin] PATH_INFO: `/v3/projects/2ebc897160654ddf8035fe5f05e04b1f/users/8fc6f8bbdc2142abb34bd599d8533288/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:24.206519 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92de50-5911-4e99-86f2-204dd5e8cdfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ebc897160654ddf8035fe5f05e04b1f, user_id=8fc6f8bbdc2142abb34bd599d8533288, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:24.209581 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92de50-5911-4e99-86f2-204dd5e8cdfb admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:24.229390 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1309/2648] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:24 2022] PUT /identity/v3/projects/2ebc897160654ddf8035fe5f05e04b1f/users/8fc6f8bbdc2142abb34bd599d8533288/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:24.242194 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f16ac-8bd9-46ca-addd-3c29905544d9 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:24.242486 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f16ac-8bd9-46ca-addd-3c29905544d9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:24.242764 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f16ac-8bd9-46ca-addd-3c29905544d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:24.279309 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-fc6f16ac-8bd9-46ca-addd-3c29905544d9 None None] MFA Rules not processed for user `8fc6f8bbdc2142abb34bd599d8533288`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:24.280756 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-fc6f16ac-8bd9-46ca-addd-3c29905544d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:24.316662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:24.371215 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92de50-5911-4e99-86f2-204dd5e8cdfb admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:24.372213 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1340/2649] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:24.384816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:24.463423 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92de50-5911-4e99-86f2-204dd5e8cdfb admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:24.470605 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f40d63-a63d-4702-beae-9522ea3be69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:24.471428 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f40d63-a63d-4702-beae-9522ea3be69d admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:24.471787 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f40d63-a63d-4702-beae-9522ea3be69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:24.472397 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f40d63-a63d-4702-beae-9522ea3be69d admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:24.473277 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f40d63-a63d-4702-beae-9522ea3be69d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:24.475985 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f40d63-a63d-4702-beae-9522ea3be69d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:24.517614 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1310/2650] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:24 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:24.519794 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f16ac-8bd9-46ca-addd-3c29905544d9 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:24.530921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f16ac-8bd9-46ca-addd-3c29905544d9 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:24.596689 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53545875-c98d-4c43-83a6-de8e989f1ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:24.597387 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53545875-c98d-4c43-83a6-de8e989f1ddd admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:24.597667 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53545875-c98d-4c43-83a6-de8e989f1ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:24.597938 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53545875-c98d-4c43-83a6-de8e989f1ddd admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:24.598741 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53545875-c98d-4c43-83a6-de8e989f1ddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:24.600774 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53545875-c98d-4c43-83a6-de8e989f1ddd admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:24.624578 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1341/2651] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:24 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:24.628558 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f40d63-a63d-4702-beae-9522ea3be69d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:24.642297 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f40d63-a63d-4702-beae-9522ea3be69d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:24.647642 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd924f-7b86-40bd-97c7-37c7e99deb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:24.648372 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd924f-7b86-40bd-97c7-37c7e99deb75 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:24.648617 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd924f-7b86-40bd-97c7-37c7e99deb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:24.648893 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd924f-7b86-40bd-97c7-37c7e99deb75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:24.649616 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd924f-7b86-40bd-97c7-37c7e99deb75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:24.651280 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd924f-7b86-40bd-97c7-37c7e99deb75 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:24.665814 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1311/2652] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:52:24.667341 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53545875-c98d-4c43-83a6-de8e989f1ddd admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:24.678221 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53545875-c98d-4c43-83a6-de8e989f1ddd admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:24.684002 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a50b5c-0c79-4064-a275-65d28ce86b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:24.685161 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a50b5c-0c79-4064-a275-65d28ce86b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:24.685318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a50b5c-0c79-4064-a275-65d28ce86b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:24.686176 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a50b5c-0c79-4064-a275-65d28ce86b24 admin admin] PATH_INFO: `/v3/projects/a77378547f5a4e7fac5bb3e463727ed9/users/3e97254e75f444c9b044b1940b71a9d3/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:24.706353 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a50b5c-0c79-4064-a275-65d28ce86b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a77378547f5a4e7fac5bb3e463727ed9, user_id=3e97254e75f444c9b044b1940b71a9d3, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:24.710027 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a50b5c-0c79-4064-a275-65d28ce86b24 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:24.726760 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1342/2653] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:24 2022] PUT /identity/v3/projects/a77378547f5a4e7fac5bb3e463727ed9/users/3e97254e75f444c9b044b1940b71a9d3/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:52:24.730590 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd924f-7b86-40bd-97c7-37c7e99deb75 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:24.744810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd924f-7b86-40bd-97c7-37c7e99deb75 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:24.836405 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc317137-0af4-4e48-b8f1-aaa50b631bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:24.837320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc317137-0af4-4e48-b8f1-aaa50b631bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:24.837616 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc317137-0af4-4e48-b8f1-aaa50b631bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:24.838414 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc317137-0af4-4e48-b8f1-aaa50b631bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:24.839371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc317137-0af4-4e48-b8f1-aaa50b631bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:24.843092 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc317137-0af4-4e48-b8f1-aaa50b631bc7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:24.876169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1312/2654] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:24.879513 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a50b5c-0c79-4064-a275-65d28ce86b24 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:24.896755 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a50b5c-0c79-4064-a275-65d28ce86b24 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:24.907034 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587f0cc-532c-427c-b48a-c7a2e3ff675c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:24.908074 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587f0cc-532c-427c-b48a-c7a2e3ff675c admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:24.908641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587f0cc-532c-427c-b48a-c7a2e3ff675c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:24.909035 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587f0cc-532c-427c-b48a-c7a2e3ff675c admin admin] PATH_INFO: `/v3/projects/a77378547f5a4e7fac5bb3e463727ed9/users/3e97254e75f444c9b044b1940b71a9d3/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:24.913763 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587f0cc-532c-427c-b48a-c7a2e3ff675c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a77378547f5a4e7fac5bb3e463727ed9, user_id=3e97254e75f444c9b044b1940b71a9d3, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:24.919501 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587f0cc-532c-427c-b48a-c7a2e3ff675c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:24.951566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1343/2655] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:24 2022] PUT /identity/v3/projects/a77378547f5a4e7fac5bb3e463727ed9/users/3e97254e75f444c9b044b1940b71a9d3/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:24.962419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d9ba8-ed02-44b7-b082-268a0721e5a5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:24.962866 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d9ba8-ed02-44b7-b082-268a0721e5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:24.963189 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d9ba8-ed02-44b7-b082-268a0721e5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:25.025393 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e56d9ba8-ed02-44b7-b082-268a0721e5a5 None None] MFA Rules not processed for user `3e97254e75f444c9b044b1940b71a9d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:25.027495 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e56d9ba8-ed02-44b7-b082-268a0721e5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:25.111101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1313/2656] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:25.121612 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587f0cc-532c-427c-b48a-c7a2e3ff675c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:25.123465 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f587f0cc-532c-427c-b48a-c7a2e3ff675c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:25.194099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587f0cc-532c-427c-b48a-c7a2e3ff675c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:25.198513 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b566e82-cce5-43b1-a8a9-11bd746e2771 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:25.199181 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b566e82-cce5-43b1-a8a9-11bd746e2771 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:25.199514 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b566e82-cce5-43b1-a8a9-11bd746e2771 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:25.200242 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b566e82-cce5-43b1-a8a9-11bd746e2771 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:25.250117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:25.282397 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b566e82-cce5-43b1-a8a9-11bd746e2771 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:25.284791 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b566e82-cce5-43b1-a8a9-11bd746e2771 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:25.298022 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1344/2657] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:26.070766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fd4e2-3331-43fb-a52f-73da4dd18caa None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:26.070766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fd4e2-3331-43fb-a52f-73da4dd18caa None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:26.070766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fd4e2-3331-43fb-a52f-73da4dd18caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:26.080134 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:26.104910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f13fd4e2-3331-43fb-a52f-73da4dd18caa None None] MFA Rules not processed for user `8453bd18330b40af9efac8d72d749141`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:26.106114 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f13fd4e2-3331-43fb-a52f-73da4dd18caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:26.193186 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1314/2658] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:26.197691 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b566e82-cce5-43b1-a8a9-11bd746e2771 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:26.199167 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6b566e82-cce5-43b1-a8a9-11bd746e2771 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:26.282248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b566e82-cce5-43b1-a8a9-11bd746e2771 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:26.286825 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f45299-dcad-41fe-96e8-c07cea1d5ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:26.287482 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f45299-dcad-41fe-96e8-c07cea1d5ece admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:26.287763 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f45299-dcad-41fe-96e8-c07cea1d5ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:26.288038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f45299-dcad-41fe-96e8-c07cea1d5ece admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:26.288771 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f45299-dcad-41fe-96e8-c07cea1d5ece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:26.290697 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f45299-dcad-41fe-96e8-c07cea1d5ece admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:26.322200 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1345/2659] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:26 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:26.325466 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fd4e2-3331-43fb-a52f-73da4dd18caa None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:26.340875 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fd4e2-3331-43fb-a52f-73da4dd18caa None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:26.441993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe8173-d270-4496-b24f-3985057d2b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:26.442668 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe8173-d270-4496-b24f-3985057d2b55 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:26.442952 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe8173-d270-4496-b24f-3985057d2b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:26.443224 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe8173-d270-4496-b24f-3985057d2b55 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:26.443916 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe8173-d270-4496-b24f-3985057d2b55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:26.448021 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe8173-d270-4496-b24f-3985057d2b55 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:26.477674 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1315/2660] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:26 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:26.481448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f45299-dcad-41fe-96e8-c07cea1d5ece admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:26.492390 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f45299-dcad-41fe-96e8-c07cea1d5ece admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:26.497168 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce98f6-1bbe-4511-9855-93b241972271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:26.498457 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce98f6-1bbe-4511-9855-93b241972271 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:26.498930 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce98f6-1bbe-4511-9855-93b241972271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:26.499271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce98f6-1bbe-4511-9855-93b241972271 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:26.500062 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce98f6-1bbe-4511-9855-93b241972271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:26.501824 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce98f6-1bbe-4511-9855-93b241972271 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:26.514099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1346/2661] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:26.518593 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe8173-d270-4496-b24f-3985057d2b55 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:26.529446 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe8173-d270-4496-b24f-3985057d2b55 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:26.535506 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fec93e-697a-4125-8201-1ab4b198f6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:26.536425 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fec93e-697a-4125-8201-1ab4b198f6aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:26.536991 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fec93e-697a-4125-8201-1ab4b198f6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:26.537271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fec93e-697a-4125-8201-1ab4b198f6aa admin admin] PATH_INFO: `/v3/projects/f5483969c5c14c4bb1c6a49e90ecfc57/users/a1218fe3d1e34356a9e498c4d7a61cd3/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:26.554186 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fec93e-697a-4125-8201-1ab4b198f6aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5483969c5c14c4bb1c6a49e90ecfc57, user_id=a1218fe3d1e34356a9e498c4d7a61cd3, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:26.556906 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fec93e-697a-4125-8201-1ab4b198f6aa admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:26.571899 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1316/2662] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:26 2022] PUT /identity/v3/projects/f5483969c5c14c4bb1c6a49e90ecfc57/users/a1218fe3d1e34356a9e498c4d7a61cd3/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:26.576495 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce98f6-1bbe-4511-9855-93b241972271 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:26.587154 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce98f6-1bbe-4511-9855-93b241972271 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:26.645669 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c4793-b859-4aae-8f65-165d3b85a6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:26.646242 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c4793-b859-4aae-8f65-165d3b85a6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:26.646520 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c4793-b859-4aae-8f65-165d3b85a6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:26.646795 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c4793-b859-4aae-8f65-165d3b85a6e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:26.647512 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c4793-b859-4aae-8f65-165d3b85a6e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:26.649149 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c4793-b859-4aae-8f65-165d3b85a6e0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:26.660081 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1347/2663] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:52:26.664102 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fec93e-697a-4125-8201-1ab4b198f6aa admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:26.675091 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fec93e-697a-4125-8201-1ab4b198f6aa admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:26.679729 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea600f71-9efd-4226-abaf-38e083a74be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:26.680643 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea600f71-9efd-4226-abaf-38e083a74be5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:26.680932 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea600f71-9efd-4226-abaf-38e083a74be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:26.681214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea600f71-9efd-4226-abaf-38e083a74be5 admin admin] PATH_INFO: `/v3/projects/f5483969c5c14c4bb1c6a49e90ecfc57/users/a1218fe3d1e34356a9e498c4d7a61cd3/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:26.683208 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea600f71-9efd-4226-abaf-38e083a74be5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5483969c5c14c4bb1c6a49e90ecfc57, user_id=a1218fe3d1e34356a9e498c4d7a61cd3, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:26.686526 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea600f71-9efd-4226-abaf-38e083a74be5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:26.697631 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1317/2664] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:26 2022] PUT /identity/v3/projects/f5483969c5c14c4bb1c6a49e90ecfc57/users/a1218fe3d1e34356a9e498c4d7a61cd3/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:30.006650 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c4793-b859-4aae-8f65-165d3b85a6e0 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:30.008358 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0b7c4793-b859-4aae-8f65-165d3b85a6e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:30.105526 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:30.112617 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c4793-b859-4aae-8f65-165d3b85a6e0 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:30.180228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db9038-3a9f-4d2a-996e-95c035a4dc74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:30.181158 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db9038-3a9f-4d2a-996e-95c035a4dc74 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:30.181617 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db9038-3a9f-4d2a-996e-95c035a4dc74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:30.182035 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db9038-3a9f-4d2a-996e-95c035a4dc74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:30.259377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db9038-3a9f-4d2a-996e-95c035a4dc74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:30.259377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db9038-3a9f-4d2a-996e-95c035a4dc74 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:30.268535 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1348/2665] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:32.987227 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac454114-8728-4f3c-a902-c5b757bc7eeb None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:32.987717 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac454114-8728-4f3c-a902-c5b757bc7eeb None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:32.987808 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac454114-8728-4f3c-a902-c5b757bc7eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:33.035363 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ac454114-8728-4f3c-a902-c5b757bc7eeb None None] MFA Rules not processed for user `a1218fe3d1e34356a9e498c4d7a61cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:33.036673 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ac454114-8728-4f3c-a902-c5b757bc7eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:33.074207 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:33.125088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1318/2666] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:32 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:33.139485 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db9038-3a9f-4d2a-996e-95c035a4dc74 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:33.141538 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-27db9038-3a9f-4d2a-996e-95c035a4dc74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:33.256408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db9038-3a9f-4d2a-996e-95c035a4dc74 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:33.264425 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261df313-b4ce-4f85-a6fc-b824f1fac9b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:33.265416 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261df313-b4ce-4f85-a6fc-b824f1fac9b5 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:33.266069 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261df313-b4ce-4f85-a6fc-b824f1fac9b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:33.266571 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261df313-b4ce-4f85-a6fc-b824f1fac9b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:33.340587 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:33.353105 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261df313-b4ce-4f85-a6fc-b824f1fac9b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:33.355034 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261df313-b4ce-4f85-a6fc-b824f1fac9b5 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:33.370217 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1349/2667] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:34.561675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369e8f6-6c98-4f30-acd0-816996a95492 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:34.562202 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369e8f6-6c98-4f30-acd0-816996a95492 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:34.562337 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369e8f6-6c98-4f30-acd0-816996a95492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:34.580697 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7369e8f6-6c98-4f30-acd0-816996a95492 None None] MFA Rules not processed for user `8453bd18330b40af9efac8d72d749141`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:34.581936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7369e8f6-6c98-4f30-acd0-816996a95492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:34.591043 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1319/2668] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:35.805069 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261df313-b4ce-4f85-a6fc-b824f1fac9b5 service nova] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:35.908447 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261df313-b4ce-4f85-a6fc-b824f1fac9b5 service nova] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:35.913311 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7f7e9-4cd3-4da4-8f5f-93b794bd6767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:35.914340 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7f7e9-4cd3-4da4-8f5f-93b794bd6767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:35.914840 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7f7e9-4cd3-4da4-8f5f-93b794bd6767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:35.915406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7f7e9-4cd3-4da4-8f5f-93b794bd6767 admin admin] PATH_INFO: `/v3/users/8fc6f8bbdc2142abb34bd599d8533288` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:35.922594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7f7e9-4cd3-4da4-8f5f-93b794bd6767 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fc6f8bbdc2142abb34bd599d8533288)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:35.924683 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7f7e9-4cd3-4da4-8f5f-93b794bd6767 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:35.986978 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-32c7f7e9-4cd3-4da4-8f5f-93b794bd6767 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fc6f8bbdc2142abb34bd599d8533288'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:36.000403 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-32c7f7e9-4cd3-4da4-8f5f-93b794bd6767 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fc6f8bbdc2142abb34bd599d8533288'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:36.001393 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-32c7f7e9-4cd3-4da4-8f5f-93b794bd6767 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fc6f8bbdc2142abb34bd599d8533288'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:36.009215 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-32c7f7e9-4cd3-4da4-8f5f-93b794bd6767 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fc6f8bbdc2142abb34bd599d8533288'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:36.009932 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-32c7f7e9-4cd3-4da4-8f5f-93b794bd6767 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fc6f8bbdc2142abb34bd599d8533288'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:36.026751 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1350/2669] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:35 2022] DELETE /identity/v3/users/8fc6f8bbdc2142abb34bd599d8533288 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:36.032359 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a68875-9c51-472b-a76c-d390e5fdee26 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:36.033542 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a68875-9c51-472b-a76c-d390e5fdee26 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:36.034399 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a68875-9c51-472b-a76c-d390e5fdee26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:36.053771 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a3a68875-9c51-472b-a76c-d390e5fdee26 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:36.054974 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a3a68875-9c51-472b-a76c-d390e5fdee26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:36.140038 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1320/2670] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:36.152356 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7f7e9-4cd3-4da4-8f5f-93b794bd6767 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:36.155249 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-32c7f7e9-4cd3-4da4-8f5f-93b794bd6767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:36.248531 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7f7e9-4cd3-4da4-8f5f-93b794bd6767 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:36.260623 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00694b3-81ba-4cc5-942b-fdb3ce726cb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:36.260623 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00694b3-81ba-4cc5-942b-fdb3ce726cb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:36.260623 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00694b3-81ba-4cc5-942b-fdb3ce726cb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:36.260623 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00694b3-81ba-4cc5-942b-fdb3ce726cb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:36.279015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00694b3-81ba-4cc5-942b-fdb3ce726cb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:36.280495 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00694b3-81ba-4cc5-942b-fdb3ce726cb9 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:36.291544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1351/2671] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:36.626472 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a68875-9c51-472b-a76c-d390e5fdee26 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:36.628145 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a3a68875-9c51-472b-a76c-d390e5fdee26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:36.645145 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a68875-9c51-472b-a76c-d390e5fdee26 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:36.650100 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682db46-9570-4e08-904e-d45fe770e403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:36.651012 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682db46-9570-4e08-904e-d45fe770e403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:36.651300 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682db46-9570-4e08-904e-d45fe770e403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:36.651574 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682db46-9570-4e08-904e-d45fe770e403 admin admin] PATH_INFO: `/v3/projects/2ebc897160654ddf8035fe5f05e04b1f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:36.652796 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682db46-9570-4e08-904e-d45fe770e403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ebc897160654ddf8035fe5f05e04b1f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:36.655267 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682db46-9570-4e08-904e-d45fe770e403 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:36.704367 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1682db46-9570-4e08-904e-d45fe770e403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ebc897160654ddf8035fe5f05e04b1f', 'request_id': 'req-1682db46-9570-4e08-904e-d45fe770e403'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:36.710578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1682db46-9570-4e08-904e-d45fe770e403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ebc897160654ddf8035fe5f05e04b1f', 'request_id': 'req-1682db46-9570-4e08-904e-d45fe770e403'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:36.715988 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1682db46-9570-4e08-904e-d45fe770e403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ebc897160654ddf8035fe5f05e04b1f', 'request_id': 'req-1682db46-9570-4e08-904e-d45fe770e403'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:36.727195 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1682db46-9570-4e08-904e-d45fe770e403 admin admin] The token cache is being invalidate because project 2ebc897160654ddf8035fe5f05e04b1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:36.727506 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1682db46-9570-4e08-904e-d45fe770e403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:36.728139 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1682db46-9570-4e08-904e-d45fe770e403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:36.729709 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1321/2672] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:36 2022] DELETE /identity/v3/projects/2ebc897160654ddf8035fe5f05e04b1f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:36.735046 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00694b3-81ba-4cc5-942b-fdb3ce726cb9 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:36.745571 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00694b3-81ba-4cc5-942b-fdb3ce726cb9 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:36.754838 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:36.804797 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57121ee1-feec-49d4-94fd-30c92a75bad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:36.805818 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57121ee1-feec-49d4-94fd-30c92a75bad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:36.806424 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57121ee1-feec-49d4-94fd-30c92a75bad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:36.806424 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57121ee1-feec-49d4-94fd-30c92a75bad2 admin admin] PATH_INFO: `/v3/users/3e97254e75f444c9b044b1940b71a9d3` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:36.807758 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57121ee1-feec-49d4-94fd-30c92a75bad2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e97254e75f444c9b044b1940b71a9d3)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:36.810033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57121ee1-feec-49d4-94fd-30c92a75bad2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:36.861573 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-57121ee1-feec-49d4-94fd-30c92a75bad2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e97254e75f444c9b044b1940b71a9d3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:36.874096 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-57121ee1-feec-49d4-94fd-30c92a75bad2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e97254e75f444c9b044b1940b71a9d3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:36.874871 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-57121ee1-feec-49d4-94fd-30c92a75bad2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e97254e75f444c9b044b1940b71a9d3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:36.881767 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-57121ee1-feec-49d4-94fd-30c92a75bad2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e97254e75f444c9b044b1940b71a9d3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:36.882405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-57121ee1-feec-49d4-94fd-30c92a75bad2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e97254e75f444c9b044b1940b71a9d3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:36.895535 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1352/2673] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:36 2022] DELETE /identity/v3/users/3e97254e75f444c9b044b1940b71a9d3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:37.181983 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682db46-9570-4e08-904e-d45fe770e403 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:37.186236 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1682db46-9570-4e08-904e-d45fe770e403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:37.204232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682db46-9570-4e08-904e-d45fe770e403 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:37.270167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:37.286219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6752c-33ee-4262-8c79-bc90de24bc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:37.289366 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6752c-33ee-4262-8c79-bc90de24bc3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:37.289671 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6752c-33ee-4262-8c79-bc90de24bc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:37.289951 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6752c-33ee-4262-8c79-bc90de24bc3d admin admin] PATH_INFO: `/v3/projects/a77378547f5a4e7fac5bb3e463727ed9` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:37.291308 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6752c-33ee-4262-8c79-bc90de24bc3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a77378547f5a4e7fac5bb3e463727ed9)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:37.293289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6752c-33ee-4262-8c79-bc90de24bc3d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:37.349566 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-eab6752c-33ee-4262-8c79-bc90de24bc3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a77378547f5a4e7fac5bb3e463727ed9', 'request_id': 'req-eab6752c-33ee-4262-8c79-bc90de24bc3d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:37.358757 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-eab6752c-33ee-4262-8c79-bc90de24bc3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a77378547f5a4e7fac5bb3e463727ed9', 'request_id': 'req-eab6752c-33ee-4262-8c79-bc90de24bc3d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:37.365646 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-eab6752c-33ee-4262-8c79-bc90de24bc3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a77378547f5a4e7fac5bb3e463727ed9', 'request_id': 'req-eab6752c-33ee-4262-8c79-bc90de24bc3d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:37.377905 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-eab6752c-33ee-4262-8c79-bc90de24bc3d admin admin] The token cache is being invalidate because project a77378547f5a4e7fac5bb3e463727ed9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:37.378196 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-eab6752c-33ee-4262-8c79-bc90de24bc3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:37.378879 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-eab6752c-33ee-4262-8c79-bc90de24bc3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:37.380606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1322/2674] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:37 2022] DELETE /identity/v3/projects/a77378547f5a4e7fac5bb3e463727ed9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:37.386921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976319f1-2bca-45a5-abd5-88441a34c3c2 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:37.387216 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976319f1-2bca-45a5-abd5-88441a34c3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:37.387636 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976319f1-2bca-45a5-abd5-88441a34c3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:37.407483 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-976319f1-2bca-45a5-abd5-88441a34c3c2 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:37.409004 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-976319f1-2bca-45a5-abd5-88441a34c3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:37.477015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1353/2675] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:37.487387 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb7955-df7d-4801-a13c-36789b063fba None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:37.487680 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb7955-df7d-4801-a13c-36789b063fba None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:37.487963 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb7955-df7d-4801-a13c-36789b063fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:37.509128 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-5adb7955-df7d-4801-a13c-36789b063fba None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:37.510263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5adb7955-df7d-4801-a13c-36789b063fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:37.520888 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1323/2676] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:37.525288 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976319f1-2bca-45a5-abd5-88441a34c3c2 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:37.536116 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976319f1-2bca-45a5-abd5-88441a34c3c2 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:37.540975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db85d7a-a3a8-4709-9444-69c1bdf0bbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:37.541775 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db85d7a-a3a8-4709-9444-69c1bdf0bbda admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:37.542060 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db85d7a-a3a8-4709-9444-69c1bdf0bbda admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:37.542377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db85d7a-a3a8-4709-9444-69c1bdf0bbda admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:37.543089 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db85d7a-a3a8-4709-9444-69c1bdf0bbda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:52:37.543486 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db85d7a-a3a8-4709-9444-69c1bdf0bbda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:37.545253 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db85d7a-a3a8-4709-9444-69c1bdf0bbda admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:37.559921 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1354/2677] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:52:37.564626 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb7955-df7d-4801-a13c-36789b063fba None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:37.574796 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb7955-df7d-4801-a13c-36789b063fba None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:37.580522 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c09ec3-e0da-4272-b10b-5d9c6109f09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:37.581226 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c09ec3-e0da-4272-b10b-5d9c6109f09d admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:37.581520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c09ec3-e0da-4272-b10b-5d9c6109f09d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:37.581790 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c09ec3-e0da-4272-b10b-5d9c6109f09d admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:37.582587 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c09ec3-e0da-4272-b10b-5d9c6109f09d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:37.584484 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c09ec3-e0da-4272-b10b-5d9c6109f09d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:37.633099 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1324/2678] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:37 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:52:37.639098 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db85d7a-a3a8-4709-9444-69c1bdf0bbda admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:37.655191 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db85d7a-a3a8-4709-9444-69c1bdf0bbda admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:37.683984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c09ec3-e0da-4272-b10b-5d9c6109f09d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:37.686341 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-01c09ec3-e0da-4272-b10b-5d9c6109f09d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:37.700756 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:37.768721 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c09ec3-e0da-4272-b10b-5d9c6109f09d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:37.773215 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a8c77-667f-4ea9-a0e7-d0bf1eeb152d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:37.773993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a8c77-667f-4ea9-a0e7-d0bf1eeb152d service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:37.774344 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a8c77-667f-4ea9-a0e7-d0bf1eeb152d service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:37.774486 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88266dc1-5be8-4277-adf6-f6af803acfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:37.774617 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a8c77-667f-4ea9-a0e7-d0bf1eeb152d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:37.775183 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88266dc1-5be8-4277-adf6-f6af803acfdb admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:37.775467 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88266dc1-5be8-4277-adf6-f6af803acfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:37.775930 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88266dc1-5be8-4277-adf6-f6af803acfdb admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:37.776732 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88266dc1-5be8-4277-adf6-f6af803acfdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:37.776843 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c72a8c77-667f-4ea9-a0e7-d0bf1eeb152d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:37.780209 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88266dc1-5be8-4277-adf6-f6af803acfdb admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:37.791356 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a8c77-667f-4ea9-a0e7-d0bf1eeb152d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:37.792941 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a8c77-667f-4ea9-a0e7-d0bf1eeb152d service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:37.803630 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1355/2679] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:37 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:37.808173 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88266dc1-5be8-4277-adf6-f6af803acfdb admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:37.808292 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1325/2680] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:52:37.823205 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88266dc1-5be8-4277-adf6-f6af803acfdb admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:37.829824 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8db704-32aa-4296-8a88-730935aa7bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:37.830818 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8db704-32aa-4296-8a88-730935aa7bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:37.831304 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8db704-32aa-4296-8a88-730935aa7bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:37.831744 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8db704-32aa-4296-8a88-730935aa7bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:37.832661 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8db704-32aa-4296-8a88-730935aa7bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:37.834433 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8db704-32aa-4296-8a88-730935aa7bc1 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:37.858168 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1356/2681] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:37.858863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a8c77-667f-4ea9-a0e7-d0bf1eeb152d service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:37.871388 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a8c77-667f-4ea9-a0e7-d0bf1eeb152d service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:37.876973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c151a-722d-4b8f-8060-87df6f8dede1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:37.877647 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c151a-722d-4b8f-8060-87df6f8dede1 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:37.878069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c151a-722d-4b8f-8060-87df6f8dede1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:37.878366 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c151a-722d-4b8f-8060-87df6f8dede1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:37.879192 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c151a-722d-4b8f-8060-87df6f8dede1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:37.881290 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c151a-722d-4b8f-8060-87df6f8dede1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:37.910229 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8db704-32aa-4296-8a88-730935aa7bc1 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:37.923169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1326/2682] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:52:37.926175 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8db704-32aa-4296-8a88-730935aa7bc1 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:37.931709 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecddf312-b70d-43ae-9bd5-edb7d47ead55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:37.932667 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddf312-b70d-43ae-9bd5-edb7d47ead55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:37.932946 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddf312-b70d-43ae-9bd5-edb7d47ead55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:37.933219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddf312-b70d-43ae-9bd5-edb7d47ead55 admin admin] PATH_INFO: `/v3/projects/299d93234326404a9906caa9e7c5c4b7/users/483ab358234d40589e80210e6c684a5b/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:37.949928 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecddf312-b70d-43ae-9bd5-edb7d47ead55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=299d93234326404a9906caa9e7c5c4b7, user_id=483ab358234d40589e80210e6c684a5b, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:37.952773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecddf312-b70d-43ae-9bd5-edb7d47ead55 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:37.969572 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1357/2683] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:37 2022] PUT /identity/v3/projects/299d93234326404a9906caa9e7c5c4b7/users/483ab358234d40589e80210e6c684a5b/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:37.980763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75983fea-31d8-4b18-9c79-446129b77508 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:37.981060 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75983fea-31d8-4b18-9c79-446129b77508 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:37.981395 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75983fea-31d8-4b18-9c79-446129b77508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:38.012879 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-75983fea-31d8-4b18-9c79-446129b77508 None None] MFA Rules not processed for user `483ab358234d40589e80210e6c684a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:38.014316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-75983fea-31d8-4b18-9c79-446129b77508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:38.050925 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:38.089665 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1327/2684] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:38.102065 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecddf312-b70d-43ae-9bd5-edb7d47ead55 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:38.104271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ecddf312-b70d-43ae-9bd5-edb7d47ead55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:38.170430 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecddf312-b70d-43ae-9bd5-edb7d47ead55 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:38.174568 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e52867-04eb-47b2-ac8e-9919dfcc093b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:38.175232 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e52867-04eb-47b2-ac8e-9919dfcc093b service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:38.175518 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e52867-04eb-47b2-ac8e-9919dfcc093b service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:38.175797 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e52867-04eb-47b2-ac8e-9919dfcc093b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:38.184951 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e52867-04eb-47b2-ac8e-9919dfcc093b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:38.186409 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e52867-04eb-47b2-ac8e-9919dfcc093b service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:38.195342 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1358/2685] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:38.216422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75983fea-31d8-4b18-9c79-446129b77508 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:38.295106 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75983fea-31d8-4b18-9c79-446129b77508 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:38.301149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eaf45c-3a65-464c-a733-ff41d18ba833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:38.302017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaf45c-3a65-464c-a733-ff41d18ba833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:38.302301 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaf45c-3a65-464c-a733-ff41d18ba833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:38.302600 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaf45c-3a65-464c-a733-ff41d18ba833 admin admin] PATH_INFO: `/v3/users/483ab358234d40589e80210e6c684a5b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:38.303807 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eaf45c-3a65-464c-a733-ff41d18ba833 admin admin] RBAC: Authorizing `identity:delete_user(user_id=483ab358234d40589e80210e6c684a5b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:38.305968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eaf45c-3a65-464c-a733-ff41d18ba833 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:38.365909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e5eaf45c-3a65-464c-a733-ff41d18ba833 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '483ab358234d40589e80210e6c684a5b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:38.366877 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e5eaf45c-3a65-464c-a733-ff41d18ba833 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '483ab358234d40589e80210e6c684a5b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:38.374054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e5eaf45c-3a65-464c-a733-ff41d18ba833 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '483ab358234d40589e80210e6c684a5b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:38.374726 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e5eaf45c-3a65-464c-a733-ff41d18ba833 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '483ab358234d40589e80210e6c684a5b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:38.383222 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e5eaf45c-3a65-464c-a733-ff41d18ba833 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '483ab358234d40589e80210e6c684a5b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:38.403221 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1328/2686] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:38 2022] DELETE /identity/v3/users/483ab358234d40589e80210e6c684a5b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:38.408325 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7b0a5-cf47-4952-8a4b-b54ed553c9c5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:38.408662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7b0a5-cf47-4952-8a4b-b54ed553c9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:38.408950 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7b0a5-cf47-4952-8a4b-b54ed553c9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:38.425573 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-3fe7b0a5-cf47-4952-8a4b-b54ed553c9c5 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:38.426778 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3fe7b0a5-cf47-4952-8a4b-b54ed553c9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:38.489093 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1359/2687] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:38.499071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eaf45c-3a65-464c-a733-ff41d18ba833 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:38.500582 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e5eaf45c-3a65-464c-a733-ff41d18ba833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:38.565990 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eaf45c-3a65-464c-a733-ff41d18ba833 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:38.569669 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6af321-b0c7-43eb-8388-644e7a1244a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:38.570324 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6af321-b0c7-43eb-8388-644e7a1244a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:38.570609 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6af321-b0c7-43eb-8388-644e7a1244a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:38.570884 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6af321-b0c7-43eb-8388-644e7a1244a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:38.577507 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:38.582040 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6af321-b0c7-43eb-8388-644e7a1244a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:38.583572 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6af321-b0c7-43eb-8388-644e7a1244a0 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:38.596066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1329/2688] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:39.089075 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7b0a5-cf47-4952-8a4b-b54ed553c9c5 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:39.090558 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3fe7b0a5-cf47-4952-8a4b-b54ed553c9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:39.143483 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7b0a5-cf47-4952-8a4b-b54ed553c9c5 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:39.149020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b54485-6ead-4185-8d7a-87e51af34d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:39.150017 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b54485-6ead-4185-8d7a-87e51af34d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:39.150312 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b54485-6ead-4185-8d7a-87e51af34d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:39.150617 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b54485-6ead-4185-8d7a-87e51af34d3a admin admin] PATH_INFO: `/v3/projects/299d93234326404a9906caa9e7c5c4b7` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:39.151864 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b54485-6ead-4185-8d7a-87e51af34d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=299d93234326404a9906caa9e7c5c4b7)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:39.153873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b54485-6ead-4185-8d7a-87e51af34d3a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:39.156802 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:39.207376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-73b54485-6ead-4185-8d7a-87e51af34d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '299d93234326404a9906caa9e7c5c4b7', 'request_id': 'req-73b54485-6ead-4185-8d7a-87e51af34d3a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:39.217405 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-73b54485-6ead-4185-8d7a-87e51af34d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '299d93234326404a9906caa9e7c5c4b7', 'request_id': 'req-73b54485-6ead-4185-8d7a-87e51af34d3a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:39.225460 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-73b54485-6ead-4185-8d7a-87e51af34d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '299d93234326404a9906caa9e7c5c4b7', 'request_id': 'req-73b54485-6ead-4185-8d7a-87e51af34d3a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:39.237897 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-73b54485-6ead-4185-8d7a-87e51af34d3a admin admin] The token cache is being invalidate because project 299d93234326404a9906caa9e7c5c4b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:39.238248 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-73b54485-6ead-4185-8d7a-87e51af34d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:39.238837 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-73b54485-6ead-4185-8d7a-87e51af34d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:39.240491 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1360/2689] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:39 2022] DELETE /identity/v3/projects/299d93234326404a9906caa9e7c5c4b7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:39.245417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb28d14-eee1-4a81-ad36-66b8b6c63b06 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:39.245897 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb28d14-eee1-4a81-ad36-66b8b6c63b06 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:39.245999 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb28d14-eee1-4a81-ad36-66b8b6c63b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:39.269661 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-dfb28d14-eee1-4a81-ad36-66b8b6c63b06 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:39.271667 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dfb28d14-eee1-4a81-ad36-66b8b6c63b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:39.374013 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1330/2690] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:39.381913 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c3cb6-c043-406a-938d-baf9351c180a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:39.382211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c3cb6-c043-406a-938d-baf9351c180a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:39.382517 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c3cb6-c043-406a-938d-baf9351c180a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:39.402295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b59c3cb6-c043-406a-938d-baf9351c180a None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:39.403521 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b59c3cb6-c043-406a-938d-baf9351c180a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:39.415996 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1361/2691] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:39.417300 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb28d14-eee1-4a81-ad36-66b8b6c63b06 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:39.430706 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb28d14-eee1-4a81-ad36-66b8b6c63b06 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:39.435619 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d75f6-6aea-45aa-9116-9cba438d1328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:39.436288 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d75f6-6aea-45aa-9116-9cba438d1328 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:39.436629 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d75f6-6aea-45aa-9116-9cba438d1328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:39.437070 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d75f6-6aea-45aa-9116-9cba438d1328 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:39.437818 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d75f6-6aea-45aa-9116-9cba438d1328 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:52:39.438129 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d75f6-6aea-45aa-9116-9cba438d1328 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:39.440552 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d75f6-6aea-45aa-9116-9cba438d1328 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:39.458412 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1331/2692] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:52:39.463077 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c3cb6-c043-406a-938d-baf9351c180a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:39.475085 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c3cb6-c043-406a-938d-baf9351c180a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:39.480213 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059559f-849e-47c0-b8d5-fe722cce5f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:39.481021 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059559f-849e-47c0-b8d5-fe722cce5f84 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:39.481382 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059559f-849e-47c0-b8d5-fe722cce5f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:39.482721 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059559f-849e-47c0-b8d5-fe722cce5f84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:39.483257 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059559f-849e-47c0-b8d5-fe722cce5f84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:39.485592 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059559f-849e-47c0-b8d5-fe722cce5f84 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:39.532550 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1362/2693] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:39 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:39.534754 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d75f6-6aea-45aa-9116-9cba438d1328 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:39.546929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d75f6-6aea-45aa-9116-9cba438d1328 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:39.634964 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ed472-ae2b-416e-9601-ddf13aa7ace2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:39.635697 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ed472-ae2b-416e-9601-ddf13aa7ace2 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:39.635996 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ed472-ae2b-416e-9601-ddf13aa7ace2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:39.636288 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ed472-ae2b-416e-9601-ddf13aa7ace2 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:39.637069 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ed472-ae2b-416e-9601-ddf13aa7ace2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:39.641410 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ed472-ae2b-416e-9601-ddf13aa7ace2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:39.683108 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059559f-849e-47c0-b8d5-fe722cce5f84 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:39.700468 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1332/2694] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:39 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:52:39.703600 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059559f-849e-47c0-b8d5-fe722cce5f84 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:39.708925 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724204d-ff09-4cd5-b1ab-e15278579785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:39.709723 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724204d-ff09-4cd5-b1ab-e15278579785 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:39.710008 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724204d-ff09-4cd5-b1ab-e15278579785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:39.710286 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724204d-ff09-4cd5-b1ab-e15278579785 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:39.711144 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724204d-ff09-4cd5-b1ab-e15278579785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:39.713485 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724204d-ff09-4cd5-b1ab-e15278579785 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:39.726020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1363/2695] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:39.730571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ed472-ae2b-416e-9601-ddf13aa7ace2 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:39.744758 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ed472-ae2b-416e-9601-ddf13aa7ace2 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:39.752194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716f255-93cd-4460-8ce9-fc9ae6437c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:39.752915 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716f255-93cd-4460-8ce9-fc9ae6437c63 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:39.753771 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716f255-93cd-4460-8ce9-fc9ae6437c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:39.754095 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716f255-93cd-4460-8ce9-fc9ae6437c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:39.754879 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716f255-93cd-4460-8ce9-fc9ae6437c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:39.760738 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716f255-93cd-4460-8ce9-fc9ae6437c63 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:39.772036 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1333/2696] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:39.776238 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724204d-ff09-4cd5-b1ab-e15278579785 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:39.786922 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724204d-ff09-4cd5-b1ab-e15278579785 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:39.791838 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039064f-b062-4df0-a0ab-3a1ecd5461f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:39.793072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039064f-b062-4df0-a0ab-3a1ecd5461f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:39.793357 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039064f-b062-4df0-a0ab-3a1ecd5461f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:39.793641 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039064f-b062-4df0-a0ab-3a1ecd5461f7 admin admin] PATH_INFO: `/v3/projects/39e459f9e8a84fbdbda4fe76bc78e893/users/8ca88b375efa4d009cb1a325b39ce33c/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:39.813438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039064f-b062-4df0-a0ab-3a1ecd5461f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39e459f9e8a84fbdbda4fe76bc78e893, user_id=8ca88b375efa4d009cb1a325b39ce33c, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:39.816099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039064f-b062-4df0-a0ab-3a1ecd5461f7 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:39.835567 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1364/2697] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:39 2022] PUT /identity/v3/projects/39e459f9e8a84fbdbda4fe76bc78e893/users/8ca88b375efa4d009cb1a325b39ce33c/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:39.847628 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b931b-7985-47fc-b7b1-4d6c4d11df8d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:39.847833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b931b-7985-47fc-b7b1-4d6c4d11df8d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:39.848116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b931b-7985-47fc-b7b1-4d6c4d11df8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:39.877794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8e9b931b-7985-47fc-b7b1-4d6c4d11df8d None None] MFA Rules not processed for user `8ca88b375efa4d009cb1a325b39ce33c`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:39.879028 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8e9b931b-7985-47fc-b7b1-4d6c4d11df8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:39.912467 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:39.976143 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1334/2698] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:39.977950 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039064f-b062-4df0-a0ab-3a1ecd5461f7 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:40.054065 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039064f-b062-4df0-a0ab-3a1ecd5461f7 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:40.061722 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55397549-0fdc-456a-a5d8-8a1cabdc7e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:40.062618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55397549-0fdc-456a-a5d8-8a1cabdc7e4c admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:40.062818 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55397549-0fdc-456a-a5d8-8a1cabdc7e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:40.063281 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55397549-0fdc-456a-a5d8-8a1cabdc7e4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:40.064042 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55397549-0fdc-456a-a5d8-8a1cabdc7e4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:40.066151 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55397549-0fdc-456a-a5d8-8a1cabdc7e4c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:40.108752 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1365/2699] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:39 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:52:40.111784 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b931b-7985-47fc-b7b1-4d6c4d11df8d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:40.125026 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b931b-7985-47fc-b7b1-4d6c4d11df8d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:40.196751 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6184f8-d9e8-45cb-a505-f9d29e3f8e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:40.197420 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6184f8-d9e8-45cb-a505-f9d29e3f8e7a admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:40.197704 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6184f8-d9e8-45cb-a505-f9d29e3f8e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:40.197982 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6184f8-d9e8-45cb-a505-f9d29e3f8e7a admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:40.198673 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6184f8-d9e8-45cb-a505-f9d29e3f8e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:40.200707 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6184f8-d9e8-45cb-a505-f9d29e3f8e7a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:40.225434 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1335/2700] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:40 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:40.226935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55397549-0fdc-456a-a5d8-8a1cabdc7e4c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:40.238789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55397549-0fdc-456a-a5d8-8a1cabdc7e4c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:40.245944 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fbdbd0-1e10-45b8-91e3-b2bfe4c21a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:40.246634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fbdbd0-1e10-45b8-91e3-b2bfe4c21a1f admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:40.246925 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fbdbd0-1e10-45b8-91e3-b2bfe4c21a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:40.247209 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fbdbd0-1e10-45b8-91e3-b2bfe4c21a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:40.248465 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fbdbd0-1e10-45b8-91e3-b2bfe4c21a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:40.250108 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fbdbd0-1e10-45b8-91e3-b2bfe4c21a1f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:40.272549 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1366/2701] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:40.275090 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6184f8-d9e8-45cb-a505-f9d29e3f8e7a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:40.286538 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6184f8-d9e8-45cb-a505-f9d29e3f8e7a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:40.291446 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537dff10-8b7b-4905-a1c0-df2e26241867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:40.292112 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dff10-8b7b-4905-a1c0-df2e26241867 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:40.292403 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dff10-8b7b-4905-a1c0-df2e26241867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:40.292730 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dff10-8b7b-4905-a1c0-df2e26241867 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:40.293465 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537dff10-8b7b-4905-a1c0-df2e26241867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:40.295658 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537dff10-8b7b-4905-a1c0-df2e26241867 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:40.306114 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1336/2702] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:40.311027 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fbdbd0-1e10-45b8-91e3-b2bfe4c21a1f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:40.316131 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:40.324133 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fbdbd0-1e10-45b8-91e3-b2bfe4c21a1f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:40.333664 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d173f-17f9-4390-96e8-bdc6f98af444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:40.334633 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d173f-17f9-4390-96e8-bdc6f98af444 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:40.334923 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d173f-17f9-4390-96e8-bdc6f98af444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:40.335275 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d173f-17f9-4390-96e8-bdc6f98af444 admin admin] PATH_INFO: `/v3/projects/4894be0207d847888516eb6c3a677688/users/9abb527ae4e749169519285835de2285/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:40.350668 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d173f-17f9-4390-96e8-bdc6f98af444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4894be0207d847888516eb6c3a677688, user_id=9abb527ae4e749169519285835de2285, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:40.353350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d173f-17f9-4390-96e8-bdc6f98af444 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:40.380587 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1367/2703] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:40 2022] PUT /identity/v3/projects/4894be0207d847888516eb6c3a677688/users/9abb527ae4e749169519285835de2285/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:40.384166 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1371f-4163-4e1b-bd85-f209321efd60 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:40.384166 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1371f-4163-4e1b-bd85-f209321efd60 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:40.384405 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1371f-4163-4e1b-bd85-f209321efd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:40.417880 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9cd1371f-4163-4e1b-bd85-f209321efd60 None None] MFA Rules not processed for user `9abb527ae4e749169519285835de2285`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:40.419186 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9cd1371f-4163-4e1b-bd85-f209321efd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:40.509719 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1337/2704] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:40.514443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d173f-17f9-4390-96e8-bdc6f98af444 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:40.591957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d173f-17f9-4390-96e8-bdc6f98af444 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:40.598414 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb7cd8-afd8-4f6b-8db9-5eae1d1ec06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:40.599099 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb7cd8-afd8-4f6b-8db9-5eae1d1ec06f admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:40.599424 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb7cd8-afd8-4f6b-8db9-5eae1d1ec06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:40.599702 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb7cd8-afd8-4f6b-8db9-5eae1d1ec06f admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:40.600839 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb7cd8-afd8-4f6b-8db9-5eae1d1ec06f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:40.602774 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb7cd8-afd8-4f6b-8db9-5eae1d1ec06f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:40.645026 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1368/2705] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:40 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:40.645966 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1371f-4163-4e1b-bd85-f209321efd60 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:40.660137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1371f-4163-4e1b-bd85-f209321efd60 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:40.698062 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:40.729494 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d40d72-2dbc-4e6b-b8fb-93da81f5aa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:40.730266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d40d72-2dbc-4e6b-b8fb-93da81f5aa75 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:40.730563 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d40d72-2dbc-4e6b-b8fb-93da81f5aa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:40.730848 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d40d72-2dbc-4e6b-b8fb-93da81f5aa75 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:40.731561 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d40d72-2dbc-4e6b-b8fb-93da81f5aa75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:40.735535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d40d72-2dbc-4e6b-b8fb-93da81f5aa75 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:40.768149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1338/2706] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:40 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:40.768979 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb7cd8-afd8-4f6b-8db9-5eae1d1ec06f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:40.786487 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb7cd8-afd8-4f6b-8db9-5eae1d1ec06f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:40.794781 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949c42d-feec-40f3-9938-99a7097ec191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:40.795525 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949c42d-feec-40f3-9938-99a7097ec191 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:40.796204 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949c42d-feec-40f3-9938-99a7097ec191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:40.796204 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949c42d-feec-40f3-9938-99a7097ec191 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:40.796885 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2949c42d-feec-40f3-9938-99a7097ec191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:40.799130 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2949c42d-feec-40f3-9938-99a7097ec191 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:40.816765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1369/2707] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:52:40.819633 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d40d72-2dbc-4e6b-b8fb-93da81f5aa75 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:40.832698 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d40d72-2dbc-4e6b-b8fb-93da81f5aa75 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:40.843651 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00463e0-4b44-4639-9379-e79812133b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:40.844998 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00463e0-4b44-4639-9379-e79812133b79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:40.845583 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00463e0-4b44-4639-9379-e79812133b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:40.846398 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00463e0-4b44-4639-9379-e79812133b79 admin admin] PATH_INFO: `/v3/projects/3b1217eeb6f244eda1a920fefc616c73/users/b356613d9155438a9c37e815083ab027/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:40.871480 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00463e0-4b44-4639-9379-e79812133b79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b1217eeb6f244eda1a920fefc616c73, user_id=b356613d9155438a9c37e815083ab027, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:40.874407 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00463e0-4b44-4639-9379-e79812133b79 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:40.891410 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1339/2708] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:40 2022] PUT /identity/v3/projects/3b1217eeb6f244eda1a920fefc616c73/users/b356613d9155438a9c37e815083ab027/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:40.895848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949c42d-feec-40f3-9938-99a7097ec191 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:40.909720 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949c42d-feec-40f3-9938-99a7097ec191 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:40.982965 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa9ead-43d4-49f5-9851-202184de012a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:40.983751 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa9ead-43d4-49f5-9851-202184de012a admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:40.984106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa9ead-43d4-49f5-9851-202184de012a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:40.984451 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa9ead-43d4-49f5-9851-202184de012a admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:40.985530 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa9ead-43d4-49f5-9851-202184de012a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:40.987516 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa9ead-43d4-49f5-9851-202184de012a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:41.004079 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1370/2709] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:41.008463 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00463e0-4b44-4639-9379-e79812133b79 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:41.021113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00463e0-4b44-4639-9379-e79812133b79 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:41.026619 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377c219-7f89-4a36-85c4-aa09232d36ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:41.027675 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377c219-7f89-4a36-85c4-aa09232d36ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:41.028003 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377c219-7f89-4a36-85c4-aa09232d36ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:41.028351 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377c219-7f89-4a36-85c4-aa09232d36ae admin admin] PATH_INFO: `/v3/projects/3b1217eeb6f244eda1a920fefc616c73/users/b356613d9155438a9c37e815083ab027/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:41.031227 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377c219-7f89-4a36-85c4-aa09232d36ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b1217eeb6f244eda1a920fefc616c73, user_id=b356613d9155438a9c37e815083ab027, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:41.038358 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377c219-7f89-4a36-85c4-aa09232d36ae admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:41.050654 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1340/2710] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:41 2022] PUT /identity/v3/projects/3b1217eeb6f244eda1a920fefc616c73/users/b356613d9155438a9c37e815083ab027/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:41.062322 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f3ee0-883c-4b82-86e3-8ab547395a1f None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:41.062634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f3ee0-883c-4b82-86e3-8ab547395a1f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:41.062883 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f3ee0-883c-4b82-86e3-8ab547395a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:41.094303 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-fc5f3ee0-883c-4b82-86e3-8ab547395a1f None None] MFA Rules not processed for user `b356613d9155438a9c37e815083ab027`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:41.095615 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-fc5f3ee0-883c-4b82-86e3-8ab547395a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:41.146634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:41.186125 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1371/2711] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:41.197677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377c219-7f89-4a36-85c4-aa09232d36ae admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:41.199801 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5377c219-7f89-4a36-85c4-aa09232d36ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:41.289148 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377c219-7f89-4a36-85c4-aa09232d36ae admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:41.293479 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5174de6-1eaf-491c-b4b2-5e05f1844fc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:41.296865 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5174de6-1eaf-491c-b4b2-5e05f1844fc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:41.296865 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5174de6-1eaf-491c-b4b2-5e05f1844fc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:41.296865 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5174de6-1eaf-491c-b4b2-5e05f1844fc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:41.376079 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5174de6-1eaf-491c-b4b2-5e05f1844fc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:41.380250 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5174de6-1eaf-491c-b4b2-5e05f1844fc4 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:41.390495 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1341/2712] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:41.735259 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f3ee0-883c-4b82-86e3-8ab547395a1f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:41.741769 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-fc5f3ee0-883c-4b82-86e3-8ab547395a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:41.853299 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f3ee0-883c-4b82-86e3-8ab547395a1f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:41.857892 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9058576-dcb8-49ef-b580-bef4937cbb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:41.858751 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9058576-dcb8-49ef-b580-bef4937cbb11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:41.859033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9058576-dcb8-49ef-b580-bef4937cbb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:41.859304 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9058576-dcb8-49ef-b580-bef4937cbb11 admin admin] PATH_INFO: `/v3/users/d6a194d68415422fbc6ca75a8dbccf22` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:41.860764 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9058576-dcb8-49ef-b580-bef4937cbb11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6a194d68415422fbc6ca75a8dbccf22)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:41.862703 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9058576-dcb8-49ef-b580-bef4937cbb11 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:41.910536 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d9058576-dcb8-49ef-b580-bef4937cbb11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6a194d68415422fbc6ca75a8dbccf22'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:41.922047 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d9058576-dcb8-49ef-b580-bef4937cbb11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6a194d68415422fbc6ca75a8dbccf22'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:41.922699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d9058576-dcb8-49ef-b580-bef4937cbb11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6a194d68415422fbc6ca75a8dbccf22'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:41.929322 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d9058576-dcb8-49ef-b580-bef4937cbb11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6a194d68415422fbc6ca75a8dbccf22'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:41.929935 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d9058576-dcb8-49ef-b580-bef4937cbb11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6a194d68415422fbc6ca75a8dbccf22'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:41.942350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1372/2713] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:41 2022] DELETE /identity/v3/users/d6a194d68415422fbc6ca75a8dbccf22 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:42.116003 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5174de6-1eaf-491c-b4b2-5e05f1844fc4 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:42.129214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5174de6-1eaf-491c-b4b2-5e05f1844fc4 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:42.156620 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:42.196032 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710b64c-dd7e-4252-828b-bd216d83bd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:42.196864 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710b64c-dd7e-4252-828b-bd216d83bd80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:42.197155 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710b64c-dd7e-4252-828b-bd216d83bd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:42.197417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710b64c-dd7e-4252-828b-bd216d83bd80 admin admin] PATH_INFO: `/v3/projects/848d69e5041341488aafc3e6d26d491c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:42.198581 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710b64c-dd7e-4252-828b-bd216d83bd80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=848d69e5041341488aafc3e6d26d491c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:42.200525 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710b64c-dd7e-4252-828b-bd216d83bd80 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:42.246979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9710b64c-dd7e-4252-828b-bd216d83bd80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '848d69e5041341488aafc3e6d26d491c', 'request_id': 'req-9710b64c-dd7e-4252-828b-bd216d83bd80'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:42.253872 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9710b64c-dd7e-4252-828b-bd216d83bd80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '848d69e5041341488aafc3e6d26d491c', 'request_id': 'req-9710b64c-dd7e-4252-828b-bd216d83bd80'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:42.260212 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9710b64c-dd7e-4252-828b-bd216d83bd80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '848d69e5041341488aafc3e6d26d491c', 'request_id': 'req-9710b64c-dd7e-4252-828b-bd216d83bd80'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:42.271976 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9710b64c-dd7e-4252-828b-bd216d83bd80 admin admin] The token cache is being invalidate because project 848d69e5041341488aafc3e6d26d491c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:42.272267 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9710b64c-dd7e-4252-828b-bd216d83bd80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:42.272996 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9710b64c-dd7e-4252-828b-bd216d83bd80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:42.274513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1342/2714] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:42 2022] DELETE /identity/v3/projects/848d69e5041341488aafc3e6d26d491c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:42.280031 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207bfa4-a078-4d2b-9cd4-99616df9b630 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:42.280543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207bfa4-a078-4d2b-9cd4-99616df9b630 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:42.280647 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207bfa4-a078-4d2b-9cd4-99616df9b630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:42.299203 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-2207bfa4-a078-4d2b-9cd4-99616df9b630 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:42.300417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2207bfa4-a078-4d2b-9cd4-99616df9b630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:42.347866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:42.362180 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1373/2715] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:42.370149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447a4e5-82c2-450c-85cd-4ce666034984 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:42.370642 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447a4e5-82c2-450c-85cd-4ce666034984 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:42.370776 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447a4e5-82c2-450c-85cd-4ce666034984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:42.390379 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a447a4e5-82c2-450c-85cd-4ce666034984 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:42.391600 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a447a4e5-82c2-450c-85cd-4ce666034984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:42.399670 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1343/2716] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:42.404398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207bfa4-a078-4d2b-9cd4-99616df9b630 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:42.414276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207bfa4-a078-4d2b-9cd4-99616df9b630 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:42.419070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c476817-c2e8-4e1e-8c47-a3de441d110f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:42.420438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c476817-c2e8-4e1e-8c47-a3de441d110f admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:42.420866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c476817-c2e8-4e1e-8c47-a3de441d110f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:42.421144 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c476817-c2e8-4e1e-8c47-a3de441d110f admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:42.421911 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c476817-c2e8-4e1e-8c47-a3de441d110f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:52:42.422219 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c476817-c2e8-4e1e-8c47-a3de441d110f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:42.423863 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c476817-c2e8-4e1e-8c47-a3de441d110f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:42.436117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1374/2717] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:52:42.440364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447a4e5-82c2-450c-85cd-4ce666034984 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:42.449763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447a4e5-82c2-450c-85cd-4ce666034984 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:42.454460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500297e-8638-4e7e-be6a-14ef709abce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:42.455108 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500297e-8638-4e7e-be6a-14ef709abce8 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:42.455380 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500297e-8638-4e7e-be6a-14ef709abce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:42.455660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500297e-8638-4e7e-be6a-14ef709abce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:42.456335 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500297e-8638-4e7e-be6a-14ef709abce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:42.458455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500297e-8638-4e7e-be6a-14ef709abce8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:42.485458 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1344/2718] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:42 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:42.489623 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c476817-c2e8-4e1e-8c47-a3de441d110f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:42.500845 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c476817-c2e8-4e1e-8c47-a3de441d110f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:42.558967 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595ea3e-4d0f-4f88-bbca-20abb810425b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:42.559633 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595ea3e-4d0f-4f88-bbca-20abb810425b admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:42.559920 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595ea3e-4d0f-4f88-bbca-20abb810425b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:42.560776 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595ea3e-4d0f-4f88-bbca-20abb810425b admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:42.561568 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595ea3e-4d0f-4f88-bbca-20abb810425b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:42.563608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595ea3e-4d0f-4f88-bbca-20abb810425b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:42.583461 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1375/2719] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:42 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:42.587599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500297e-8638-4e7e-be6a-14ef709abce8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:42.598025 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500297e-8638-4e7e-be6a-14ef709abce8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:42.602936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0eea1-f4fa-4732-b78b-8c9406359372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:42.603612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0eea1-f4fa-4732-b78b-8c9406359372 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:42.603893 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0eea1-f4fa-4732-b78b-8c9406359372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:42.604167 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0eea1-f4fa-4732-b78b-8c9406359372 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:42.604929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0eea1-f4fa-4732-b78b-8c9406359372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:42.606575 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0eea1-f4fa-4732-b78b-8c9406359372 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:42.618133 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1345/2720] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:42.622123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595ea3e-4d0f-4f88-bbca-20abb810425b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:42.632694 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595ea3e-4d0f-4f88-bbca-20abb810425b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:42.637215 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb66ce7-928c-4bfb-8383-c59dcabceef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:42.637933 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb66ce7-928c-4bfb-8383-c59dcabceef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:42.638321 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb66ce7-928c-4bfb-8383-c59dcabceef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:42.638651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb66ce7-928c-4bfb-8383-c59dcabceef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:42.639437 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb66ce7-928c-4bfb-8383-c59dcabceef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:42.641048 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb66ce7-928c-4bfb-8383-c59dcabceef9 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:42.655513 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1376/2721] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:42.656922 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0eea1-f4fa-4732-b78b-8c9406359372 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:42.667191 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0eea1-f4fa-4732-b78b-8c9406359372 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:42.673109 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171748a6-c24e-4df8-a79d-8cb571fc1603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:42.674367 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171748a6-c24e-4df8-a79d-8cb571fc1603 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:42.674659 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171748a6-c24e-4df8-a79d-8cb571fc1603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:42.674943 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171748a6-c24e-4df8-a79d-8cb571fc1603 admin admin] PATH_INFO: `/v3/projects/01c427f452ff40b8b6eb680a23ed5ace/users/f13059803ed14f8895be3eb4ef4a638f/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:42.691512 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171748a6-c24e-4df8-a79d-8cb571fc1603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01c427f452ff40b8b6eb680a23ed5ace, user_id=f13059803ed14f8895be3eb4ef4a638f, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:42.694421 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171748a6-c24e-4df8-a79d-8cb571fc1603 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:42.707033 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1346/2722] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:42 2022] PUT /identity/v3/projects/01c427f452ff40b8b6eb680a23ed5ace/users/f13059803ed14f8895be3eb4ef4a638f/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:42.717867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f1f78-9844-4543-b0df-e861ea4cd59a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:42.718156 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f1f78-9844-4543-b0df-e861ea4cd59a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:42.718436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f1f78-9844-4543-b0df-e861ea4cd59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:42.746280 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a65f1f78-9844-4543-b0df-e861ea4cd59a None None] MFA Rules not processed for user `f13059803ed14f8895be3eb4ef4a638f`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:42.747483 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a65f1f78-9844-4543-b0df-e861ea4cd59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:42.814534 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1377/2723] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:42.825634 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171748a6-c24e-4df8-a79d-8cb571fc1603 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:42.827321 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-171748a6-c24e-4df8-a79d-8cb571fc1603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:42.890653 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:42.916606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171748a6-c24e-4df8-a79d-8cb571fc1603 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:42.922982 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710db70-83c8-49c6-8028-d4a650ac7ee2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:42.923845 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710db70-83c8-49c6-8028-d4a650ac7ee2 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:42.924295 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710db70-83c8-49c6-8028-d4a650ac7ee2 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:42.924757 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710db70-83c8-49c6-8028-d4a650ac7ee2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:42.933701 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710db70-83c8-49c6-8028-d4a650ac7ee2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:42.935863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710db70-83c8-49c6-8028-d4a650ac7ee2 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:42.945432 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1347/2724] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:43.028051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f1f78-9844-4543-b0df-e861ea4cd59a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:43.030000 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a65f1f78-9844-4543-b0df-e861ea4cd59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:43.089799 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:43.096485 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f1f78-9844-4543-b0df-e861ea4cd59a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:43.100626 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26930c-0c25-492a-9078-d6fd74bcca51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:43.101323 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26930c-0c25-492a-9078-d6fd74bcca51 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:43.101628 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26930c-0c25-492a-9078-d6fd74bcca51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:43.101930 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26930c-0c25-492a-9078-d6fd74bcca51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:43.103701 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0f26930c-0c25-492a-9078-d6fd74bcca51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:43.175691 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26930c-0c25-492a-9078-d6fd74bcca51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:43.177828 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26930c-0c25-492a-9078-d6fd74bcca51 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:43.189186 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1378/2725] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:52:43.202321 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710db70-83c8-49c6-8028-d4a650ac7ee2 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:43.273890 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710db70-83c8-49c6-8028-d4a650ac7ee2 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:43.279219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4c982-55f8-4bc2-a85d-c23275665d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:43.280110 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4c982-55f8-4bc2-a85d-c23275665d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:43.280396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4c982-55f8-4bc2-a85d-c23275665d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:43.280719 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4c982-55f8-4bc2-a85d-c23275665d97 admin admin] PATH_INFO: `/v3/users/f13059803ed14f8895be3eb4ef4a638f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:43.281956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4c982-55f8-4bc2-a85d-c23275665d97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f13059803ed14f8895be3eb4ef4a638f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:43.283924 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4c982-55f8-4bc2-a85d-c23275665d97 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:43.335132 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-67a4c982-55f8-4bc2-a85d-c23275665d97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f13059803ed14f8895be3eb4ef4a638f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:43.335785 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-67a4c982-55f8-4bc2-a85d-c23275665d97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f13059803ed14f8895be3eb4ef4a638f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:43.342847 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-67a4c982-55f8-4bc2-a85d-c23275665d97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f13059803ed14f8895be3eb4ef4a638f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:43.343499 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-67a4c982-55f8-4bc2-a85d-c23275665d97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f13059803ed14f8895be3eb4ef4a638f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:43.351471 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-67a4c982-55f8-4bc2-a85d-c23275665d97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f13059803ed14f8895be3eb4ef4a638f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:43.373463 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1348/2726] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:43 2022] DELETE /identity/v3/users/f13059803ed14f8895be3eb4ef4a638f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:43.378301 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc27f1-07df-4a4d-8954-25063efcc3e5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:43.378728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc27f1-07df-4a4d-8954-25063efcc3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:43.378862 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc27f1-07df-4a4d-8954-25063efcc3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:43.398881 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e5cc27f1-07df-4a4d-8954-25063efcc3e5 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:43.400083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e5cc27f1-07df-4a4d-8954-25063efcc3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:43.466862 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1379/2727] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:43.477791 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4c982-55f8-4bc2-a85d-c23275665d97 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:43.479227 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-67a4c982-55f8-4bc2-a85d-c23275665d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:43.543459 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4c982-55f8-4bc2-a85d-c23275665d97 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:43.547534 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee388a-59e4-4400-b31c-aa82a4e48d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:43.548214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee388a-59e4-4400-b31c-aa82a4e48d14 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:43.548582 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee388a-59e4-4400-b31c-aa82a4e48d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:43.548900 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee388a-59e4-4400-b31c-aa82a4e48d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:43.559467 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee388a-59e4-4400-b31c-aa82a4e48d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:43.561612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee388a-59e4-4400-b31c-aa82a4e48d14 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:43.566708 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:43.579276 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1349/2728] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:43.820848 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc27f1-07df-4a4d-8954-25063efcc3e5 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:43.822235 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e5cc27f1-07df-4a4d-8954-25063efcc3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:43.891730 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc27f1-07df-4a4d-8954-25063efcc3e5 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:43.895728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d091d5c-3ea6-4eba-ac15-361d93d01290 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:43.896651 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d091d5c-3ea6-4eba-ac15-361d93d01290 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:43.897055 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d091d5c-3ea6-4eba-ac15-361d93d01290 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:43.897334 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d091d5c-3ea6-4eba-ac15-361d93d01290 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:43.899615 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-5d091d5c-3ea6-4eba-ac15-361d93d01290 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:43.905700 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee388a-59e4-4400-b31c-aa82a4e48d14 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:43.907142 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5eee388a-59e4-4400-b31c-aa82a4e48d14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:43.920967 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee388a-59e4-4400-b31c-aa82a4e48d14 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:43.930973 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879b9c5-ac19-4a10-ae21-0e577c8505d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:43.931940 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879b9c5-ac19-4a10-ae21-0e577c8505d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:43.932396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879b9c5-ac19-4a10-ae21-0e577c8505d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:43.932677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879b9c5-ac19-4a10-ae21-0e577c8505d4 admin admin] PATH_INFO: `/v3/projects/01c427f452ff40b8b6eb680a23ed5ace` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:43.934156 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879b9c5-ac19-4a10-ae21-0e577c8505d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01c427f452ff40b8b6eb680a23ed5ace)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:43.936996 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879b9c5-ac19-4a10-ae21-0e577c8505d4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:43.975750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:43.980089 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d091d5c-3ea6-4eba-ac15-361d93d01290 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:43.981552 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d091d5c-3ea6-4eba-ac15-361d93d01290 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:43.987992 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3879b9c5-ac19-4a10-ae21-0e577c8505d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01c427f452ff40b8b6eb680a23ed5ace', 'request_id': 'req-3879b9c5-ac19-4a10-ae21-0e577c8505d4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:43.991446 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1380/2729] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:43 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:43.996706 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3879b9c5-ac19-4a10-ae21-0e577c8505d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01c427f452ff40b8b6eb680a23ed5ace', 'request_id': 'req-3879b9c5-ac19-4a10-ae21-0e577c8505d4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:44.004111 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3879b9c5-ac19-4a10-ae21-0e577c8505d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01c427f452ff40b8b6eb680a23ed5ace', 'request_id': 'req-3879b9c5-ac19-4a10-ae21-0e577c8505d4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:44.015742 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3879b9c5-ac19-4a10-ae21-0e577c8505d4 admin admin] The token cache is being invalidate because project 01c427f452ff40b8b6eb680a23ed5ace was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:44.016057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3879b9c5-ac19-4a10-ae21-0e577c8505d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:44.016831 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3879b9c5-ac19-4a10-ae21-0e577c8505d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:44.018906 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1350/2730] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:43 2022] DELETE /identity/v3/projects/01c427f452ff40b8b6eb680a23ed5ace => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:44.023731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f8358-08fb-424e-bdb6-d3cdc3d33397 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:44.024020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f8358-08fb-424e-bdb6-d3cdc3d33397 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:44.024297 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f8358-08fb-424e-bdb6-d3cdc3d33397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:44.047018 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-cf5f8358-08fb-424e-bdb6-d3cdc3d33397 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:44.048350 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-cf5f8358-08fb-424e-bdb6-d3cdc3d33397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:44.112834 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1381/2731] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:44.120752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2804816-8d26-4cd8-963b-63bff5cb4854 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:44.121072 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2804816-8d26-4cd8-963b-63bff5cb4854 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:44.121356 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2804816-8d26-4cd8-963b-63bff5cb4854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:44.139961 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a2804816-8d26-4cd8-963b-63bff5cb4854 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:44.141212 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a2804816-8d26-4cd8-963b-63bff5cb4854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:44.149706 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1351/2732] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:44.153999 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f8358-08fb-424e-bdb6-d3cdc3d33397 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:44.163514 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f8358-08fb-424e-bdb6-d3cdc3d33397 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:44.168583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da7f32-207d-4923-9e62-6f2d3cf0d736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:44.169252 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da7f32-207d-4923-9e62-6f2d3cf0d736 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:44.170033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da7f32-207d-4923-9e62-6f2d3cf0d736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:44.170366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da7f32-207d-4923-9e62-6f2d3cf0d736 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:44.171094 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da7f32-207d-4923-9e62-6f2d3cf0d736 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:52:44.171406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da7f32-207d-4923-9e62-6f2d3cf0d736 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:44.173198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da7f32-207d-4923-9e62-6f2d3cf0d736 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:44.185126 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1382/2733] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:52:44.190032 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2804816-8d26-4cd8-963b-63bff5cb4854 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:44.199612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2804816-8d26-4cd8-963b-63bff5cb4854 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:44.204556 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24f208-3ef4-4e98-ae93-d3d11432f72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:44.205205 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24f208-3ef4-4e98-ae93-d3d11432f72a admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:44.205488 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24f208-3ef4-4e98-ae93-d3d11432f72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:44.205760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24f208-3ef4-4e98-ae93-d3d11432f72a admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:44.206440 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24f208-3ef4-4e98-ae93-d3d11432f72a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:44.208355 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24f208-3ef4-4e98-ae93-d3d11432f72a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:44.233064 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1352/2734] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:44 2022] POST /identity/v3/projects => generated 405 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:44.237423 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da7f32-207d-4923-9e62-6f2d3cf0d736 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:44.248732 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da7f32-207d-4923-9e62-6f2d3cf0d736 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:44.317011 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289c969-99c6-4d22-be25-b2c8f7ddebc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:44.317608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289c969-99c6-4d22-be25-b2c8f7ddebc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:44.317895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289c969-99c6-4d22-be25-b2c8f7ddebc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:44.318180 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289c969-99c6-4d22-be25-b2c8f7ddebc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:44.318875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289c969-99c6-4d22-be25-b2c8f7ddebc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:44.320829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289c969-99c6-4d22-be25-b2c8f7ddebc1 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:44.353179 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1383/2735] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:44 2022] POST /identity/v3/users => generated 303 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:52:44.357907 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24f208-3ef4-4e98-ae93-d3d11432f72a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:44.379205 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24f208-3ef4-4e98-ae93-d3d11432f72a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:44.384518 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4847b-796c-4a45-9e68-0459677a0591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:44.385308 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4847b-796c-4a45-9e68-0459677a0591 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:44.385599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4847b-796c-4a45-9e68-0459677a0591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:44.385876 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4847b-796c-4a45-9e68-0459677a0591 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:44.386598 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4847b-796c-4a45-9e68-0459677a0591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:44.388279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4847b-796c-4a45-9e68-0459677a0591 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:44.398513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1353/2736] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:44.402577 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289c969-99c6-4d22-be25-b2c8f7ddebc1 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:44.423234 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289c969-99c6-4d22-be25-b2c8f7ddebc1 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:44.427864 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85948a-edbb-4379-b83f-170d823c46db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:44.428531 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85948a-edbb-4379-b83f-170d823c46db admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:44.428837 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85948a-edbb-4379-b83f-170d823c46db admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:44.429111 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85948a-edbb-4379-b83f-170d823c46db admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:44.429818 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85948a-edbb-4379-b83f-170d823c46db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:44.431392 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85948a-edbb-4379-b83f-170d823c46db admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:44.441787 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1384/2737] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:44.445929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4847b-796c-4a45-9e68-0459677a0591 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:44.456126 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4847b-796c-4a45-9e68-0459677a0591 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:44.460734 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb007e1-7e34-4475-a70a-ec428ca3b5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:44.461592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb007e1-7e34-4475-a70a-ec428ca3b5c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:44.461878 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb007e1-7e34-4475-a70a-ec428ca3b5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:44.462156 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb007e1-7e34-4475-a70a-ec428ca3b5c4 admin admin] PATH_INFO: `/v3/projects/0b087203f49b4743b42157382ed3de7f/users/73bd108ab371438db15e73b69d26770f/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:44.477086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb007e1-7e34-4475-a70a-ec428ca3b5c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b087203f49b4743b42157382ed3de7f, user_id=73bd108ab371438db15e73b69d26770f, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:44.479746 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb007e1-7e34-4475-a70a-ec428ca3b5c4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:44.493442 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1354/2738] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:44 2022] PUT /identity/v3/projects/0b087203f49b4743b42157382ed3de7f/users/73bd108ab371438db15e73b69d26770f/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:44.498413 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e83831-4bbd-4d06-abb8-21c4ca5d9a73 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:44.498703 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e83831-4bbd-4d06-abb8-21c4ca5d9a73 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:44.498982 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e83831-4bbd-4d06-abb8-21c4ca5d9a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:44.516940 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-89e83831-4bbd-4d06-abb8-21c4ca5d9a73 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:44.518142 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-89e83831-4bbd-4d06-abb8-21c4ca5d9a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:44.543949 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:44.577788 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1385/2739] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:44.587244 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb007e1-7e34-4475-a70a-ec428ca3b5c4 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:44.589014 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2fb007e1-7e34-4475-a70a-ec428ca3b5c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:44.654657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb007e1-7e34-4475-a70a-ec428ca3b5c4 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:44.658277 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1658d-f8dd-4e76-a124-68c32dd15ee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:44.658984 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1658d-f8dd-4e76-a124-68c32dd15ee7 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:44.659267 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1658d-f8dd-4e76-a124-68c32dd15ee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:44.659541 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1658d-f8dd-4e76-a124-68c32dd15ee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:44.668433 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1658d-f8dd-4e76-a124-68c32dd15ee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:44.670565 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1658d-f8dd-4e76-a124-68c32dd15ee7 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:44.679728 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1355/2740] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:45.339477 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d709d3-1eaa-4430-80b4-f0935ec0d6ed None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:45.340024 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d709d3-1eaa-4430-80b4-f0935ec0d6ed None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:45.340583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d709d3-1eaa-4430-80b4-f0935ec0d6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:45.390893 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-25d709d3-1eaa-4430-80b4-f0935ec0d6ed None None] MFA Rules not processed for user `73bd108ab371438db15e73b69d26770f`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:45.393448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-25d709d3-1eaa-4430-80b4-f0935ec0d6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:45.478002 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1386/2741] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:45 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:45.482654 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1658d-f8dd-4e76-a124-68c32dd15ee7 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:45.492644 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1658d-f8dd-4e76-a124-68c32dd15ee7 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:45.498113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980836b-e540-4681-abd1-b23c0b28f32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:45.498767 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980836b-e540-4681-abd1-b23c0b28f32d admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:45.499031 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980836b-e540-4681-abd1-b23c0b28f32d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:45.499299 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980836b-e540-4681-abd1-b23c0b28f32d admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:45.499980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980836b-e540-4681-abd1-b23c0b28f32d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:45.501967 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980836b-e540-4681-abd1-b23c0b28f32d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:45.510458 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:45.532552 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1356/2742] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:45 2022] POST /identity/v3/projects => generated 403 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:45.536858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d709d3-1eaa-4430-80b4-f0935ec0d6ed None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:45.549533 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d709d3-1eaa-4430-80b4-f0935ec0d6ed None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:45.604578 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9a4d6-159c-4b01-be08-fa0e2b204c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:45.605249 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9a4d6-159c-4b01-be08-fa0e2b204c4f admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:45.605551 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9a4d6-159c-4b01-be08-fa0e2b204c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:45.605808 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9a4d6-159c-4b01-be08-fa0e2b204c4f admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:45.606485 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9a4d6-159c-4b01-be08-fa0e2b204c4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:45.609201 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9a4d6-159c-4b01-be08-fa0e2b204c4f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:45.629948 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1387/2743] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:45 2022] POST /identity/v3/users => generated 308 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:45.634640 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980836b-e540-4681-abd1-b23c0b28f32d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:45.645313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980836b-e540-4681-abd1-b23c0b28f32d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:45.649848 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acceee-3959-41ea-af5e-933b8c0735d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:45.650497 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acceee-3959-41ea-af5e-933b8c0735d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:45.650779 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acceee-3959-41ea-af5e-933b8c0735d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:45.651055 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acceee-3959-41ea-af5e-933b8c0735d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:45.651771 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acceee-3959-41ea-af5e-933b8c0735d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:45.653411 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acceee-3959-41ea-af5e-933b8c0735d1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:45.665494 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1357/2744] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:45.670084 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9a4d6-159c-4b01-be08-fa0e2b204c4f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:45.680006 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9a4d6-159c-4b01-be08-fa0e2b204c4f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:45.684882 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6d26c-6113-4b0e-9123-49609ddeeaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:45.686465 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6d26c-6113-4b0e-9123-49609ddeeaa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:45.686810 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6d26c-6113-4b0e-9123-49609ddeeaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:45.687150 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6d26c-6113-4b0e-9123-49609ddeeaa2 admin admin] PATH_INFO: `/v3/projects/1237d0ec757340648356a4c28cf6d009/users/c3b43bc0d66849d0812dfe8e84f928ea/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:45.706387 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def6d26c-6113-4b0e-9123-49609ddeeaa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1237d0ec757340648356a4c28cf6d009, user_id=c3b43bc0d66849d0812dfe8e84f928ea, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:45.709068 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def6d26c-6113-4b0e-9123-49609ddeeaa2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:45.722609 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1388/2745] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:45 2022] PUT /identity/v3/projects/1237d0ec757340648356a4c28cf6d009/users/c3b43bc0d66849d0812dfe8e84f928ea/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:45.726663 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acceee-3959-41ea-af5e-933b8c0735d1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:45.737889 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acceee-3959-41ea-af5e-933b8c0735d1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:45.795251 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da8f1e-ed01-4098-b77d-273bb6a1d94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:45.795972 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da8f1e-ed01-4098-b77d-273bb6a1d94a admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:45.796256 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da8f1e-ed01-4098-b77d-273bb6a1d94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:45.796557 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da8f1e-ed01-4098-b77d-273bb6a1d94a admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:45.797363 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da8f1e-ed01-4098-b77d-273bb6a1d94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:45.799070 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da8f1e-ed01-4098-b77d-273bb6a1d94a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:45.808632 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1358/2746] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:45.813394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6d26c-6113-4b0e-9123-49609ddeeaa2 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:45.825316 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6d26c-6113-4b0e-9123-49609ddeeaa2 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:45.829922 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b8d66-d893-4fe8-a473-a76885a50e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:45.830796 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b8d66-d893-4fe8-a473-a76885a50e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:45.831072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b8d66-d893-4fe8-a473-a76885a50e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:45.831347 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b8d66-d893-4fe8-a473-a76885a50e31 admin admin] PATH_INFO: `/v3/projects/1237d0ec757340648356a4c28cf6d009/users/c3b43bc0d66849d0812dfe8e84f928ea/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:45.833316 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b8d66-d893-4fe8-a473-a76885a50e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1237d0ec757340648356a4c28cf6d009, user_id=c3b43bc0d66849d0812dfe8e84f928ea, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:45.835942 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b8d66-d893-4fe8-a473-a76885a50e31 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:45.846251 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1389/2747] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:45 2022] PUT /identity/v3/projects/1237d0ec757340648356a4c28cf6d009/users/c3b43bc0d66849d0812dfe8e84f928ea/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:46.470218 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e02e5-1498-4cd3-994e-8784b3a5ab54 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:46.470600 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e02e5-1498-4cd3-994e-8784b3a5ab54 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:46.470890 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e02e5-1498-4cd3-994e-8784b3a5ab54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:46.499086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e35e02e5-1498-4cd3-994e-8784b3a5ab54 None None] MFA Rules not processed for user `c3b43bc0d66849d0812dfe8e84f928ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:46.501023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e35e02e5-1498-4cd3-994e-8784b3a5ab54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:46.576889 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1359/2748] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:46 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:47.615032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b8d66-d893-4fe8-a473-a76885a50e31 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:47.633602 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:47.685533 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b8d66-d893-4fe8-a473-a76885a50e31 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:47.690398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b324ba-9d54-4696-a773-560e208911d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:47.691310 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b324ba-9d54-4696-a773-560e208911d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:47.691573 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b324ba-9d54-4696-a773-560e208911d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:47.691844 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b324ba-9d54-4696-a773-560e208911d5 admin admin] PATH_INFO: `/v3/users/73bd108ab371438db15e73b69d26770f` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:47.693036 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b324ba-9d54-4696-a773-560e208911d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73bd108ab371438db15e73b69d26770f)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:47.694940 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b324ba-9d54-4696-a773-560e208911d5 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:47.743575 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a5b324ba-9d54-4696-a773-560e208911d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73bd108ab371438db15e73b69d26770f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:47.757012 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a5b324ba-9d54-4696-a773-560e208911d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73bd108ab371438db15e73b69d26770f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:47.757717 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a5b324ba-9d54-4696-a773-560e208911d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73bd108ab371438db15e73b69d26770f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:47.766899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a5b324ba-9d54-4696-a773-560e208911d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73bd108ab371438db15e73b69d26770f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:47.767593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a5b324ba-9d54-4696-a773-560e208911d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73bd108ab371438db15e73b69d26770f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:47.783395 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1390/2749] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:47 2022] DELETE /identity/v3/users/73bd108ab371438db15e73b69d26770f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:47.968323 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e02e5-1498-4cd3-994e-8784b3a5ab54 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:47.989803 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e02e5-1498-4cd3-994e-8784b3a5ab54 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:48.049391 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f845d7-8f78-484b-ab37-62e8ef30986b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:48.050255 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f845d7-8f78-484b-ab37-62e8ef30986b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:48.050523 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f845d7-8f78-484b-ab37-62e8ef30986b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:48.050797 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f845d7-8f78-484b-ab37-62e8ef30986b admin admin] PATH_INFO: `/v3/projects/0b087203f49b4743b42157382ed3de7f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:48.052012 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f845d7-8f78-484b-ab37-62e8ef30986b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b087203f49b4743b42157382ed3de7f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:48.054085 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f845d7-8f78-484b-ab37-62e8ef30986b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:48.055550 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:48.100678 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e0f845d7-8f78-484b-ab37-62e8ef30986b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b087203f49b4743b42157382ed3de7f', 'request_id': 'req-e0f845d7-8f78-484b-ab37-62e8ef30986b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:48.107905 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e0f845d7-8f78-484b-ab37-62e8ef30986b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b087203f49b4743b42157382ed3de7f', 'request_id': 'req-e0f845d7-8f78-484b-ab37-62e8ef30986b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:48.113866 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e0f845d7-8f78-484b-ab37-62e8ef30986b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b087203f49b4743b42157382ed3de7f', 'request_id': 'req-e0f845d7-8f78-484b-ab37-62e8ef30986b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:48.124727 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e0f845d7-8f78-484b-ab37-62e8ef30986b admin admin] The token cache is being invalidate because project 0b087203f49b4743b42157382ed3de7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:48.125013 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e0f845d7-8f78-484b-ab37-62e8ef30986b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:48.125624 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e0f845d7-8f78-484b-ab37-62e8ef30986b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:48.127356 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1360/2750] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:47 2022] DELETE /identity/v3/projects/0b087203f49b4743b42157382ed3de7f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:48.131486 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b324ba-9d54-4696-a773-560e208911d5 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:48.132992 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a5b324ba-9d54-4696-a773-560e208911d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:48.148771 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b324ba-9d54-4696-a773-560e208911d5 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:48.204493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32574adf-db48-43e3-924b-878eb100ccef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:48.205390 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32574adf-db48-43e3-924b-878eb100ccef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:48.205672 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32574adf-db48-43e3-924b-878eb100ccef admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:48.205950 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32574adf-db48-43e3-924b-878eb100ccef admin admin] PATH_INFO: `/v3/users/c3b43bc0d66849d0812dfe8e84f928ea` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:48.207117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32574adf-db48-43e3-924b-878eb100ccef admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3b43bc0d66849d0812dfe8e84f928ea)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:48.209063 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32574adf-db48-43e3-924b-878eb100ccef admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:48.245264 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:48.256574 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-32574adf-db48-43e3-924b-878eb100ccef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3b43bc0d66849d0812dfe8e84f928ea'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:48.269054 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-32574adf-db48-43e3-924b-878eb100ccef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3b43bc0d66849d0812dfe8e84f928ea'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:48.269772 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-32574adf-db48-43e3-924b-878eb100ccef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3b43bc0d66849d0812dfe8e84f928ea'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:48.276437 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-32574adf-db48-43e3-924b-878eb100ccef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3b43bc0d66849d0812dfe8e84f928ea'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:48.277194 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-32574adf-db48-43e3-924b-878eb100ccef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3b43bc0d66849d0812dfe8e84f928ea'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:48.289772 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1391/2751] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:48 2022] DELETE /identity/v3/users/c3b43bc0d66849d0812dfe8e84f928ea => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:48.461424 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f845d7-8f78-484b-ab37-62e8ef30986b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:48.463117 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e0f845d7-8f78-484b-ab37-62e8ef30986b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:48.491395 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f845d7-8f78-484b-ab37-62e8ef30986b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:48.550470 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09174fd7-1c0e-447f-85d7-6c36383f81b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:48.551238 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09174fd7-1c0e-447f-85d7-6c36383f81b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:48.551520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09174fd7-1c0e-447f-85d7-6c36383f81b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:48.551800 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09174fd7-1c0e-447f-85d7-6c36383f81b6 admin admin] PATH_INFO: `/v3/projects/1237d0ec757340648356a4c28cf6d009` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:48.553014 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09174fd7-1c0e-447f-85d7-6c36383f81b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1237d0ec757340648356a4c28cf6d009)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:48.554942 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09174fd7-1c0e-447f-85d7-6c36383f81b6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:48.601041 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-09174fd7-1c0e-447f-85d7-6c36383f81b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1237d0ec757340648356a4c28cf6d009', 'request_id': 'req-09174fd7-1c0e-447f-85d7-6c36383f81b6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:48.608461 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-09174fd7-1c0e-447f-85d7-6c36383f81b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1237d0ec757340648356a4c28cf6d009', 'request_id': 'req-09174fd7-1c0e-447f-85d7-6c36383f81b6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:48.614411 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-09174fd7-1c0e-447f-85d7-6c36383f81b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1237d0ec757340648356a4c28cf6d009', 'request_id': 'req-09174fd7-1c0e-447f-85d7-6c36383f81b6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:48.626001 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-09174fd7-1c0e-447f-85d7-6c36383f81b6 admin admin] The token cache is being invalidate because project 1237d0ec757340648356a4c28cf6d009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:48.626287 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-09174fd7-1c0e-447f-85d7-6c36383f81b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:48.626909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-09174fd7-1c0e-447f-85d7-6c36383f81b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:48.628417 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1361/2752] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:48 2022] DELETE /identity/v3/projects/1237d0ec757340648356a4c28cf6d009 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:48.633305 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e2f58-b6b6-4bba-837a-d375e6da1453 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:48.633784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e2f58-b6b6-4bba-837a-d375e6da1453 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:48.633885 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e2f58-b6b6-4bba-837a-d375e6da1453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:48.678995 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-944e2f58-b6b6-4bba-837a-d375e6da1453 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:48.680180 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-944e2f58-b6b6-4bba-837a-d375e6da1453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:48.736517 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1392/2753] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:48.745382 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15b221-d70d-407f-9547-06aa683001e4 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:48.745670 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15b221-d70d-407f-9547-06aa683001e4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:48.745944 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15b221-d70d-407f-9547-06aa683001e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:48.764386 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6f15b221-d70d-407f-9547-06aa683001e4 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:48.765591 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6f15b221-d70d-407f-9547-06aa683001e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:48.773362 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1362/2754] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:48.777413 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e2f58-b6b6-4bba-837a-d375e6da1453 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:48.786863 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e2f58-b6b6-4bba-837a-d375e6da1453 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:48.791586 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84fd9b-7451-4bf9-821c-dfd509bda160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:48.792233 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84fd9b-7451-4bf9-821c-dfd509bda160 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:48.792527 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84fd9b-7451-4bf9-821c-dfd509bda160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:48.792822 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84fd9b-7451-4bf9-821c-dfd509bda160 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:48.793568 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84fd9b-7451-4bf9-821c-dfd509bda160 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:52:48.793877 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84fd9b-7451-4bf9-821c-dfd509bda160 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:48.795962 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84fd9b-7451-4bf9-821c-dfd509bda160 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:48.807672 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1393/2755] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:52:48.812047 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15b221-d70d-407f-9547-06aa683001e4 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:48.821725 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15b221-d70d-407f-9547-06aa683001e4 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:48.826734 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2ced3-08ed-4479-8c47-9a2b73889de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:48.827384 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2ced3-08ed-4479-8c47-9a2b73889de0 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:48.827671 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2ced3-08ed-4479-8c47-9a2b73889de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:48.827952 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2ced3-08ed-4479-8c47-9a2b73889de0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:48.828688 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd2ced3-08ed-4479-8c47-9a2b73889de0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:48.830612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd2ced3-08ed-4479-8c47-9a2b73889de0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:48.841531 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:48.864913 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1363/2756] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:48 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:48.865983 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84fd9b-7451-4bf9-821c-dfd509bda160 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:48.877732 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84fd9b-7451-4bf9-821c-dfd509bda160 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:48.950755 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c1273-77c9-45f3-8319-611bebb48a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:48.951201 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2ced3-08ed-4479-8c47-9a2b73889de0 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:48.951639 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c1273-77c9-45f3-8319-611bebb48a8a admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:48.951908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c1273-77c9-45f3-8319-611bebb48a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:48.952179 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c1273-77c9-45f3-8319-611bebb48a8a admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:48.953113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8bd2ced3-08ed-4479-8c47-9a2b73889de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:48.953608 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c1273-77c9-45f3-8319-611bebb48a8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:48.955801 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c1273-77c9-45f3-8319-611bebb48a8a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:48.967677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2ced3-08ed-4479-8c47-9a2b73889de0 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:48.974490 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53ae23-88d5-41e6-ab70-6e99e1ef908e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:48.975712 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53ae23-88d5-41e6-ab70-6e99e1ef908e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:48.975860 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53ae23-88d5-41e6-ab70-6e99e1ef908e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:48.976075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53ae23-88d5-41e6-ab70-6e99e1ef908e admin admin] PATH_INFO: `/v3/users/8ca88b375efa4d009cb1a325b39ce33c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:48.977491 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53ae23-88d5-41e6-ab70-6e99e1ef908e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ca88b375efa4d009cb1a325b39ce33c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:48.979376 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53ae23-88d5-41e6-ab70-6e99e1ef908e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:48.981670 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1394/2757] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:48 2022] POST /identity/v3/users => generated 282 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:48.987194 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c1273-77c9-45f3-8319-611bebb48a8a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:48.999231 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c1273-77c9-45f3-8319-611bebb48a8a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:49.005378 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a52249-c90e-4cc8-8752-a91e875bf782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:49.006285 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a52249-c90e-4cc8-8752-a91e875bf782 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:49.006629 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a52249-c90e-4cc8-8752-a91e875bf782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:49.006991 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a52249-c90e-4cc8-8752-a91e875bf782 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:49.008025 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a52249-c90e-4cc8-8752-a91e875bf782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:49.010062 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a52249-c90e-4cc8-8752-a91e875bf782 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:49.011908 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:49.027723 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1395/2758] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:52:49.029455 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a52249-c90e-4cc8-8752-a91e875bf782 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:49.035712 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ba53ae23-88d5-41e6-ab70-6e99e1ef908e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ca88b375efa4d009cb1a325b39ce33c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:49.036744 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ba53ae23-88d5-41e6-ab70-6e99e1ef908e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ca88b375efa4d009cb1a325b39ce33c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:49.040803 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a52249-c90e-4cc8-8752-a91e875bf782 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:49.046942 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66762ebf-a6d0-42ae-a98a-2a18e61bbc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:49.047593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66762ebf-a6d0-42ae-a98a-2a18e61bbc52 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:49.047866 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66762ebf-a6d0-42ae-a98a-2a18e61bbc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:49.048146 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66762ebf-a6d0-42ae-a98a-2a18e61bbc52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:49.048905 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66762ebf-a6d0-42ae-a98a-2a18e61bbc52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:49.050048 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ba53ae23-88d5-41e6-ab70-6e99e1ef908e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ca88b375efa4d009cb1a325b39ce33c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:49.050476 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66762ebf-a6d0-42ae-a98a-2a18e61bbc52 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:49.050765 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ba53ae23-88d5-41e6-ab70-6e99e1ef908e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ca88b375efa4d009cb1a325b39ce33c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:49.057996 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ba53ae23-88d5-41e6-ab70-6e99e1ef908e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ca88b375efa4d009cb1a325b39ce33c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:49.061239 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1396/2759] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:52:49.065316 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66762ebf-a6d0-42ae-a98a-2a18e61bbc52 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:49.066951 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-66762ebf-a6d0-42ae-a98a-2a18e61bbc52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:49.076291 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1364/2760] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:48 2022] DELETE /identity/v3/users/8ca88b375efa4d009cb1a325b39ce33c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:52:49.080210 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66762ebf-a6d0-42ae-a98a-2a18e61bbc52 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:49.080438 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76772612-ea8d-45aa-a0cc-0353f55fd39c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:49.080752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76772612-ea8d-45aa-a0cc-0353f55fd39c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:49.081028 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76772612-ea8d-45aa-a0cc-0353f55fd39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:49.103930 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-76772612-ea8d-45aa-a0cc-0353f55fd39c None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:49.106673 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-76772612-ea8d-45aa-a0cc-0353f55fd39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:49.139722 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0956aaf-90c1-404c-bc7d-1807886ab994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:49.140679 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0956aaf-90c1-404c-bc7d-1807886ab994 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:49.140957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0956aaf-90c1-404c-bc7d-1807886ab994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:49.141214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0956aaf-90c1-404c-bc7d-1807886ab994 admin admin] PATH_INFO: `/v3/projects/6f7a3d3143c84b2ea6a252adcf450593/users/0f88750ba7d24ce68e8f9c21ffab61fe/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:49.156662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0956aaf-90c1-404c-bc7d-1807886ab994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f7a3d3143c84b2ea6a252adcf450593, user_id=0f88750ba7d24ce68e8f9c21ffab61fe, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:49.159320 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0956aaf-90c1-404c-bc7d-1807886ab994 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:49.172566 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1397/2761] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:49 2022] PUT /identity/v3/projects/6f7a3d3143c84b2ea6a252adcf450593/users/0f88750ba7d24ce68e8f9c21ffab61fe/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:52:49.173472 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1365/2762] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:49.182649 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f16977-ee5d-4988-aca9-2f931447f403 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:49.182942 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f16977-ee5d-4988-aca9-2f931447f403 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:49.183070 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76772612-ea8d-45aa-a0cc-0353f55fd39c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:49.183222 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f16977-ee5d-4988-aca9-2f931447f403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:49.184392 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-76772612-ea8d-45aa-a0cc-0353f55fd39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:49.209293 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-04f16977-ee5d-4988-aca9-2f931447f403 None None] MFA Rules not processed for user `0f88750ba7d24ce68e8f9c21ffab61fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:49.210483 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-04f16977-ee5d-4988-aca9-2f931447f403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:49.258959 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:49.270401 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76772612-ea8d-45aa-a0cc-0353f55fd39c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:49.280394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1398/2763] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:49 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:49.284864 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f16977-ee5d-4988-aca9-2f931447f403 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:49.322996 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab84f7-618c-4d69-89ff-0246b6f417e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:49.323579 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab84f7-618c-4d69-89ff-0246b6f417e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:49.323926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab84f7-618c-4d69-89ff-0246b6f417e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:49.324270 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab84f7-618c-4d69-89ff-0246b6f417e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:49.341845 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:49.346388 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f16977-ee5d-4988-aca9-2f931447f403 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:49.352303 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a603c-1206-4a2a-a65c-8bab5d4e5fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:49.352984 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a603c-1206-4a2a-a65c-8bab5d4e5fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:49.353266 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a603c-1206-4a2a-a65c-8bab5d4e5fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:49.353537 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a603c-1206-4a2a-a65c-8bab5d4e5fe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:49.354214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a603c-1206-4a2a-a65c-8bab5d4e5fe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:49.356104 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a603c-1206-4a2a-a65c-8bab5d4e5fe5 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:49.382525 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1399/2764] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:49 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:52:49.386542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a603c-1206-4a2a-a65c-8bab5d4e5fe5 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:49.386692 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab84f7-618c-4d69-89ff-0246b6f417e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:49.388637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab84f7-618c-4d69-89ff-0246b6f417e1 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:49.398789 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1366/2765] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:52:49.457954 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a603c-1206-4a2a-a65c-8bab5d4e5fe5 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:49.462673 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47f774-ea8f-4cbb-8207-02efd145e805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:49.463324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47f774-ea8f-4cbb-8207-02efd145e805 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:49.463601 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47f774-ea8f-4cbb-8207-02efd145e805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:49.463875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47f774-ea8f-4cbb-8207-02efd145e805 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:49.464592 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47f774-ea8f-4cbb-8207-02efd145e805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:49.467150 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47f774-ea8f-4cbb-8207-02efd145e805 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:49.490902 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1400/2766] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:49 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:52:49.492324 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab84f7-618c-4d69-89ff-0246b6f417e1 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:49.502586 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab84f7-618c-4d69-89ff-0246b6f417e1 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:49.507565 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8ce06-fd02-4f33-bb84-fa584e31db0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:49.508231 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8ce06-fd02-4f33-bb84-fa584e31db0a admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:49.508546 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8ce06-fd02-4f33-bb84-fa584e31db0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:49.508832 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8ce06-fd02-4f33-bb84-fa584e31db0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:49.509578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8ce06-fd02-4f33-bb84-fa584e31db0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:49.511177 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8ce06-fd02-4f33-bb84-fa584e31db0a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:49.522003 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1367/2767] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:49.526229 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47f774-ea8f-4cbb-8207-02efd145e805 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:49.536754 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47f774-ea8f-4cbb-8207-02efd145e805 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:49.541712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c896f59-eb0c-4473-97eb-d090f4e50809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:49.542590 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c896f59-eb0c-4473-97eb-d090f4e50809 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:49.542870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c896f59-eb0c-4473-97eb-d090f4e50809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:49.543146 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c896f59-eb0c-4473-97eb-d090f4e50809 admin admin] PATH_INFO: `/v3/projects/603edf30f2d641e3a4ce1491157924a6/users/56e3af8dfe664ffea6477391ed2664a7/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:49.570831 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c896f59-eb0c-4473-97eb-d090f4e50809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=603edf30f2d641e3a4ce1491157924a6, user_id=56e3af8dfe664ffea6477391ed2664a7, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:49.573572 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c896f59-eb0c-4473-97eb-d090f4e50809 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:49.587575 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1401/2768] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:49 2022] PUT /identity/v3/projects/603edf30f2d641e3a4ce1491157924a6/users/56e3af8dfe664ffea6477391ed2664a7/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:52:49.592243 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8ce06-fd02-4f33-bb84-fa584e31db0a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:49.602446 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8ce06-fd02-4f33-bb84-fa584e31db0a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:49.659199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e5ca4-efab-4f43-a60c-77ac1184935f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:49.659895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e5ca4-efab-4f43-a60c-77ac1184935f admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:49.660180 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e5ca4-efab-4f43-a60c-77ac1184935f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:49.660924 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e5ca4-efab-4f43-a60c-77ac1184935f admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:49.661212 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e5ca4-efab-4f43-a60c-77ac1184935f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:49.662861 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e5ca4-efab-4f43-a60c-77ac1184935f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:49.673203 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1368/2769] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:52:49.677565 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c896f59-eb0c-4473-97eb-d090f4e50809 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:49.685796 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e5ca4-efab-4f43-a60c-77ac1184935f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:49.687991 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-287e5ca4-efab-4f43-a60c-77ac1184935f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:49.689312 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c896f59-eb0c-4473-97eb-d090f4e50809 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:49.694108 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aeaabb-a057-40d7-83b7-c325f6f4d4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:49.695065 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aeaabb-a057-40d7-83b7-c325f6f4d4f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:49.695419 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aeaabb-a057-40d7-83b7-c325f6f4d4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:49.695718 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aeaabb-a057-40d7-83b7-c325f6f4d4f4 admin admin] PATH_INFO: `/v3/projects/603edf30f2d641e3a4ce1491157924a6/users/56e3af8dfe664ffea6477391ed2664a7/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:49.698297 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aeaabb-a057-40d7-83b7-c325f6f4d4f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=603edf30f2d641e3a4ce1491157924a6, user_id=56e3af8dfe664ffea6477391ed2664a7, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:49.701313 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aeaabb-a057-40d7-83b7-c325f6f4d4f4 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:49.702691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e5ca4-efab-4f43-a60c-77ac1184935f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:49.707843 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea254cda-d5c5-44fd-85a1-c1e9210dc2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:49.709253 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea254cda-d5c5-44fd-85a1-c1e9210dc2a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:49.709571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea254cda-d5c5-44fd-85a1-c1e9210dc2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:49.709851 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea254cda-d5c5-44fd-85a1-c1e9210dc2a6 admin admin] PATH_INFO: `/v3/projects/39e459f9e8a84fbdbda4fe76bc78e893` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:49.711237 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea254cda-d5c5-44fd-85a1-c1e9210dc2a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39e459f9e8a84fbdbda4fe76bc78e893)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:49.713308 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea254cda-d5c5-44fd-85a1-c1e9210dc2a6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:49.713894 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1402/2770] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:49 2022] PUT /identity/v3/projects/603edf30f2d641e3a4ce1491157924a6/users/56e3af8dfe664ffea6477391ed2664a7/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:49.724163 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09889a32-713c-428a-8ce9-134c39a3e45b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:49.724474 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09889a32-713c-428a-8ce9-134c39a3e45b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:49.724773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09889a32-713c-428a-8ce9-134c39a3e45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:49.751831 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-09889a32-713c-428a-8ce9-134c39a3e45b None None] MFA Rules not processed for user `56e3af8dfe664ffea6477391ed2664a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:49.752530 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:49.753078 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-09889a32-713c-428a-8ce9-134c39a3e45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:49.767580 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ea254cda-d5c5-44fd-85a1-c1e9210dc2a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39e459f9e8a84fbdbda4fe76bc78e893', 'request_id': 'req-ea254cda-d5c5-44fd-85a1-c1e9210dc2a6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:49.774885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ea254cda-d5c5-44fd-85a1-c1e9210dc2a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39e459f9e8a84fbdbda4fe76bc78e893', 'request_id': 'req-ea254cda-d5c5-44fd-85a1-c1e9210dc2a6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:49.780738 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ea254cda-d5c5-44fd-85a1-c1e9210dc2a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39e459f9e8a84fbdbda4fe76bc78e893', 'request_id': 'req-ea254cda-d5c5-44fd-85a1-c1e9210dc2a6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:49.792352 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ea254cda-d5c5-44fd-85a1-c1e9210dc2a6 admin admin] The token cache is being invalidate because project 39e459f9e8a84fbdbda4fe76bc78e893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:49.792671 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ea254cda-d5c5-44fd-85a1-c1e9210dc2a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:49.793325 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ea254cda-d5c5-44fd-85a1-c1e9210dc2a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:49.794993 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1369/2771] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:49 2022] DELETE /identity/v3/projects/39e459f9e8a84fbdbda4fe76bc78e893 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:49.798687 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea254cda-d5c5-44fd-85a1-c1e9210dc2a6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:49.800023 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ea254cda-d5c5-44fd-85a1-c1e9210dc2a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:49.824401 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1403/2772] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:49 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:49.835943 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09889a32-713c-428a-8ce9-134c39a3e45b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:49.837329 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-09889a32-713c-428a-8ce9-134c39a3e45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:49.858271 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:49.864815 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea254cda-d5c5-44fd-85a1-c1e9210dc2a6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:49.869455 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c479d10-1635-4608-b31c-a8eab6643830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:49.870333 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c479d10-1635-4608-b31c-a8eab6643830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:49.870612 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c479d10-1635-4608-b31c-a8eab6643830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:49.870884 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c479d10-1635-4608-b31c-a8eab6643830 admin admin] PATH_INFO: `/v3/users/9abb527ae4e749169519285835de2285` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:49.872085 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c479d10-1635-4608-b31c-a8eab6643830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9abb527ae4e749169519285835de2285)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:49.874548 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c479d10-1635-4608-b31c-a8eab6643830 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:49.896483 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09889a32-713c-428a-8ce9-134c39a3e45b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:49.900889 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc0912-cbb6-42af-99c2-97a3bb57c915 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:49.901685 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc0912-cbb6-42af-99c2-97a3bb57c915 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:49.901968 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc0912-cbb6-42af-99c2-97a3bb57c915 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:49.902245 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc0912-cbb6-42af-99c2-97a3bb57c915 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:49.912727 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc0912-cbb6-42af-99c2-97a3bb57c915 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:49.914163 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc0912-cbb6-42af-99c2-97a3bb57c915 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:49.921768 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1c479d10-1635-4608-b31c-a8eab6643830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9abb527ae4e749169519285835de2285'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:49.922426 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1c479d10-1635-4608-b31c-a8eab6643830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9abb527ae4e749169519285835de2285'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:49.923949 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1404/2773] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:49 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:52:49.930058 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1c479d10-1635-4608-b31c-a8eab6643830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9abb527ae4e749169519285835de2285'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:49.930719 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1c479d10-1635-4608-b31c-a8eab6643830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9abb527ae4e749169519285835de2285'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:49.941460 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1c479d10-1635-4608-b31c-a8eab6643830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9abb527ae4e749169519285835de2285'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:49.964464 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1370/2774] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:49 2022] DELETE /identity/v3/users/9abb527ae4e749169519285835de2285 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:52:50.258107 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc0912-cbb6-42af-99c2-97a3bb57c915 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:50.278435 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc0912-cbb6-42af-99c2-97a3bb57c915 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:50.347226 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e10a2-1f10-4f24-84f5-99aafa450c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:50.348208 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e10a2-1f10-4f24-84f5-99aafa450c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:50.348632 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e10a2-1f10-4f24-84f5-99aafa450c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:50.349005 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e10a2-1f10-4f24-84f5-99aafa450c54 admin admin] PATH_INFO: `/v3/projects/4894be0207d847888516eb6c3a677688` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:50.350256 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e10a2-1f10-4f24-84f5-99aafa450c54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4894be0207d847888516eb6c3a677688)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:50.352331 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e10a2-1f10-4f24-84f5-99aafa450c54 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:50.363190 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c479d10-1635-4608-b31c-a8eab6643830 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:50.364690 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1c479d10-1635-4608-b31c-a8eab6643830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:50.377544 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c479d10-1635-4608-b31c-a8eab6643830 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:50.382559 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f236a93-f94e-47ed-9a41-81a268d802c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:50.383425 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f236a93-f94e-47ed-9a41-81a268d802c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:50.383708 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f236a93-f94e-47ed-9a41-81a268d802c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:50.383985 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f236a93-f94e-47ed-9a41-81a268d802c5 admin admin] PATH_INFO: `/v3/users/0f88750ba7d24ce68e8f9c21ffab61fe` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:50.385327 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f236a93-f94e-47ed-9a41-81a268d802c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f88750ba7d24ce68e8f9c21ffab61fe)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:50.387189 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f236a93-f94e-47ed-9a41-81a268d802c5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:50.401942 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8e2e10a2-1f10-4f24-84f5-99aafa450c54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4894be0207d847888516eb6c3a677688', 'request_id': 'req-8e2e10a2-1f10-4f24-84f5-99aafa450c54'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:50.409979 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8e2e10a2-1f10-4f24-84f5-99aafa450c54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4894be0207d847888516eb6c3a677688', 'request_id': 'req-8e2e10a2-1f10-4f24-84f5-99aafa450c54'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:50.417680 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8e2e10a2-1f10-4f24-84f5-99aafa450c54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4894be0207d847888516eb6c3a677688', 'request_id': 'req-8e2e10a2-1f10-4f24-84f5-99aafa450c54'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:50.425087 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:50.429297 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8e2e10a2-1f10-4f24-84f5-99aafa450c54 admin admin] The token cache is being invalidate because project 4894be0207d847888516eb6c3a677688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:50.429583 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8e2e10a2-1f10-4f24-84f5-99aafa450c54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:50.430326 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8e2e10a2-1f10-4f24-84f5-99aafa450c54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:50.431852 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1405/2775] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:50 2022] DELETE /identity/v3/projects/4894be0207d847888516eb6c3a677688 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:50.436333 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e10a2-1f10-4f24-84f5-99aafa450c54 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:50.437637 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8e2e10a2-1f10-4f24-84f5-99aafa450c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:50.442777 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7f236a93-f94e-47ed-9a41-81a268d802c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f88750ba7d24ce68e8f9c21ffab61fe'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:50.443492 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7f236a93-f94e-47ed-9a41-81a268d802c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f88750ba7d24ce68e8f9c21ffab61fe'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:50.451791 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7f236a93-f94e-47ed-9a41-81a268d802c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f88750ba7d24ce68e8f9c21ffab61fe'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:50.452744 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7f236a93-f94e-47ed-9a41-81a268d802c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f88750ba7d24ce68e8f9c21ffab61fe'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:50.460086 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7f236a93-f94e-47ed-9a41-81a268d802c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f88750ba7d24ce68e8f9c21ffab61fe'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:50.477678 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1371/2776] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:50 2022] DELETE /identity/v3/users/0f88750ba7d24ce68e8f9c21ffab61fe => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:50.482110 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cc317-3d27-4d89-a8a5-8f8ee05dc1a8 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:50.482407 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cc317-3d27-4d89-a8a5-8f8ee05dc1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:50.482691 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cc317-3d27-4d89-a8a5-8f8ee05dc1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:50.491368 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:50.500868 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-2e9cc317-3d27-4d89-a8a5-8f8ee05dc1a8 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:50.502208 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2e9cc317-3d27-4d89-a8a5-8f8ee05dc1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:50.506281 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e10a2-1f10-4f24-84f5-99aafa450c54 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:50.571025 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fce07f-39e9-4ceb-892e-59d50e98d6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:50.571899 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fce07f-39e9-4ceb-892e-59d50e98d6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:50.572187 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fce07f-39e9-4ceb-892e-59d50e98d6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:50.572463 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fce07f-39e9-4ceb-892e-59d50e98d6a9 admin admin] PATH_INFO: `/v3/users/b356613d9155438a9c37e815083ab027` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:50.572936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1372/2777] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:52:50.577244 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fce07f-39e9-4ceb-892e-59d50e98d6a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b356613d9155438a9c37e815083ab027)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:50.579150 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fce07f-39e9-4ceb-892e-59d50e98d6a9 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:50.582964 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cc317-3d27-4d89-a8a5-8f8ee05dc1a8 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:50.584290 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2e9cc317-3d27-4d89-a8a5-8f8ee05dc1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:50.626606 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-70fce07f-39e9-4ceb-892e-59d50e98d6a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b356613d9155438a9c37e815083ab027'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:50.638303 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-70fce07f-39e9-4ceb-892e-59d50e98d6a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b356613d9155438a9c37e815083ab027'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:50.638979 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-70fce07f-39e9-4ceb-892e-59d50e98d6a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b356613d9155438a9c37e815083ab027'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:50.642462 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cc317-3d27-4d89-a8a5-8f8ee05dc1a8 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:50.646042 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-70fce07f-39e9-4ceb-892e-59d50e98d6a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b356613d9155438a9c37e815083ab027'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:50.646191 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76b49c-42e8-4abb-910e-a6c71cc1ecbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:50.646698 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-70fce07f-39e9-4ceb-892e-59d50e98d6a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b356613d9155438a9c37e815083ab027'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:50.646816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76b49c-42e8-4abb-910e-a6c71cc1ecbd service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:50.647049 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76b49c-42e8-4abb-910e-a6c71cc1ecbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:50.647333 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76b49c-42e8-4abb-910e-a6c71cc1ecbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:50.649150 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3b76b49c-42e8-4abb-910e-a6c71cc1ecbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:50.660154 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1406/2778] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:50 2022] DELETE /identity/v3/users/b356613d9155438a9c37e815083ab027 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:52:50.665145 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76b49c-42e8-4abb-910e-a6c71cc1ecbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:50.666630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76b49c-42e8-4abb-910e-a6c71cc1ecbd service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:50.677237 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1373/2779] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:52:51.030158 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fce07f-39e9-4ceb-892e-59d50e98d6a9 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:51.031704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-70fce07f-39e9-4ceb-892e-59d50e98d6a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:51.064170 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76b49c-42e8-4abb-910e-a6c71cc1ecbd service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:51.065689 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3b76b49c-42e8-4abb-910e-a6c71cc1ecbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:51.082052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76b49c-42e8-4abb-910e-a6c71cc1ecbd service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:51.132814 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fce07f-39e9-4ceb-892e-59d50e98d6a9 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:51.141228 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:51.147793 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884190a-1477-42a5-a6c0-0ac181e54412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:51.149331 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884190a-1477-42a5-a6c0-0ac181e54412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:51.149981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884190a-1477-42a5-a6c0-0ac181e54412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:51.150569 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884190a-1477-42a5-a6c0-0ac181e54412 admin admin] PATH_INFO: `/v3/projects/3b1217eeb6f244eda1a920fefc616c73` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:51.151962 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884190a-1477-42a5-a6c0-0ac181e54412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b1217eeb6f244eda1a920fefc616c73)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:51.153373 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044ac06-27cc-4d0c-a0ac-22cf7905bb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:51.154729 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884190a-1477-42a5-a6c0-0ac181e54412 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:51.155255 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044ac06-27cc-4d0c-a0ac-22cf7905bb7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:51.155564 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044ac06-27cc-4d0c-a0ac-22cf7905bb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:51.155850 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044ac06-27cc-4d0c-a0ac-22cf7905bb7d admin admin] PATH_INFO: `/v3/projects/6f7a3d3143c84b2ea6a252adcf450593` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:51.157165 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044ac06-27cc-4d0c-a0ac-22cf7905bb7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f7a3d3143c84b2ea6a252adcf450593)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:51.159692 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044ac06-27cc-4d0c-a0ac-22cf7905bb7d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:51.178499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:51.206097 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b884190a-1477-42a5-a6c0-0ac181e54412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b1217eeb6f244eda1a920fefc616c73', 'request_id': 'req-b884190a-1477-42a5-a6c0-0ac181e54412'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:51.207289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9044ac06-27cc-4d0c-a0ac-22cf7905bb7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f7a3d3143c84b2ea6a252adcf450593', 'request_id': 'req-9044ac06-27cc-4d0c-a0ac-22cf7905bb7d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:51.213807 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b884190a-1477-42a5-a6c0-0ac181e54412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b1217eeb6f244eda1a920fefc616c73', 'request_id': 'req-b884190a-1477-42a5-a6c0-0ac181e54412'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:51.216140 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9044ac06-27cc-4d0c-a0ac-22cf7905bb7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f7a3d3143c84b2ea6a252adcf450593', 'request_id': 'req-9044ac06-27cc-4d0c-a0ac-22cf7905bb7d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:51.220385 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b884190a-1477-42a5-a6c0-0ac181e54412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b1217eeb6f244eda1a920fefc616c73', 'request_id': 'req-b884190a-1477-42a5-a6c0-0ac181e54412'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:51.222263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9044ac06-27cc-4d0c-a0ac-22cf7905bb7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f7a3d3143c84b2ea6a252adcf450593', 'request_id': 'req-9044ac06-27cc-4d0c-a0ac-22cf7905bb7d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:51.231073 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b884190a-1477-42a5-a6c0-0ac181e54412 admin admin] The token cache is being invalidate because project 3b1217eeb6f244eda1a920fefc616c73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:51.231430 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b884190a-1477-42a5-a6c0-0ac181e54412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:51.232101 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b884190a-1477-42a5-a6c0-0ac181e54412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:51.233173 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9044ac06-27cc-4d0c-a0ac-22cf7905bb7d admin admin] The token cache is being invalidate because project 6f7a3d3143c84b2ea6a252adcf450593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:51.233458 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9044ac06-27cc-4d0c-a0ac-22cf7905bb7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:51.233699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1407/2780] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:51 2022] DELETE /identity/v3/projects/3b1217eeb6f244eda1a920fefc616c73 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:51.237238 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9044ac06-27cc-4d0c-a0ac-22cf7905bb7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:51.239186 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1374/2781] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:51 2022] DELETE /identity/v3/projects/6f7a3d3143c84b2ea6a252adcf450593 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:51.243010 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884190a-1477-42a5-a6c0-0ac181e54412 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:51.244485 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b884190a-1477-42a5-a6c0-0ac181e54412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:51.317919 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884190a-1477-42a5-a6c0-0ac181e54412 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:51.383649 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ac03f-d6bb-408a-9ac8-c189e1dbefe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:51.384573 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ac03f-d6bb-408a-9ac8-c189e1dbefe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:51.384865 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ac03f-d6bb-408a-9ac8-c189e1dbefe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:51.385139 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ac03f-d6bb-408a-9ac8-c189e1dbefe4 admin admin] PATH_INFO: `/v3/users/56e3af8dfe664ffea6477391ed2664a7` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:51.386981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ac03f-d6bb-408a-9ac8-c189e1dbefe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56e3af8dfe664ffea6477391ed2664a7)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:51.389028 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ac03f-d6bb-408a-9ac8-c189e1dbefe4 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:51.443337 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b58ac03f-d6bb-408a-9ac8-c189e1dbefe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56e3af8dfe664ffea6477391ed2664a7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:51.452312 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:51.458321 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b58ac03f-d6bb-408a-9ac8-c189e1dbefe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56e3af8dfe664ffea6477391ed2664a7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:51.459172 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b58ac03f-d6bb-408a-9ac8-c189e1dbefe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56e3af8dfe664ffea6477391ed2664a7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:51.467929 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b58ac03f-d6bb-408a-9ac8-c189e1dbefe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56e3af8dfe664ffea6477391ed2664a7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:51.468728 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b58ac03f-d6bb-408a-9ac8-c189e1dbefe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56e3af8dfe664ffea6477391ed2664a7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:51.485443 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1408/2782] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:52:51 2022] DELETE /identity/v3/users/56e3af8dfe664ffea6477391ed2664a7 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:51.766680 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044ac06-27cc-4d0c-a0ac-22cf7905bb7d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:51.768157 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9044ac06-27cc-4d0c-a0ac-22cf7905bb7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:51.781977 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044ac06-27cc-4d0c-a0ac-22cf7905bb7d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:51.838135 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ddf04-fd9b-4df2-9690-f30e81b5406b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:51.839026 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ddf04-fd9b-4df2-9690-f30e81b5406b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:51.839309 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ddf04-fd9b-4df2-9690-f30e81b5406b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:51.839587 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ddf04-fd9b-4df2-9690-f30e81b5406b admin admin] PATH_INFO: `/v3/projects/603edf30f2d641e3a4ce1491157924a6` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:51.840794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ddf04-fd9b-4df2-9690-f30e81b5406b admin admin] RBAC: Authorizing `identity:delete_project(project_id=603edf30f2d641e3a4ce1491157924a6)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:51.843389 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ddf04-fd9b-4df2-9690-f30e81b5406b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:51.888559 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-960ddf04-fd9b-4df2-9690-f30e81b5406b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '603edf30f2d641e3a4ce1491157924a6', 'request_id': 'req-960ddf04-fd9b-4df2-9690-f30e81b5406b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:51.895887 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-960ddf04-fd9b-4df2-9690-f30e81b5406b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '603edf30f2d641e3a4ce1491157924a6', 'request_id': 'req-960ddf04-fd9b-4df2-9690-f30e81b5406b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:51.901413 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-960ddf04-fd9b-4df2-9690-f30e81b5406b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '603edf30f2d641e3a4ce1491157924a6', 'request_id': 'req-960ddf04-fd9b-4df2-9690-f30e81b5406b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:51.912613 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-960ddf04-fd9b-4df2-9690-f30e81b5406b admin admin] The token cache is being invalidate because project 603edf30f2d641e3a4ce1491157924a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:52:51.912896 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-960ddf04-fd9b-4df2-9690-f30e81b5406b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:51.913509 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-960ddf04-fd9b-4df2-9690-f30e81b5406b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:52:51.915034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1375/2783] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:52:51 2022] DELETE /identity/v3/projects/603edf30f2d641e3a4ce1491157924a6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:51.920981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b2fd6-5bb8-4932-a4de-28c92283a6ce None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:51.921273 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b2fd6-5bb8-4932-a4de-28c92283a6ce None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:51.921579 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b2fd6-5bb8-4932-a4de-28c92283a6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:51.939835 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c75b2fd6-5bb8-4932-a4de-28c92283a6ce None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:51.941083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c75b2fd6-5bb8-4932-a4de-28c92283a6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:51.999279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1409/2784] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:52.008409 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1f5e1-9bb3-4850-9868-8eb2fd7b725a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:52.008733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1f5e1-9bb3-4850-9868-8eb2fd7b725a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:52.009027 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1f5e1-9bb3-4850-9868-8eb2fd7b725a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:52.027884 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-28a1f5e1-9bb3-4850-9868-8eb2fd7b725a None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:52.029168 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-28a1f5e1-9bb3-4850-9868-8eb2fd7b725a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:52.036965 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1376/2785] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:52.041030 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b2fd6-5bb8-4932-a4de-28c92283a6ce None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:52.050560 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b2fd6-5bb8-4932-a4de-28c92283a6ce None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:52.055061 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6df192-5047-477a-a07f-ad687af6682a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:52.055701 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6df192-5047-477a-a07f-ad687af6682a admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:52.055983 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6df192-5047-477a-a07f-ad687af6682a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:52.056259 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6df192-5047-477a-a07f-ad687af6682a admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:52.057007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6df192-5047-477a-a07f-ad687af6682a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:52:52.057315 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6df192-5047-477a-a07f-ad687af6682a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:52.058901 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6df192-5047-477a-a07f-ad687af6682a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:52.070787 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1410/2786] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:52:52.075100 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1f5e1-9bb3-4850-9868-8eb2fd7b725a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:52.084670 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1f5e1-9bb3-4850-9868-8eb2fd7b725a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:52.089184 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd756262-5f4e-4384-b220-ac730397ebb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:52.089819 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd756262-5f4e-4384-b220-ac730397ebb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:52.090102 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd756262-5f4e-4384-b220-ac730397ebb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:52.090378 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd756262-5f4e-4384-b220-ac730397ebb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:52.091114 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd756262-5f4e-4384-b220-ac730397ebb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:52.093141 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd756262-5f4e-4384-b220-ac730397ebb7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:52.096291 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:52.119857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1377/2787] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:52 2022] POST /identity/v3/projects => generated 409 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:52:52.124454 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6df192-5047-477a-a07f-ad687af6682a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:52.134354 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6df192-5047-477a-a07f-ad687af6682a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:52.195626 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e61990-0f77-43e1-a82a-8ce12ba72cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:52.196295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e61990-0f77-43e1-a82a-8ce12ba72cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:52.196604 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e61990-0f77-43e1-a82a-8ce12ba72cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:52.196879 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e61990-0f77-43e1-a82a-8ce12ba72cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:52.197555 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e61990-0f77-43e1-a82a-8ce12ba72cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:52.199446 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e61990-0f77-43e1-a82a-8ce12ba72cb6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:52.219584 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1411/2788] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:52 2022] POST /identity/v3/users => generated 305 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:52:52.222896 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd756262-5f4e-4384-b220-ac730397ebb7 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:52.233140 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd756262-5f4e-4384-b220-ac730397ebb7 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:52.237972 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff7ca1-7583-48af-8cb0-bb273a9e6de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:52.238619 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff7ca1-7583-48af-8cb0-bb273a9e6de9 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:52.238912 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff7ca1-7583-48af-8cb0-bb273a9e6de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:52.239193 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff7ca1-7583-48af-8cb0-bb273a9e6de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:52.239914 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff7ca1-7583-48af-8cb0-bb273a9e6de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:52.241569 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff7ca1-7583-48af-8cb0-bb273a9e6de9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:52.252334 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1378/2789] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:52.256207 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e61990-0f77-43e1-a82a-8ce12ba72cb6 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:52.266861 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e61990-0f77-43e1-a82a-8ce12ba72cb6 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:52.271471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48802405-5581-499a-9498-08765d7d6490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:52.272152 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48802405-5581-499a-9498-08765d7d6490 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:52.272436 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48802405-5581-499a-9498-08765d7d6490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:52.272756 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48802405-5581-499a-9498-08765d7d6490 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:52.273471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48802405-5581-499a-9498-08765d7d6490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:52.275058 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48802405-5581-499a-9498-08765d7d6490 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:52.284911 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1412/2790] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:52.289186 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff7ca1-7583-48af-8cb0-bb273a9e6de9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:52.299657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff7ca1-7583-48af-8cb0-bb273a9e6de9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:52.304246 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccf303-226d-4ee5-a1c2-24f5dbaf8dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:52.305137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccf303-226d-4ee5-a1c2-24f5dbaf8dff admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:52.305424 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccf303-226d-4ee5-a1c2-24f5dbaf8dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:52.305703 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccf303-226d-4ee5-a1c2-24f5dbaf8dff admin admin] PATH_INFO: `/v3/projects/9e9f830e25dd4dec968f0db17f0b328e/users/7c2f0479b8c44f1d9aee443ec540a048/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:52.321794 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ccf303-226d-4ee5-a1c2-24f5dbaf8dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e9f830e25dd4dec968f0db17f0b328e, user_id=7c2f0479b8c44f1d9aee443ec540a048, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:52.324449 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ccf303-226d-4ee5-a1c2-24f5dbaf8dff admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:52.336995 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1379/2791] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:52 2022] PUT /identity/v3/projects/9e9f830e25dd4dec968f0db17f0b328e/users/7c2f0479b8c44f1d9aee443ec540a048/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:52.347127 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc5669-89c3-45df-ae11-e25a3bd4a61c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:52.347420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc5669-89c3-45df-ae11-e25a3bd4a61c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:52.347705 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc5669-89c3-45df-ae11-e25a3bd4a61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:52.374872 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-58cc5669-89c3-45df-ae11-e25a3bd4a61c None None] MFA Rules not processed for user `7c2f0479b8c44f1d9aee443ec540a048`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:52.376070 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-58cc5669-89c3-45df-ae11-e25a3bd4a61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:52.408962 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:52.441904 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1413/2792] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:52 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:52.446359 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccf303-226d-4ee5-a1c2-24f5dbaf8dff admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:52.507660 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccf303-226d-4ee5-a1c2-24f5dbaf8dff admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:52.512357 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab80d6-604c-4855-827d-bdc96f980cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:52.513064 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab80d6-604c-4855-827d-bdc96f980cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:52.513352 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab80d6-604c-4855-827d-bdc96f980cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:52.513634 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab80d6-604c-4855-827d-bdc96f980cb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:52.514322 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab80d6-604c-4855-827d-bdc96f980cb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:52.516259 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab80d6-604c-4855-827d-bdc96f980cb4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:52.540360 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1380/2793] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:52:52 2022] POST /identity/v3/projects => generated 405 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:52.544946 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc5669-89c3-45df-ae11-e25a3bd4a61c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:52.555691 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc5669-89c3-45df-ae11-e25a3bd4a61c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:52.609800 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877d97b-5e71-4803-b48b-825805acbd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:52.610705 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877d97b-5e71-4803-b48b-825805acbd0b admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:52.610991 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877d97b-5e71-4803-b48b-825805acbd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:52.611268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877d97b-5e71-4803-b48b-825805acbd0b admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:52.611949 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877d97b-5e71-4803-b48b-825805acbd0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:52.613896 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877d97b-5e71-4803-b48b-825805acbd0b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:52.633204 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1414/2794] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:52:52 2022] POST /identity/v3/users => generated 309 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:52:52.637137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab80d6-604c-4855-827d-bdc96f980cb4 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:52.647252 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab80d6-604c-4855-827d-bdc96f980cb4 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:52.652050 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6fcc0-0cb7-4c94-8a85-5adec54ea58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:52.652740 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6fcc0-0cb7-4c94-8a85-5adec54ea58f admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:52.653012 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6fcc0-0cb7-4c94-8a85-5adec54ea58f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:52.653287 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6fcc0-0cb7-4c94-8a85-5adec54ea58f admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:52.654000 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6fcc0-0cb7-4c94-8a85-5adec54ea58f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:52.655597 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6fcc0-0cb7-4c94-8a85-5adec54ea58f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:52.665904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1381/2795] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:52:52.670392 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877d97b-5e71-4803-b48b-825805acbd0b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:52.680184 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877d97b-5e71-4803-b48b-825805acbd0b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:52.684749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6afb75-6d0a-44c2-8685-2e7a97f5b4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:52.686231 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6afb75-6d0a-44c2-8685-2e7a97f5b4f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:52.686512 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6afb75-6d0a-44c2-8685-2e7a97f5b4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:52.686784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6afb75-6d0a-44c2-8685-2e7a97f5b4f5 admin admin] PATH_INFO: `/v3/projects/8f047c85d6af44fe8fd501d1501bb8d5/users/3147d71efa424c2fbae81258f4c6570d/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:52.701388 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6afb75-6d0a-44c2-8685-2e7a97f5b4f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f047c85d6af44fe8fd501d1501bb8d5, user_id=3147d71efa424c2fbae81258f4c6570d, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:52.704052 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6afb75-6d0a-44c2-8685-2e7a97f5b4f5 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:52.717079 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1415/2796] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:52 2022] PUT /identity/v3/projects/8f047c85d6af44fe8fd501d1501bb8d5/users/3147d71efa424c2fbae81258f4c6570d/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:52.720959 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6fcc0-0cb7-4c94-8a85-5adec54ea58f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:52.730792 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6fcc0-0cb7-4c94-8a85-5adec54ea58f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:52.787526 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd14bc-2b9f-461b-9601-ec9dc5a29315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:52.788184 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd14bc-2b9f-461b-9601-ec9dc5a29315 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:52.788469 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd14bc-2b9f-461b-9601-ec9dc5a29315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:52.788776 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd14bc-2b9f-461b-9601-ec9dc5a29315 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:52.789516 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd14bc-2b9f-461b-9601-ec9dc5a29315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:52.791123 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd14bc-2b9f-461b-9601-ec9dc5a29315 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:52.801293 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1382/2797] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:52:52.805384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6afb75-6d0a-44c2-8685-2e7a97f5b4f5 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:52.815742 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6afb75-6d0a-44c2-8685-2e7a97f5b4f5 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:52.820297 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259214e-5934-430a-9806-707e7ba1aaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:52.821202 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259214e-5934-430a-9806-707e7ba1aaa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:52.821484 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259214e-5934-430a-9806-707e7ba1aaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:52.821756 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259214e-5934-430a-9806-707e7ba1aaa3 admin admin] PATH_INFO: `/v3/projects/8f047c85d6af44fe8fd501d1501bb8d5/users/3147d71efa424c2fbae81258f4c6570d/roles/ab64ea6d0475430195af26a049485569` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:52.823695 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8259214e-5934-430a-9806-707e7ba1aaa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f047c85d6af44fe8fd501d1501bb8d5, user_id=3147d71efa424c2fbae81258f4c6570d, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:52.826402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8259214e-5934-430a-9806-707e7ba1aaa3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:52.836522 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1416/2798] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:52:52 2022] PUT /identity/v3/projects/8f047c85d6af44fe8fd501d1501bb8d5/users/3147d71efa424c2fbae81258f4c6570d/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:52:52.847011 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a2195-8c6f-41db-abe1-680f1785cc6c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:52.847334 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a2195-8c6f-41db-abe1-680f1785cc6c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:52.847615 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a2195-8c6f-41db-abe1-680f1785cc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:52.874116 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-2b6a2195-8c6f-41db-abe1-680f1785cc6c None None] MFA Rules not processed for user `3147d71efa424c2fbae81258f4c6570d`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:52:52.875303 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2b6a2195-8c6f-41db-abe1-680f1785cc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:52.883154 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:52:52.943436 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1383/2799] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:52:52 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:52:52.954006 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259214e-5934-430a-9806-707e7ba1aaa3 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:52.955736 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8259214e-5934-430a-9806-707e7ba1aaa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:52:53.011977 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259214e-5934-430a-9806-707e7ba1aaa3 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:53.015539 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff74801-553f-48eb-9f27-fc0073258040 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:53.016163 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff74801-553f-48eb-9f27-fc0073258040 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:53.016442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff74801-553f-48eb-9f27-fc0073258040 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:53.016749 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff74801-553f-48eb-9f27-fc0073258040 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:53.025790 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff74801-553f-48eb-9f27-fc0073258040 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:53.027261 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff74801-553f-48eb-9f27-fc0073258040 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:53.037157 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1417/2800] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:52 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:52:53.180454 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a2195-8c6f-41db-abe1-680f1785cc6c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:52:53.189965 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a2195-8c6f-41db-abe1-680f1785cc6c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:52:53.193513 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935a61e-be9b-4a2e-8750-36e9a4ef012c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:52:53.194095 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935a61e-be9b-4a2e-8750-36e9a4ef012c service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:52:53.194379 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935a61e-be9b-4a2e-8750-36e9a4ef012c service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:52:53.194658 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935a61e-be9b-4a2e-8750-36e9a4ef012c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:52:53.251514 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935a61e-be9b-4a2e-8750-36e9a4ef012c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:52:53.253016 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935a61e-be9b-4a2e-8750-36e9a4ef012c service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:52:53.262149 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1384/2801] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:52:53 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:53:01.942508 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff74801-553f-48eb-9f27-fc0073258040 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:01.944047 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-cff74801-553f-48eb-9f27-fc0073258040 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:01.975243 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:02.002896 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff74801-553f-48eb-9f27-fc0073258040 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:02.006438 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3afb73-98f1-4326-bb05-3410d59b8a71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:02.007067 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3afb73-98f1-4326-bb05-3410d59b8a71 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:02.007347 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3afb73-98f1-4326-bb05-3410d59b8a71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:02.007621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3afb73-98f1-4326-bb05-3410d59b8a71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:02.009354 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6c3afb73-98f1-4326-bb05-3410d59b8a71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:02.018431 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3afb73-98f1-4326-bb05-3410d59b8a71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:02.019838 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3afb73-98f1-4326-bb05-3410d59b8a71 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:02.027692 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1418/2802] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:53:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:53:02.476656 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935a61e-be9b-4a2e-8750-36e9a4ef012c service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:02.478079 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2935a61e-be9b-4a2e-8750-36e9a4ef012c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:02.554868 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935a61e-be9b-4a2e-8750-36e9a4ef012c service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:02.560793 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626e319-5bed-4685-a771-f74ed7bd9f6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48709a771ab64ed38018873313f37c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:02.561441 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626e319-5bed-4685-a771-f74ed7bd9f6d service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:02.561730 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626e319-5bed-4685-a771-f74ed7bd9f6d service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:02.562057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626e319-5bed-4685-a771-f74ed7bd9f6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:02.563824 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b626e319-5bed-4685-a771-f74ed7bd9f6d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:02.576799 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626e319-5bed-4685-a771-f74ed7bd9f6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:02.578595 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626e319-5bed-4685-a771-f74ed7bd9f6d service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:02.589227 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1385/2803] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:53:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:53:03.679306 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3afb73-98f1-4326-bb05-3410d59b8a71 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:03.744363 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3afb73-98f1-4326-bb05-3410d59b8a71 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:03.749718 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5e677-9a7e-4a65-badb-e0dd4f82ecc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:03.750366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5e677-9a7e-4a65-badb-e0dd4f82ecc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:03.750756 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5e677-9a7e-4a65-badb-e0dd4f82ecc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:03.751108 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5e677-9a7e-4a65-badb-e0dd4f82ecc4 admin admin] PATH_INFO: `/v3/users/7c2f0479b8c44f1d9aee443ec540a048` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:03.752270 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5e677-9a7e-4a65-badb-e0dd4f82ecc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c2f0479b8c44f1d9aee443ec540a048)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:03.754228 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5e677-9a7e-4a65-badb-e0dd4f82ecc4 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:03.804342 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-75c5e677-9a7e-4a65-badb-e0dd4f82ecc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c2f0479b8c44f1d9aee443ec540a048'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:03.817359 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-75c5e677-9a7e-4a65-badb-e0dd4f82ecc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c2f0479b8c44f1d9aee443ec540a048'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:03.818015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-75c5e677-9a7e-4a65-badb-e0dd4f82ecc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c2f0479b8c44f1d9aee443ec540a048'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:03.824731 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-75c5e677-9a7e-4a65-badb-e0dd4f82ecc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c2f0479b8c44f1d9aee443ec540a048'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:03.826249 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-75c5e677-9a7e-4a65-badb-e0dd4f82ecc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c2f0479b8c44f1d9aee443ec540a048'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:03.839017 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1419/2804] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:53:03 2022] DELETE /identity/v3/users/7c2f0479b8c44f1d9aee443ec540a048 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:53:03.843324 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7a5cd-0a66-46a6-aaa8-365c198efd48 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:03.843842 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7a5cd-0a66-46a6-aaa8-365c198efd48 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:03.843968 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7a5cd-0a66-46a6-aaa8-365c198efd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:03.861928 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-12d7a5cd-0a66-46a6-aaa8-365c198efd48 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:03.863274 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-12d7a5cd-0a66-46a6-aaa8-365c198efd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:03.894347 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:03.932870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1386/2805] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:03.943114 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5e677-9a7e-4a65-badb-e0dd4f82ecc4 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:03.944576 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-75c5e677-9a7e-4a65-badb-e0dd4f82ecc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:04.009255 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:04.015696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5e677-9a7e-4a65-badb-e0dd4f82ecc4 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:04.021394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a8d29-68e8-46f7-bc58-69e78a7e88af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:04.022221 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a8d29-68e8-46f7-bc58-69e78a7e88af service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:04.022676 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a8d29-68e8-46f7-bc58-69e78a7e88af service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:04.023120 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a8d29-68e8-46f7-bc58-69e78a7e88af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:04.034282 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a8d29-68e8-46f7-bc58-69e78a7e88af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:04.036145 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a8d29-68e8-46f7-bc58-69e78a7e88af service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:04.048092 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1420/2806] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:53:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:53:04.464704 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7a5cd-0a66-46a6-aaa8-365c198efd48 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:04.466728 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-12d7a5cd-0a66-46a6-aaa8-365c198efd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:04.478778 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7a5cd-0a66-46a6-aaa8-365c198efd48 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:04.484026 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71679e12-5b45-44ef-b05a-ddcad685c13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:04.484985 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71679e12-5b45-44ef-b05a-ddcad685c13e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:04.485578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71679e12-5b45-44ef-b05a-ddcad685c13e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:04.485927 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71679e12-5b45-44ef-b05a-ddcad685c13e admin admin] PATH_INFO: `/v3/projects/9e9f830e25dd4dec968f0db17f0b328e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:04.487182 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71679e12-5b45-44ef-b05a-ddcad685c13e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e9f830e25dd4dec968f0db17f0b328e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:04.489196 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71679e12-5b45-44ef-b05a-ddcad685c13e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:04.541489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-71679e12-5b45-44ef-b05a-ddcad685c13e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e9f830e25dd4dec968f0db17f0b328e', 'request_id': 'req-71679e12-5b45-44ef-b05a-ddcad685c13e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:04.549854 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-71679e12-5b45-44ef-b05a-ddcad685c13e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e9f830e25dd4dec968f0db17f0b328e', 'request_id': 'req-71679e12-5b45-44ef-b05a-ddcad685c13e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:04.555786 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-71679e12-5b45-44ef-b05a-ddcad685c13e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e9f830e25dd4dec968f0db17f0b328e', 'request_id': 'req-71679e12-5b45-44ef-b05a-ddcad685c13e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:04.568441 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-71679e12-5b45-44ef-b05a-ddcad685c13e admin admin] The token cache is being invalidate because project 9e9f830e25dd4dec968f0db17f0b328e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:53:04.568711 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-71679e12-5b45-44ef-b05a-ddcad685c13e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:04.569520 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-71679e12-5b45-44ef-b05a-ddcad685c13e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:04.571080 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1387/2807] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:53:04 2022] DELETE /identity/v3/projects/9e9f830e25dd4dec968f0db17f0b328e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:53:04.575034 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a8d29-68e8-46f7-bc58-69e78a7e88af service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:04.584941 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a8d29-68e8-46f7-bc58-69e78a7e88af service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:04.640593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6cdfc-0e21-40b1-baa7-0b22731e3069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:04.641472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6cdfc-0e21-40b1-baa7-0b22731e3069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:04.641750 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6cdfc-0e21-40b1-baa7-0b22731e3069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:04.642020 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6cdfc-0e21-40b1-baa7-0b22731e3069 admin admin] PATH_INFO: `/v3/users/3147d71efa424c2fbae81258f4c6570d` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:04.643206 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6cdfc-0e21-40b1-baa7-0b22731e3069 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3147d71efa424c2fbae81258f4c6570d)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:04.645163 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6cdfc-0e21-40b1-baa7-0b22731e3069 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:04.696981 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c6d6cdfc-0e21-40b1-baa7-0b22731e3069 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3147d71efa424c2fbae81258f4c6570d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:04.714452 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c6d6cdfc-0e21-40b1-baa7-0b22731e3069 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3147d71efa424c2fbae81258f4c6570d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:04.715170 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c6d6cdfc-0e21-40b1-baa7-0b22731e3069 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3147d71efa424c2fbae81258f4c6570d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:04.723089 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c6d6cdfc-0e21-40b1-baa7-0b22731e3069 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3147d71efa424c2fbae81258f4c6570d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:04.723741 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c6d6cdfc-0e21-40b1-baa7-0b22731e3069 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3147d71efa424c2fbae81258f4c6570d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:04.742377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1421/2808] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:53:04 2022] DELETE /identity/v3/users/3147d71efa424c2fbae81258f4c6570d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:53:05.149539 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71679e12-5b45-44ef-b05a-ddcad685c13e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:05.151347 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-71679e12-5b45-44ef-b05a-ddcad685c13e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:05.165249 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71679e12-5b45-44ef-b05a-ddcad685c13e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:05.243340 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36bdf4-7943-42cf-9fce-f41ba3e453bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:05.244355 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36bdf4-7943-42cf-9fce-f41ba3e453bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:05.244492 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36bdf4-7943-42cf-9fce-f41ba3e453bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:05.244706 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36bdf4-7943-42cf-9fce-f41ba3e453bb admin admin] PATH_INFO: `/v3/projects/8f047c85d6af44fe8fd501d1501bb8d5` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:05.245917 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36bdf4-7943-42cf-9fce-f41ba3e453bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f047c85d6af44fe8fd501d1501bb8d5)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:05.248406 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36bdf4-7943-42cf-9fce-f41ba3e453bb admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:05.303051 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7b36bdf4-7943-42cf-9fce-f41ba3e453bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f047c85d6af44fe8fd501d1501bb8d5', 'request_id': 'req-7b36bdf4-7943-42cf-9fce-f41ba3e453bb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:05.311268 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7b36bdf4-7943-42cf-9fce-f41ba3e453bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f047c85d6af44fe8fd501d1501bb8d5', 'request_id': 'req-7b36bdf4-7943-42cf-9fce-f41ba3e453bb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:05.314760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:05.320052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7b36bdf4-7943-42cf-9fce-f41ba3e453bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f047c85d6af44fe8fd501d1501bb8d5', 'request_id': 'req-7b36bdf4-7943-42cf-9fce-f41ba3e453bb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:05.333445 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7b36bdf4-7943-42cf-9fce-f41ba3e453bb admin admin] The token cache is being invalidate because project 8f047c85d6af44fe8fd501d1501bb8d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:53:05.333733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7b36bdf4-7943-42cf-9fce-f41ba3e453bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:05.334387 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7b36bdf4-7943-42cf-9fce-f41ba3e453bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:05.335957 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1388/2809] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:53:05 2022] DELETE /identity/v3/projects/8f047c85d6af44fe8fd501d1501bb8d5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:53:05.340867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5093dc-64b4-4e06-a76e-0f9be3d3b8c5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:05.341195 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5093dc-64b4-4e06-a76e-0f9be3d3b8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:05.341544 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5093dc-64b4-4e06-a76e-0f9be3d3b8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:05.360321 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-5b5093dc-64b4-4e06-a76e-0f9be3d3b8c5 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:05.361746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-5b5093dc-64b4-4e06-a76e-0f9be3d3b8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:05.422534 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1422/2810] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:05.430833 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8b6fa-e598-4a79-a1de-e766357269c4 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:05.431126 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8b6fa-e598-4a79-a1de-e766357269c4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:05.431405 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8b6fa-e598-4a79-a1de-e766357269c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:05.450303 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e9a8b6fa-e598-4a79-a1de-e766357269c4 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:05.452451 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e9a8b6fa-e598-4a79-a1de-e766357269c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:05.460671 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1389/2811] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:05.464951 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5093dc-64b4-4e06-a76e-0f9be3d3b8c5 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:05.474928 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5093dc-64b4-4e06-a76e-0f9be3d3b8c5 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:05.479604 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc41e7-c3e9-44e4-aeca-9b4ae11d03f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:05.480268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc41e7-c3e9-44e4-aeca-9b4ae11d03f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:05.480586 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc41e7-c3e9-44e4-aeca-9b4ae11d03f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:05.480869 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc41e7-c3e9-44e4-aeca-9b4ae11d03f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:05.482102 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc41e7-c3e9-44e4-aeca-9b4ae11d03f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:53:05.482455 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc41e7-c3e9-44e4-aeca-9b4ae11d03f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:05.484116 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc41e7-c3e9-44e4-aeca-9b4ae11d03f3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:05.491814 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:05.500773 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1423/2812] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:53:05.504523 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8b6fa-e598-4a79-a1de-e766357269c4 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:05.514223 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8b6fa-e598-4a79-a1de-e766357269c4 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:05.518947 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7c48d-b18a-4498-a407-dc2b299255d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:05.519578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7c48d-b18a-4498-a407-dc2b299255d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:05.519865 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7c48d-b18a-4498-a407-dc2b299255d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:05.520145 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7c48d-b18a-4498-a407-dc2b299255d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:05.520879 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7c48d-b18a-4498-a407-dc2b299255d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:05.522792 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7c48d-b18a-4498-a407-dc2b299255d3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:05.548776 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1390/2813] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:53:05 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:53:05.552873 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc41e7-c3e9-44e4-aeca-9b4ae11d03f3 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:05.562999 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc41e7-c3e9-44e4-aeca-9b4ae11d03f3 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:05.619513 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c72238-f853-44c7-a6a9-84407fdaf141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:05.620180 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c72238-f853-44c7-a6a9-84407fdaf141 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:05.620470 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c72238-f853-44c7-a6a9-84407fdaf141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:05.620786 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c72238-f853-44c7-a6a9-84407fdaf141 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:05.621461 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c72238-f853-44c7-a6a9-84407fdaf141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:05.624049 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c72238-f853-44c7-a6a9-84407fdaf141 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:05.651034 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1424/2814] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:53:05 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:53:05.652784 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7c48d-b18a-4498-a407-dc2b299255d3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:05.663137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7c48d-b18a-4498-a407-dc2b299255d3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:05.667870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acc678-9343-48b2-b1e8-d78fde1c44bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:05.668546 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acc678-9343-48b2-b1e8-d78fde1c44bd admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:05.668830 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acc678-9343-48b2-b1e8-d78fde1c44bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:05.669599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acc678-9343-48b2-b1e8-d78fde1c44bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:05.670334 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6acc678-9343-48b2-b1e8-d78fde1c44bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:05.671952 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6acc678-9343-48b2-b1e8-d78fde1c44bd admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:05.682320 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1391/2815] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:53:05.686782 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c72238-f853-44c7-a6a9-84407fdaf141 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:05.696762 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c72238-f853-44c7-a6a9-84407fdaf141 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:05.701359 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6b03b-0867-4e90-9ed4-bf1a1efa35f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:05.702042 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6b03b-0867-4e90-9ed4-bf1a1efa35f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:05.702328 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6b03b-0867-4e90-9ed4-bf1a1efa35f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:05.702607 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6b03b-0867-4e90-9ed4-bf1a1efa35f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:05.703323 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6b03b-0867-4e90-9ed4-bf1a1efa35f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:05.704948 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6b03b-0867-4e90-9ed4-bf1a1efa35f9 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:05.714654 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1425/2816] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:53:05.718628 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acc678-9343-48b2-b1e8-d78fde1c44bd admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:05.728343 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acc678-9343-48b2-b1e8-d78fde1c44bd admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:05.733454 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba24a0-34bf-4cac-a139-96b92f06780d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:05.734310 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba24a0-34bf-4cac-a139-96b92f06780d admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:05.734592 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba24a0-34bf-4cac-a139-96b92f06780d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:05.734865 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba24a0-34bf-4cac-a139-96b92f06780d admin admin] PATH_INFO: `/v3/projects/3012453fc25a496681bb8654733281bd/users/3462b970d36c48b8bb56f282f3532060/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:05.750312 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba24a0-34bf-4cac-a139-96b92f06780d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3012453fc25a496681bb8654733281bd, user_id=3462b970d36c48b8bb56f282f3532060, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:05.753043 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba24a0-34bf-4cac-a139-96b92f06780d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:05.766356 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1392/2817] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:53:05 2022] PUT /identity/v3/projects/3012453fc25a496681bb8654733281bd/users/3462b970d36c48b8bb56f282f3532060/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:53:05.776365 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a831c53-b450-420d-bfa4-66b68541132c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:05.776697 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a831c53-b450-420d-bfa4-66b68541132c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:05.776983 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a831c53-b450-420d-bfa4-66b68541132c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:05.803122 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-1a831c53-b450-420d-bfa4-66b68541132c None None] MFA Rules not processed for user `3462b970d36c48b8bb56f282f3532060`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:05.804327 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1a831c53-b450-420d-bfa4-66b68541132c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:05.868819 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1426/2818] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:53:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:05.880172 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba24a0-34bf-4cac-a139-96b92f06780d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:05.881929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-89ba24a0-34bf-4cac-a139-96b92f06780d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:05.939960 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba24a0-34bf-4cac-a139-96b92f06780d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:05.943681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84248aa7-3571-41e3-ba1e-86144d2f611f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2522b8560d224aa1a973207a79ce6a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:05.944359 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84248aa7-3571-41e3-ba1e-86144d2f611f service glance] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:05.944695 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84248aa7-3571-41e3-ba1e-86144d2f611f service glance] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:05.944979 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84248aa7-3571-41e3-ba1e-86144d2f611f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:05.953692 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84248aa7-3571-41e3-ba1e-86144d2f611f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:05.955143 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84248aa7-3571-41e3-ba1e-86144d2f611f service glance] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:05.964249 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1393/2819] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:53:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:53:15.865432 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=67,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:15.881614 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a831c53-b450-420d-bfa4-66b68541132c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:15.883316 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1a831c53-b450-420d-bfa4-66b68541132c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:15.959957 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=58,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:15.966025 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a831c53-b450-420d-bfa4-66b68541132c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:15.971499 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c63eaf-73f8-453f-806b-dc8bd5ba6917 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:15.972148 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c63eaf-73f8-453f-806b-dc8bd5ba6917 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:15.972433 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c63eaf-73f8-453f-806b-dc8bd5ba6917 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:15.972748 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c63eaf-73f8-453f-806b-dc8bd5ba6917 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:15.974621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-81c63eaf-73f8-453f-806b-dc8bd5ba6917 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:15.987618 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c63eaf-73f8-453f-806b-dc8bd5ba6917 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:15.989303 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c63eaf-73f8-453f-806b-dc8bd5ba6917 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:16.000232 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1427/2820] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:53:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:53:19.066910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84248aa7-3571-41e3-ba1e-86144d2f611f service glance] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:19.068319 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-84248aa7-3571-41e3-ba1e-86144d2f611f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:19.125785 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84248aa7-3571-41e3-ba1e-86144d2f611f service glance] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:19.129339 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30f3a3-fb92-45da-bfdd-f78e69efa126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:19.129967 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30f3a3-fb92-45da-bfdd-f78e69efa126 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:19.130248 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30f3a3-fb92-45da-bfdd-f78e69efa126 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:19.130522 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30f3a3-fb92-45da-bfdd-f78e69efa126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:19.132261 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ab30f3a3-fb92-45da-bfdd-f78e69efa126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:19.192849 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30f3a3-fb92-45da-bfdd-f78e69efa126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:19.194279 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30f3a3-fb92-45da-bfdd-f78e69efa126 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:19.204121 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1394/2821] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:53:19 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:53:20.912531 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c63eaf-73f8-453f-806b-dc8bd5ba6917 service nova] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:20.913983 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-81c63eaf-73f8-453f-806b-dc8bd5ba6917 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:20.927774 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c63eaf-73f8-453f-806b-dc8bd5ba6917 service nova] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:20.934032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef6973-b111-4ed4-9df5-754a6e454199 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:20.935180 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef6973-b111-4ed4-9df5-754a6e454199 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:20.935471 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef6973-b111-4ed4-9df5-754a6e454199 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:20.935737 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef6973-b111-4ed4-9df5-754a6e454199 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:20.937529 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6cef6973-b111-4ed4-9df5-754a6e454199 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:20.949891 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef6973-b111-4ed4-9df5-754a6e454199 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:20.952032 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef6973-b111-4ed4-9df5-754a6e454199 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:20.962983 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1428/2822] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:53:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:53:29.199348 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=50 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:30.958117 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=43 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:47.487754 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e1020-386a-4301-9c58-1f068d0dea42 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:47.488247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e1020-386a-4301-9c58-1f068d0dea42 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:47.488446 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e1020-386a-4301-9c58-1f068d0dea42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:47.515743 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-030e1020-386a-4301-9c58-1f068d0dea42 None None] MFA Rules not processed for user `a2bd48e6390241448fe2cf098ab64df3`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:47.516896 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-030e1020-386a-4301-9c58-1f068d0dea42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:47.570478 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1395/2823] 10.222.0.59 () {58 vars in 967 bytes} [Thu Jun 30 10:53:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:47.621698 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef6973-b111-4ed4-9df5-754a6e454199 service nova] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:47.623128 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6cef6973-b111-4ed4-9df5-754a6e454199 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:47.696939 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef6973-b111-4ed4-9df5-754a6e454199 service nova] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:47.702789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad3609-03e1-4a15-a7c6-fa5221108bc0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c15327c36c8c49ac87a3b3e9ab49eea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:47.703442 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad3609-03e1-4a15-a7c6-fa5221108bc0 service swift] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:47.703727 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad3609-03e1-4a15-a7c6-fa5221108bc0 service swift] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:47.704005 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad3609-03e1-4a15-a7c6-fa5221108bc0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:47.712684 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad3609-03e1-4a15-a7c6-fa5221108bc0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:47.714268 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad3609-03e1-4a15-a7c6-fa5221108bc0 service swift] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:47.722408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1429/2824] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 30 10:53:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:53:48.731868 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e1020-386a-4301-9c58-1f068d0dea42 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:48.794963 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e1020-386a-4301-9c58-1f068d0dea42 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:48.799402 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46c1c3-f377-4f79-aa19-451614830084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:48.800258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46c1c3-f377-4f79-aa19-451614830084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:48.800602 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46c1c3-f377-4f79-aa19-451614830084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:48.800842 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46c1c3-f377-4f79-aa19-451614830084 admin admin] PATH_INFO: `/v3/users/3462b970d36c48b8bb56f282f3532060` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:48.802022 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46c1c3-f377-4f79-aa19-451614830084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3462b970d36c48b8bb56f282f3532060)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:48.803937 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46c1c3-f377-4f79-aa19-451614830084 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:48.851018 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8a46c1c3-f377-4f79-aa19-451614830084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3462b970d36c48b8bb56f282f3532060'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:48.851674 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8a46c1c3-f377-4f79-aa19-451614830084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3462b970d36c48b8bb56f282f3532060'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:48.859274 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8a46c1c3-f377-4f79-aa19-451614830084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3462b970d36c48b8bb56f282f3532060'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:48.860334 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8a46c1c3-f377-4f79-aa19-451614830084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3462b970d36c48b8bb56f282f3532060'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:48.868863 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8a46c1c3-f377-4f79-aa19-451614830084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3462b970d36c48b8bb56f282f3532060'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:48.887133 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1396/2825] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:53:48 2022] DELETE /identity/v3/users/3462b970d36c48b8bb56f282f3532060 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:53:48.896135 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd244a05-bd9a-4042-aa8a-27ee48cae4d4 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:48.896591 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd244a05-bd9a-4042-aa8a-27ee48cae4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:48.896770 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd244a05-bd9a-4042-aa8a-27ee48cae4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:48.917970 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-cd244a05-bd9a-4042-aa8a-27ee48cae4d4 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:48.919251 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-cd244a05-bd9a-4042-aa8a-27ee48cae4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:48.986040 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1430/2826] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:48.996606 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46c1c3-f377-4f79-aa19-451614830084 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:48.998910 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8a46c1c3-f377-4f79-aa19-451614830084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:49.018752 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:49.069663 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46c1c3-f377-4f79-aa19-451614830084 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:49.074336 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8c47e-7d3c-4c76-86f4-58c612ba13f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:49.074858 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8c47e-7d3c-4c76-86f4-58c612ba13f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:49.075182 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8c47e-7d3c-4c76-86f4-58c612ba13f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:49.075721 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8c47e-7d3c-4c76-86f4-58c612ba13f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:49.088219 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8c47e-7d3c-4c76-86f4-58c612ba13f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:49.089727 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8c47e-7d3c-4c76-86f4-58c612ba13f9 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:49.100452 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1397/2827] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:53:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:53:49.379637 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd244a05-bd9a-4042-aa8a-27ee48cae4d4 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:49.382211 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-cd244a05-bd9a-4042-aa8a-27ee48cae4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:49.402743 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd244a05-bd9a-4042-aa8a-27ee48cae4d4 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:49.408235 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ec6d2-95e9-402f-a5a5-0c0d887681e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:49.415884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ec6d2-95e9-402f-a5a5-0c0d887681e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:49.416243 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ec6d2-95e9-402f-a5a5-0c0d887681e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:49.416613 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ec6d2-95e9-402f-a5a5-0c0d887681e9 admin admin] PATH_INFO: `/v3/projects/3012453fc25a496681bb8654733281bd` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:49.418083 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ec6d2-95e9-402f-a5a5-0c0d887681e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3012453fc25a496681bb8654733281bd)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:49.420752 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ec6d2-95e9-402f-a5a5-0c0d887681e9 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:49.473843 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-444ec6d2-95e9-402f-a5a5-0c0d887681e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3012453fc25a496681bb8654733281bd', 'request_id': 'req-444ec6d2-95e9-402f-a5a5-0c0d887681e9'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:49.486760 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-444ec6d2-95e9-402f-a5a5-0c0d887681e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3012453fc25a496681bb8654733281bd', 'request_id': 'req-444ec6d2-95e9-402f-a5a5-0c0d887681e9'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:49.496624 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-444ec6d2-95e9-402f-a5a5-0c0d887681e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3012453fc25a496681bb8654733281bd', 'request_id': 'req-444ec6d2-95e9-402f-a5a5-0c0d887681e9'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:49.508515 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-444ec6d2-95e9-402f-a5a5-0c0d887681e9 admin admin] The token cache is being invalidate because project 3012453fc25a496681bb8654733281bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:53:49.508801 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-444ec6d2-95e9-402f-a5a5-0c0d887681e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:49.509445 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-444ec6d2-95e9-402f-a5a5-0c0d887681e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:49.511327 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1431/2828] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:53:49 2022] DELETE /identity/v3/projects/3012453fc25a496681bb8654733281bd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:53:49.516101 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a670a-7b63-4c9f-a783-26d963acb9b9 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:49.516422 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a670a-7b63-4c9f-a783-26d963acb9b9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:49.516773 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a670a-7b63-4c9f-a783-26d963acb9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:49.549384 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8d9a670a-7b63-4c9f-a783-26d963acb9b9 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:49.550598 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8d9a670a-7b63-4c9f-a783-26d963acb9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:49.619653 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1398/2829] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:49.684889 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40058744-0be5-468b-9140-88526959203b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:49.685174 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40058744-0be5-468b-9140-88526959203b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:49.685756 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40058744-0be5-468b-9140-88526959203b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:49.710892 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-40058744-0be5-468b-9140-88526959203b None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:49.712548 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-40058744-0be5-468b-9140-88526959203b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:49.722434 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1432/2830] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:49.726839 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a670a-7b63-4c9f-a783-26d963acb9b9 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:49.737030 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a670a-7b63-4c9f-a783-26d963acb9b9 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:49.742054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1a94d-e6e5-4466-9ff1-ebb245971675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:49.742711 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1a94d-e6e5-4466-9ff1-ebb245971675 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:49.742990 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1a94d-e6e5-4466-9ff1-ebb245971675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:49.743260 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1a94d-e6e5-4466-9ff1-ebb245971675 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:49.743985 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1a94d-e6e5-4466-9ff1-ebb245971675 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:53:49.744388 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1a94d-e6e5-4466-9ff1-ebb245971675 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:49.746077 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1a94d-e6e5-4466-9ff1-ebb245971675 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:49.759256 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1399/2831] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:53:49.763173 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40058744-0be5-468b-9140-88526959203b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:49.773602 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40058744-0be5-468b-9140-88526959203b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:49.779678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de70185-8cf4-41ed-9e21-692935f447fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:49.780345 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de70185-8cf4-41ed-9e21-692935f447fc admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:49.780712 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de70185-8cf4-41ed-9e21-692935f447fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:49.780996 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de70185-8cf4-41ed-9e21-692935f447fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:49.781704 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de70185-8cf4-41ed-9e21-692935f447fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:49.783891 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de70185-8cf4-41ed-9e21-692935f447fc admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:49.787521 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:49.820528 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1433/2832] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:53:49 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:53:49.835695 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1a94d-e6e5-4466-9ff1-ebb245971675 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:49.838267 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1a94d-e6e5-4466-9ff1-ebb245971675 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:49.901885 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0bd29-b7ce-4e47-81a8-8c8231076b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:49.902555 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0bd29-b7ce-4e47-81a8-8c8231076b00 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:49.902834 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0bd29-b7ce-4e47-81a8-8c8231076b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:49.903175 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0bd29-b7ce-4e47-81a8-8c8231076b00 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:49.904346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0bd29-b7ce-4e47-81a8-8c8231076b00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:49.906306 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0bd29-b7ce-4e47-81a8-8c8231076b00 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:49.932325 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1400/2833] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:53:49 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:53:49.933261 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de70185-8cf4-41ed-9e21-692935f447fc admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:49.953370 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de70185-8cf4-41ed-9e21-692935f447fc admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:49.960867 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f2212-4af7-423f-a542-3ca7f7b0fac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:49.961740 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f2212-4af7-423f-a542-3ca7f7b0fac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:49.962408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f2212-4af7-423f-a542-3ca7f7b0fac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:49.962408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f2212-4af7-423f-a542-3ca7f7b0fac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:49.963241 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f2212-4af7-423f-a542-3ca7f7b0fac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:49.966310 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f2212-4af7-423f-a542-3ca7f7b0fac0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:49.983434 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1434/2834] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:53:49.987546 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0bd29-b7ce-4e47-81a8-8c8231076b00 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:50.000653 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0bd29-b7ce-4e47-81a8-8c8231076b00 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:50.005828 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f7108-bb07-4c52-bc42-910e945786f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:50.006300 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f7108-bb07-4c52-bc42-910e945786f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:50.006681 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f7108-bb07-4c52-bc42-910e945786f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:50.007226 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f7108-bb07-4c52-bc42-910e945786f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:50.008188 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f7108-bb07-4c52-bc42-910e945786f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:50.010059 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f7108-bb07-4c52-bc42-910e945786f3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:50.027890 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1401/2835] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:53:50.029467 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f2212-4af7-423f-a542-3ca7f7b0fac0 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:50.048802 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f2212-4af7-423f-a542-3ca7f7b0fac0 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:50.056972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329d3de-d4ec-46c2-aaa8-57410b9af665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:50.057887 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329d3de-d4ec-46c2-aaa8-57410b9af665 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:50.058174 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329d3de-d4ec-46c2-aaa8-57410b9af665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:50.058450 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329d3de-d4ec-46c2-aaa8-57410b9af665 admin admin] PATH_INFO: `/v3/projects/0270ab7a89544ff8a293b11383e7d760/users/191b6d55c1014e3384a83a50eaad63c6/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:50.074624 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9329d3de-d4ec-46c2-aaa8-57410b9af665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0270ab7a89544ff8a293b11383e7d760, user_id=191b6d55c1014e3384a83a50eaad63c6, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:50.077676 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9329d3de-d4ec-46c2-aaa8-57410b9af665 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:50.098414 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1435/2836] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:53:50 2022] PUT /identity/v3/projects/0270ab7a89544ff8a293b11383e7d760/users/191b6d55c1014e3384a83a50eaad63c6/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:53:50.108463 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfdfc2-93a8-4d16-a875-2ba58f47c5eb None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:50.108780 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfdfc2-93a8-4d16-a875-2ba58f47c5eb None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:50.109094 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfdfc2-93a8-4d16-a875-2ba58f47c5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:50.136111 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-14dfdfc2-93a8-4d16-a875-2ba58f47c5eb None None] MFA Rules not processed for user `191b6d55c1014e3384a83a50eaad63c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:50.137351 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-14dfdfc2-93a8-4d16-a875-2ba58f47c5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:50.142172 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:50.205865 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1402/2837] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:53:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:50.217634 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329d3de-d4ec-46c2-aaa8-57410b9af665 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:50.219670 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9329d3de-d4ec-46c2-aaa8-57410b9af665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:50.304939 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329d3de-d4ec-46c2-aaa8-57410b9af665 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:50.308769 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3d2ec-d950-448b-b5e4-7d00e042fb58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:50.309955 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3d2ec-d950-448b-b5e4-7d00e042fb58 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:50.310320 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3d2ec-d950-448b-b5e4-7d00e042fb58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:50.310692 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3d2ec-d950-448b-b5e4-7d00e042fb58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:50.319457 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3d2ec-d950-448b-b5e4-7d00e042fb58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:50.320949 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3d2ec-d950-448b-b5e4-7d00e042fb58 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:50.330706 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1436/2838] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:53:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:53:51.222007 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfdfc2-93a8-4d16-a875-2ba58f47c5eb None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:51.223448 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-14dfdfc2-93a8-4d16-a875-2ba58f47c5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:51.334258 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfdfc2-93a8-4d16-a875-2ba58f47c5eb None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:51.339293 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443800b3-5dfb-45d5-ba5f-5779d67db421 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48709a771ab64ed38018873313f37c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:51.339936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443800b3-5dfb-45d5-ba5f-5779d67db421 service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:51.340218 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443800b3-5dfb-45d5-ba5f-5779d67db421 service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:51.340523 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443800b3-5dfb-45d5-ba5f-5779d67db421 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:51.342298 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-443800b3-5dfb-45d5-ba5f-5779d67db421 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:51.354594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443800b3-5dfb-45d5-ba5f-5779d67db421 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:51.356760 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443800b3-5dfb-45d5-ba5f-5779d67db421 service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:51.367449 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1403/2839] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:53:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:53:52.958596 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3d2ec-d950-448b-b5e4-7d00e042fb58 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:53.023366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3d2ec-d950-448b-b5e4-7d00e042fb58 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:53.032172 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e178a4-df95-4159-9e52-a37f40eeade9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:53.033462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e178a4-df95-4159-9e52-a37f40eeade9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:53.033462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e178a4-df95-4159-9e52-a37f40eeade9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:53.033660 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e178a4-df95-4159-9e52-a37f40eeade9 admin admin] PATH_INFO: `/v3/users/191b6d55c1014e3384a83a50eaad63c6` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:53.035033 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e178a4-df95-4159-9e52-a37f40eeade9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=191b6d55c1014e3384a83a50eaad63c6)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:53.038545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e178a4-df95-4159-9e52-a37f40eeade9 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:53.086381 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:53.101046 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-55e178a4-df95-4159-9e52-a37f40eeade9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '191b6d55c1014e3384a83a50eaad63c6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:53.119496 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-55e178a4-df95-4159-9e52-a37f40eeade9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '191b6d55c1014e3384a83a50eaad63c6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:53.120429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-55e178a4-df95-4159-9e52-a37f40eeade9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '191b6d55c1014e3384a83a50eaad63c6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:53.129870 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-55e178a4-df95-4159-9e52-a37f40eeade9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '191b6d55c1014e3384a83a50eaad63c6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:53.130672 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-55e178a4-df95-4159-9e52-a37f40eeade9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '191b6d55c1014e3384a83a50eaad63c6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:53.148660 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1437/2840] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:53:52 2022] DELETE /identity/v3/users/191b6d55c1014e3384a83a50eaad63c6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:53:53.153495 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c054690-ef99-4257-b9e9-062d144760ca None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:53.153935 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c054690-ef99-4257-b9e9-062d144760ca None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:53.154199 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c054690-ef99-4257-b9e9-062d144760ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:53.173709 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8c054690-ef99-4257-b9e9-062d144760ca None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:53.174934 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8c054690-ef99-4257-b9e9-062d144760ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:53.240032 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1404/2841] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:53:53.249665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e178a4-df95-4159-9e52-a37f40eeade9 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:53.251086 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-55e178a4-df95-4159-9e52-a37f40eeade9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:53.308838 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e178a4-df95-4159-9e52-a37f40eeade9 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:53.313277 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68981b-e361-488e-8e78-b7226606def6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:53.313925 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68981b-e361-488e-8e78-b7226606def6 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:53.314217 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68981b-e361-488e-8e78-b7226606def6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:53.314494 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68981b-e361-488e-8e78-b7226606def6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:53.323765 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68981b-e361-488e-8e78-b7226606def6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:53.325943 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68981b-e361-488e-8e78-b7226606def6 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:53.336165 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1438/2842] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:53:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:53:53.749193 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c054690-ef99-4257-b9e9-062d144760ca None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:53.751350 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8c054690-ef99-4257-b9e9-062d144760ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:53.775306 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c054690-ef99-4257-b9e9-062d144760ca None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:53.781071 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62061e6a-9ae7-42dd-9055-6e2ecf7331bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:53.782056 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62061e6a-9ae7-42dd-9055-6e2ecf7331bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:53.782637 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62061e6a-9ae7-42dd-9055-6e2ecf7331bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:53.782858 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62061e6a-9ae7-42dd-9055-6e2ecf7331bd admin admin] PATH_INFO: `/v3/projects/0270ab7a89544ff8a293b11383e7d760` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:53.784245 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62061e6a-9ae7-42dd-9055-6e2ecf7331bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0270ab7a89544ff8a293b11383e7d760)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:53.786847 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62061e6a-9ae7-42dd-9055-6e2ecf7331bd admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:53.805074 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:53.851137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-62061e6a-9ae7-42dd-9055-6e2ecf7331bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0270ab7a89544ff8a293b11383e7d760', 'request_id': 'req-62061e6a-9ae7-42dd-9055-6e2ecf7331bd'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:53.861630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-62061e6a-9ae7-42dd-9055-6e2ecf7331bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0270ab7a89544ff8a293b11383e7d760', 'request_id': 'req-62061e6a-9ae7-42dd-9055-6e2ecf7331bd'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:53.868600 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-62061e6a-9ae7-42dd-9055-6e2ecf7331bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0270ab7a89544ff8a293b11383e7d760', 'request_id': 'req-62061e6a-9ae7-42dd-9055-6e2ecf7331bd'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:53.889679 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-62061e6a-9ae7-42dd-9055-6e2ecf7331bd admin admin] The token cache is being invalidate because project 0270ab7a89544ff8a293b11383e7d760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:53:53.889994 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-62061e6a-9ae7-42dd-9055-6e2ecf7331bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:53.890785 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-62061e6a-9ae7-42dd-9055-6e2ecf7331bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:53.892323 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1405/2843] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:53:53 2022] DELETE /identity/v3/projects/0270ab7a89544ff8a293b11383e7d760 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:53:53.898086 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471edfeb-fcfd-4eaf-bdb5-af81aad33915 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:53.898474 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471edfeb-fcfd-4eaf-bdb5-af81aad33915 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:53.898852 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471edfeb-fcfd-4eaf-bdb5-af81aad33915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:53.929622 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-471edfeb-fcfd-4eaf-bdb5-af81aad33915 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:53.931131 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-471edfeb-fcfd-4eaf-bdb5-af81aad33915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:54.013688 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1439/2844] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:53:54.021216 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe26f9-4f7e-42d6-9300-ec2256b8c0ee None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:54.021452 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe26f9-4f7e-42d6-9300-ec2256b8c0ee None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:54.021730 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe26f9-4f7e-42d6-9300-ec2256b8c0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:54.048061 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f5fe26f9-4f7e-42d6-9300-ec2256b8c0ee None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:54.050481 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f5fe26f9-4f7e-42d6-9300-ec2256b8c0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:54.063260 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1406/2845] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:53:54.064552 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471edfeb-fcfd-4eaf-bdb5-af81aad33915 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:54.075055 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471edfeb-fcfd-4eaf-bdb5-af81aad33915 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:54.080255 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f7e7b-300e-4727-981a-6290dc86b894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:54.080971 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f7e7b-300e-4727-981a-6290dc86b894 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:54.081255 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f7e7b-300e-4727-981a-6290dc86b894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:54.081530 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f7e7b-300e-4727-981a-6290dc86b894 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:54.082259 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f7e7b-300e-4727-981a-6290dc86b894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:53:54.082740 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f7e7b-300e-4727-981a-6290dc86b894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:54.084157 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f7e7b-300e-4727-981a-6290dc86b894 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:54.098663 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1440/2846] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:53:54.103126 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe26f9-4f7e-42d6-9300-ec2256b8c0ee None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:54.113867 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe26f9-4f7e-42d6-9300-ec2256b8c0ee None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:54.120726 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b57a30-40bd-4136-ac1b-1f0bd655eeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:54.125465 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b57a30-40bd-4136-ac1b-1f0bd655eeba admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:54.125868 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b57a30-40bd-4136-ac1b-1f0bd655eeba admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:54.126214 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b57a30-40bd-4136-ac1b-1f0bd655eeba admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:54.127324 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b57a30-40bd-4136-ac1b-1f0bd655eeba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:54.130005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b57a30-40bd-4136-ac1b-1f0bd655eeba admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:54.169226 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1407/2847] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:53:54 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:53:54.171015 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f7e7b-300e-4727-981a-6290dc86b894 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:54.190783 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f7e7b-300e-4727-981a-6290dc86b894 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:54.269984 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:54.299624 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383557d6-a1c1-466a-ae7c-5f0f7645e84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:54.300709 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383557d6-a1c1-466a-ae7c-5f0f7645e84c admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:54.301085 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383557d6-a1c1-466a-ae7c-5f0f7645e84c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:54.301457 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383557d6-a1c1-466a-ae7c-5f0f7645e84c admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:54.302241 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383557d6-a1c1-466a-ae7c-5f0f7645e84c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:54.304366 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383557d6-a1c1-466a-ae7c-5f0f7645e84c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:54.333825 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1441/2848] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:53:54 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:53:54.337585 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b57a30-40bd-4136-ac1b-1f0bd655eeba admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:54.349976 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b57a30-40bd-4136-ac1b-1f0bd655eeba admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:54.354987 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ced98-11a4-4444-9bee-c033b2af48b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:54.355657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ced98-11a4-4444-9bee-c033b2af48b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:54.355946 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ced98-11a4-4444-9bee-c033b2af48b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:54.356254 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ced98-11a4-4444-9bee-c033b2af48b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:54.357021 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ced98-11a4-4444-9bee-c033b2af48b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:54.358672 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ced98-11a4-4444-9bee-c033b2af48b1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:54.374303 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1408/2849] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:53:54.378241 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383557d6-a1c1-466a-ae7c-5f0f7645e84c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:54.389944 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383557d6-a1c1-466a-ae7c-5f0f7645e84c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:54.395643 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8daaa-8130-4614-8ec7-e3c3d574ac24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:54.396315 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8daaa-8130-4614-8ec7-e3c3d574ac24 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:54.396630 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8daaa-8130-4614-8ec7-e3c3d574ac24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:54.396909 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8daaa-8130-4614-8ec7-e3c3d574ac24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:54.397630 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8daaa-8130-4614-8ec7-e3c3d574ac24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:54.399223 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8daaa-8130-4614-8ec7-e3c3d574ac24 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:54.413149 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1442/2850] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:53:54.414395 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ced98-11a4-4444-9bee-c033b2af48b1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:54.427255 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ced98-11a4-4444-9bee-c033b2af48b1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:54.432135 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf776c-4694-4683-844c-e0f7153b63a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:54.432865 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf776c-4694-4683-844c-e0f7153b63a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:54.433145 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf776c-4694-4683-844c-e0f7153b63a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:54.433419 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf776c-4694-4683-844c-e0f7153b63a2 admin admin] PATH_INFO: `/v3/projects/3942296630944f26ac4de923a8430165/users/7a01a462cd6f4007845a8a8f40090ad6/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:54.437352 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8daaa-8130-4614-8ec7-e3c3d574ac24 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:54.440279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-67c8daaa-8130-4614-8ec7-e3c3d574ac24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:54.450449 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf776c-4694-4683-844c-e0f7153b63a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3942296630944f26ac4de923a8430165, user_id=7a01a462cd6f4007845a8a8f40090ad6, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:54.453432 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf776c-4694-4683-844c-e0f7153b63a2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:54.456693 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8daaa-8130-4614-8ec7-e3c3d574ac24 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:54.462377 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac0dfb-60f8-4682-a6fb-f7cfb288e21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:54.463278 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac0dfb-60f8-4682-a6fb-f7cfb288e21f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:54.463560 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac0dfb-60f8-4682-a6fb-f7cfb288e21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:54.463838 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac0dfb-60f8-4682-a6fb-f7cfb288e21f admin admin] PATH_INFO: `/v3/users/9a24491b2e4545e289fa4f1cff4f30d1` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:54.465090 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac0dfb-60f8-4682-a6fb-f7cfb288e21f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a24491b2e4545e289fa4f1cff4f30d1)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:54.467610 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac0dfb-60f8-4682-a6fb-f7cfb288e21f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:54.468315 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1409/2851] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:53:54 2022] PUT /identity/v3/projects/3942296630944f26ac4de923a8430165/users/7a01a462cd6f4007845a8a8f40090ad6/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:53:54.479582 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae41645-6d8c-444c-bc51-82cb8fed7d06 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:54.479942 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae41645-6d8c-444c-bc51-82cb8fed7d06 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:54.480298 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae41645-6d8c-444c-bc51-82cb8fed7d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:54.506278 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6ae41645-6d8c-444c-bc51-82cb8fed7d06 None None] MFA Rules not processed for user `7a01a462cd6f4007845a8a8f40090ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:54.507479 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6ae41645-6d8c-444c-bc51-82cb8fed7d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:54.517917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-49ac0dfb-60f8-4682-a6fb-f7cfb288e21f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a24491b2e4545e289fa4f1cff4f30d1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:54.529926 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-49ac0dfb-60f8-4682-a6fb-f7cfb288e21f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a24491b2e4545e289fa4f1cff4f30d1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:54.530597 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-49ac0dfb-60f8-4682-a6fb-f7cfb288e21f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a24491b2e4545e289fa4f1cff4f30d1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:54.537253 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-49ac0dfb-60f8-4682-a6fb-f7cfb288e21f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a24491b2e4545e289fa4f1cff4f30d1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:54.537836 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-49ac0dfb-60f8-4682-a6fb-f7cfb288e21f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a24491b2e4545e289fa4f1cff4f30d1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:54.550804 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1443/2852] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:53:54 2022] DELETE /identity/v3/users/9a24491b2e4545e289fa4f1cff4f30d1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:53:54.583497 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1410/2853] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:53:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:53:54.594666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac0dfb-60f8-4682-a6fb-f7cfb288e21f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:54.598172 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-49ac0dfb-60f8-4682-a6fb-f7cfb288e21f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:54.659119 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac0dfb-60f8-4682-a6fb-f7cfb288e21f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:54.662766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379d49e-f814-4866-a2df-79f808da316e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:54.663413 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379d49e-f814-4866-a2df-79f808da316e service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:54.663701 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379d49e-f814-4866-a2df-79f808da316e service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:54.663978 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379d49e-f814-4866-a2df-79f808da316e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:54.712276 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:54.725677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae41645-6d8c-444c-bc51-82cb8fed7d06 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:54.727232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6ae41645-6d8c-444c-bc51-82cb8fed7d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:54.729016 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379d49e-f814-4866-a2df-79f808da316e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:54.730746 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379d49e-f814-4866-a2df-79f808da316e service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:54.743417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1444/2854] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:53:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:53:54.766054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:54.806056 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae41645-6d8c-444c-bc51-82cb8fed7d06 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:54.863545 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e7298-aea3-49b6-8012-acdb94abd59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:54.864496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e7298-aea3-49b6-8012-acdb94abd59c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:54.864886 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e7298-aea3-49b6-8012-acdb94abd59c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:54.865244 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e7298-aea3-49b6-8012-acdb94abd59c admin admin] PATH_INFO: `/v3/projects/9d4ab649bf434f78b83122111ec19083` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:54.866763 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e7298-aea3-49b6-8012-acdb94abd59c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d4ab649bf434f78b83122111ec19083)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:54.868950 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e7298-aea3-49b6-8012-acdb94abd59c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:54.920125 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-986e7298-aea3-49b6-8012-acdb94abd59c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d4ab649bf434f78b83122111ec19083', 'request_id': 'req-986e7298-aea3-49b6-8012-acdb94abd59c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:54.928634 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-986e7298-aea3-49b6-8012-acdb94abd59c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d4ab649bf434f78b83122111ec19083', 'request_id': 'req-986e7298-aea3-49b6-8012-acdb94abd59c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:54.934454 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-986e7298-aea3-49b6-8012-acdb94abd59c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d4ab649bf434f78b83122111ec19083', 'request_id': 'req-986e7298-aea3-49b6-8012-acdb94abd59c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:54.947238 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-986e7298-aea3-49b6-8012-acdb94abd59c admin admin] The token cache is being invalidate because project 9d4ab649bf434f78b83122111ec19083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:53:54.947628 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-986e7298-aea3-49b6-8012-acdb94abd59c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:54.948407 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-986e7298-aea3-49b6-8012-acdb94abd59c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:54.952221 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1411/2855] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:53:54 2022] DELETE /identity/v3/projects/9d4ab649bf434f78b83122111ec19083 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:53:54.956359 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379d49e-f814-4866-a2df-79f808da316e service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:54.969535 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379d49e-f814-4866-a2df-79f808da316e service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:55.036829 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b319bb7-56e3-4d8a-a266-0f5b3f99760a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:55.037766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b319bb7-56e3-4d8a-a266-0f5b3f99760a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:55.038221 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b319bb7-56e3-4d8a-a266-0f5b3f99760a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:55.038557 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b319bb7-56e3-4d8a-a266-0f5b3f99760a admin admin] PATH_INFO: `/v3/users/3d4ebe7ef0e14f1ca8a6b88b73c14760` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:55.039924 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b319bb7-56e3-4d8a-a266-0f5b3f99760a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d4ebe7ef0e14f1ca8a6b88b73c14760)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:55.042136 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b319bb7-56e3-4d8a-a266-0f5b3f99760a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:55.092464 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1b319bb7-56e3-4d8a-a266-0f5b3f99760a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d4ebe7ef0e14f1ca8a6b88b73c14760'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:55.104441 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1b319bb7-56e3-4d8a-a266-0f5b3f99760a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d4ebe7ef0e14f1ca8a6b88b73c14760'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:55.105453 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1b319bb7-56e3-4d8a-a266-0f5b3f99760a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d4ebe7ef0e14f1ca8a6b88b73c14760'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:55.113615 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1b319bb7-56e3-4d8a-a266-0f5b3f99760a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d4ebe7ef0e14f1ca8a6b88b73c14760'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:55.114307 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1b319bb7-56e3-4d8a-a266-0f5b3f99760a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d4ebe7ef0e14f1ca8a6b88b73c14760'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:55.127109 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1445/2856] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:53:54 2022] DELETE /identity/v3/users/3d4ebe7ef0e14f1ca8a6b88b73c14760 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:53:55.294567 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e7298-aea3-49b6-8012-acdb94abd59c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:53:55.295978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-986e7298-aea3-49b6-8012-acdb94abd59c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:55.309015 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e7298-aea3-49b6-8012-acdb94abd59c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:53:55.366360 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08a83f-7a60-46de-8c64-13d5d5078841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:53:55.367205 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08a83f-7a60-46de-8c64-13d5d5078841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:55.367491 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08a83f-7a60-46de-8c64-13d5d5078841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:55.367769 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08a83f-7a60-46de-8c64-13d5d5078841 admin admin] PATH_INFO: `/v3/projects/aff0e117e98b47f69ba9c5c5b6ae0189` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:55.369000 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08a83f-7a60-46de-8c64-13d5d5078841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aff0e117e98b47f69ba9c5c5b6ae0189)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:53:55.371002 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08a83f-7a60-46de-8c64-13d5d5078841 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:53:55.373756 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:53:55.419642 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9d08a83f-7a60-46de-8c64-13d5d5078841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aff0e117e98b47f69ba9c5c5b6ae0189', 'request_id': 'req-9d08a83f-7a60-46de-8c64-13d5d5078841'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:55.426788 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9d08a83f-7a60-46de-8c64-13d5d5078841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aff0e117e98b47f69ba9c5c5b6ae0189', 'request_id': 'req-9d08a83f-7a60-46de-8c64-13d5d5078841'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:55.432723 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9d08a83f-7a60-46de-8c64-13d5d5078841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aff0e117e98b47f69ba9c5c5b6ae0189', 'request_id': 'req-9d08a83f-7a60-46de-8c64-13d5d5078841'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:55.444037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9d08a83f-7a60-46de-8c64-13d5d5078841 admin admin] The token cache is being invalidate because project aff0e117e98b47f69ba9c5c5b6ae0189 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:53:55.444325 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9d08a83f-7a60-46de-8c64-13d5d5078841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:55.444986 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9d08a83f-7a60-46de-8c64-13d5d5078841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:53:55.446515 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1412/2857] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:53:55 2022] DELETE /identity/v3/projects/aff0e117e98b47f69ba9c5c5b6ae0189 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:53:56.120147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a152021-400f-47a1-aa68-d9852c42c242 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:53:56.120711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a152021-400f-47a1-aa68-d9852c42c242 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:53:56.120711 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a152021-400f-47a1-aa68-d9852c42c242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:53:56.138214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9a152021-400f-47a1-aa68-d9852c42c242 None None] MFA Rules not processed for user `7a01a462cd6f4007845a8a8f40090ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:53:56.139409 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9a152021-400f-47a1-aa68-d9852c42c242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:53:56.193505 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1446/2858] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:53:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:54:05.441066 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=23,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:54:06.186902 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=84,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:54:09.472629 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08a83f-7a60-46de-8c64-13d5d5078841 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:54:09.474083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9d08a83f-7a60-46de-8c64-13d5d5078841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:54:09.544895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08a83f-7a60-46de-8c64-13d5d5078841 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:54:09.549692 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff065659-e0b1-4515-a53a-34121297ce33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48709a771ab64ed38018873313f37c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:54:09.550332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff065659-e0b1-4515-a53a-34121297ce33 service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:54:09.550617 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff065659-e0b1-4515-a53a-34121297ce33 service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:54:09.550897 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff065659-e0b1-4515-a53a-34121297ce33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:54:09.552764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ff065659-e0b1-4515-a53a-34121297ce33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:54:09.564754 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff065659-e0b1-4515-a53a-34121297ce33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:54:09.566327 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff065659-e0b1-4515-a53a-34121297ce33 service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:54:09.576045 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1413/2859] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:54:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:54:11.046079 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82886317-d930-46e7-ad10-c817e2e5d155 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:54:11.046581 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82886317-d930-46e7-ad10-c817e2e5d155 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:54:11.046685 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82886317-d930-46e7-ad10-c817e2e5d155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:54:11.065414 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-82886317-d930-46e7-ad10-c817e2e5d155 None None] MFA Rules not processed for user `a2bd48e6390241448fe2cf098ab64df3`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:54:11.066617 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-82886317-d930-46e7-ad10-c817e2e5d155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:54:11.120987 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1447/2860] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 30 10:54:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:54:11.133147 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff065659-e0b1-4515-a53a-34121297ce33 service placement] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:54:11.134544 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ff065659-e0b1-4515-a53a-34121297ce33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:54:11.202733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff065659-e0b1-4515-a53a-34121297ce33 service placement] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:54:11.207542 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ca5ae-66c6-4ae1-8f52-a2a47e30c228 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c15327c36c8c49ac87a3b3e9ab49eea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:54:11.208169 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ca5ae-66c6-4ae1-8f52-a2a47e30c228 service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:54:11.208450 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ca5ae-66c6-4ae1-8f52-a2a47e30c228 service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:54:11.208756 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ca5ae-66c6-4ae1-8f52-a2a47e30c228 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:54:11.216766 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ca5ae-66c6-4ae1-8f52-a2a47e30c228 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:54:11.218421 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ca5ae-66c6-4ae1-8f52-a2a47e30c228 service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:54:11.231220 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1414/2861] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 30 10:54:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:54:11.724647 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58bd56-3a77-4b23-9eb8-2584e31f4729 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:54:11.724943 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58bd56-3a77-4b23-9eb8-2584e31f4729 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:54:11.725221 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58bd56-3a77-4b23-9eb8-2584e31f4729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:54:11.742706 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-2f58bd56-3a77-4b23-9eb8-2584e31f4729 None None] MFA Rules not processed for user `a2bd48e6390241448fe2cf098ab64df3`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:54:11.743875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2f58bd56-3a77-4b23-9eb8-2584e31f4729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:54:11.750884 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1448/2862] 10.222.0.59 () {58 vars in 967 bytes} [Thu Jun 30 10:54:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:54:11.762551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ca5ae-66c6-4ae1-8f52-a2a47e30c228 service swift] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:54:11.773970 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ca5ae-66c6-4ae1-8f52-a2a47e30c228 service swift] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:54:11.779614 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e4230-6d35-4967-aba8-1e6387bcc480 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c15327c36c8c49ac87a3b3e9ab49eea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:54:11.780264 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e4230-6d35-4967-aba8-1e6387bcc480 service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:54:11.780575 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e4230-6d35-4967-aba8-1e6387bcc480 service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:54:11.780857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e4230-6d35-4967-aba8-1e6387bcc480 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:54:11.789077 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e4230-6d35-4967-aba8-1e6387bcc480 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:54:11.790683 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e4230-6d35-4967-aba8-1e6387bcc480 service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:54:11.798674 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1415/2863] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 30 10:54:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:54:11.985062 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2d640-1e73-472f-83c3-1f4fad513cd3 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:54:11.985357 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2d640-1e73-472f-83c3-1f4fad513cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:54:11.985640 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2d640-1e73-472f-83c3-1f4fad513cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:54:12.003666 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-4ad2d640-1e73-472f-83c3-1f4fad513cd3 None None] MFA Rules not processed for user `a2bd48e6390241448fe2cf098ab64df3`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:54:12.004888 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4ad2d640-1e73-472f-83c3-1f4fad513cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:54:12.011990 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1449/2864] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 30 10:54:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:54:12.026260 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e4230-6d35-4967-aba8-1e6387bcc480 service swift] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:54:12.037627 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e4230-6d35-4967-aba8-1e6387bcc480 service swift] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:54:12.043182 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed97bb-6ac7-43a6-882f-e624a96d4af9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c15327c36c8c49ac87a3b3e9ab49eea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:54:12.043816 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed97bb-6ac7-43a6-882f-e624a96d4af9 service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:54:12.044105 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed97bb-6ac7-43a6-882f-e624a96d4af9 service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:54:12.044384 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed97bb-6ac7-43a6-882f-e624a96d4af9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:54:12.052733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed97bb-6ac7-43a6-882f-e624a96d4af9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:54:12.054324 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed97bb-6ac7-43a6-882f-e624a96d4af9 service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:54:12.062810 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1416/2865] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 30 10:54:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:54:12.374927 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e28bd9-9172-4f07-ae6f-cf0462770d03 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:54:12.375389 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e28bd9-9172-4f07-ae6f-cf0462770d03 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:54:12.375493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e28bd9-9172-4f07-ae6f-cf0462770d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:54:12.392569 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f4e28bd9-9172-4f07-ae6f-cf0462770d03 None None] MFA Rules not processed for user `a2bd48e6390241448fe2cf098ab64df3`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:54:12.393895 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f4e28bd9-9172-4f07-ae6f-cf0462770d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:54:12.400825 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1450/2866] 10.222.0.59 () {58 vars in 967 bytes} [Thu Jun 30 10:54:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:54:12.412589 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed97bb-6ac7-43a6-882f-e624a96d4af9 service swift] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:54:12.423870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed97bb-6ac7-43a6-882f-e624a96d4af9 service swift] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:54:12.428936 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2fb5b-0e07-4111-a9f8-41c40dbc425a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c15327c36c8c49ac87a3b3e9ab49eea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:54:12.429559 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2fb5b-0e07-4111-a9f8-41c40dbc425a service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:54:12.429846 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2fb5b-0e07-4111-a9f8-41c40dbc425a service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:54:12.430206 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2fb5b-0e07-4111-a9f8-41c40dbc425a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:54:12.438716 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2fb5b-0e07-4111-a9f8-41c40dbc425a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:54:12.440364 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2fb5b-0e07-4111-a9f8-41c40dbc425a service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:54:12.448381 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1417/2867] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Jun 30 10:54:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:54:14.471089 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e28bd9-9172-4f07-ae6f-cf0462770d03 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:54:14.472542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f4e28bd9-9172-4f07-ae6f-cf0462770d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:54:14.539319 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e28bd9-9172-4f07-ae6f-cf0462770d03 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:54:14.543875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1186df-8966-48c2-9d12-b9be822cfc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:54:14.545375 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1186df-8966-48c2-9d12-b9be822cfc4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:54:14.545654 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1186df-8966-48c2-9d12-b9be822cfc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:54:14.545927 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1186df-8966-48c2-9d12-b9be822cfc4b admin admin] PATH_INFO: `/v3/users/7a01a462cd6f4007845a8a8f40090ad6` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:54:14.547122 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1186df-8966-48c2-9d12-b9be822cfc4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a01a462cd6f4007845a8a8f40090ad6)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:54:14.549075 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1186df-8966-48c2-9d12-b9be822cfc4b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:54:14.593799 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8f1186df-8966-48c2-9d12-b9be822cfc4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a01a462cd6f4007845a8a8f40090ad6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:54:14.605125 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8f1186df-8966-48c2-9d12-b9be822cfc4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a01a462cd6f4007845a8a8f40090ad6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:54:14.605772 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8f1186df-8966-48c2-9d12-b9be822cfc4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a01a462cd6f4007845a8a8f40090ad6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:54:14.614858 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8f1186df-8966-48c2-9d12-b9be822cfc4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a01a462cd6f4007845a8a8f40090ad6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:54:14.615910 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8f1186df-8966-48c2-9d12-b9be822cfc4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a01a462cd6f4007845a8a8f40090ad6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:54:14.629402 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1451/2868] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:54:14 2022] DELETE /identity/v3/users/7a01a462cd6f4007845a8a8f40090ad6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:54:14.634158 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98390fe1-0c20-4280-b149-68d3bbf3ccd5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:54:14.634670 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98390fe1-0c20-4280-b149-68d3bbf3ccd5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:54:14.634782 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98390fe1-0c20-4280-b149-68d3bbf3ccd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:54:14.651909 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-98390fe1-0c20-4280-b149-68d3bbf3ccd5 None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:54:14.653137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-98390fe1-0c20-4280-b149-68d3bbf3ccd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:54:14.686289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:54:14.710720 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1418/2869] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:54:14.720758 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1186df-8966-48c2-9d12-b9be822cfc4b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:54:14.722141 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8f1186df-8966-48c2-9d12-b9be822cfc4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:54:14.728624 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:54:14.780295 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1186df-8966-48c2-9d12-b9be822cfc4b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:54:14.783972 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479186a-408d-439e-b0f2-5f7927f616dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:54:14.784648 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479186a-408d-439e-b0f2-5f7927f616dd service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:54:14.784934 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479186a-408d-439e-b0f2-5f7927f616dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:54:14.785214 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479186a-408d-439e-b0f2-5f7927f616dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:54:14.794144 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479186a-408d-439e-b0f2-5f7927f616dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:54:14.796118 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479186a-408d-439e-b0f2-5f7927f616dd service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:54:14.806545 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1452/2870] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:54:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:54:14.976369 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98390fe1-0c20-4280-b149-68d3bbf3ccd5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:54:14.977958 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-98390fe1-0c20-4280-b149-68d3bbf3ccd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:54:14.993137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98390fe1-0c20-4280-b149-68d3bbf3ccd5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:54:14.998181 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcfd00-5d57-42ca-b658-2450896a89e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:54:14.999112 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcfd00-5d57-42ca-b658-2450896a89e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:54:14.999463 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcfd00-5d57-42ca-b658-2450896a89e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:54:14.999844 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcfd00-5d57-42ca-b658-2450896a89e8 admin admin] PATH_INFO: `/v3/projects/3942296630944f26ac4de923a8430165` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:54:15.001143 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dcfd00-5d57-42ca-b658-2450896a89e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3942296630944f26ac4de923a8430165)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:54:15.003079 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dcfd00-5d57-42ca-b658-2450896a89e8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:54:15.050608 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-99dcfd00-5d57-42ca-b658-2450896a89e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3942296630944f26ac4de923a8430165', 'request_id': 'req-99dcfd00-5d57-42ca-b658-2450896a89e8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:54:15.057643 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-99dcfd00-5d57-42ca-b658-2450896a89e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3942296630944f26ac4de923a8430165', 'request_id': 'req-99dcfd00-5d57-42ca-b658-2450896a89e8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:54:15.063082 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-99dcfd00-5d57-42ca-b658-2450896a89e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3942296630944f26ac4de923a8430165', 'request_id': 'req-99dcfd00-5d57-42ca-b658-2450896a89e8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:54:15.073742 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-99dcfd00-5d57-42ca-b658-2450896a89e8 admin admin] The token cache is being invalidate because project 3942296630944f26ac4de923a8430165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:54:15.074028 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-99dcfd00-5d57-42ca-b658-2450896a89e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:54:15.074652 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-99dcfd00-5d57-42ca-b658-2450896a89e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:54:15.076708 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1419/2871] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:54:14 2022] DELETE /identity/v3/projects/3942296630944f26ac4de923a8430165 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:54:24.801375 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=24 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:54:25.070911 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:55:39.166836 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479186a-408d-439e-b0f2-5f7927f616dd service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:55:39.175548 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479186a-408d-439e-b0f2-5f7927f616dd service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:55:39.223758 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf96a5-ec1c-4b42-9a26-57086195f2fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:55:39.224394 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf96a5-ec1c-4b42-9a26-57086195f2fb service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:55:39.224701 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf96a5-ec1c-4b42-9a26-57086195f2fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:55:39.224977 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf96a5-ec1c-4b42-9a26-57086195f2fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:55:39.226693 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6bcf96a5-ec1c-4b42-9a26-57086195f2fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:55:39.307678 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf96a5-ec1c-4b42-9a26-57086195f2fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:55:39.309154 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf96a5-ec1c-4b42-9a26-57086195f2fb service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:55:39.329398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1453/2872] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:55:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:55:40.517873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcfd00-5d57-42ca-b658-2450896a89e8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:55:40.519290 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-99dcfd00-5d57-42ca-b658-2450896a89e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:55:40.532061 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcfd00-5d57-42ca-b658-2450896a89e8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:55:40.536449 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa169f0-fd12-4771-b79a-7084f68e6b1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:55:40.537131 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa169f0-fd12-4771-b79a-7084f68e6b1e service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:55:40.537414 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa169f0-fd12-4771-b79a-7084f68e6b1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:55:40.537689 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa169f0-fd12-4771-b79a-7084f68e6b1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:55:40.539469 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4aa169f0-fd12-4771-b79a-7084f68e6b1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:55:40.553143 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa169f0-fd12-4771-b79a-7084f68e6b1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:55:40.554576 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa169f0-fd12-4771-b79a-7084f68e6b1e service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:55:40.566035 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1420/2873] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:55:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:55:49.284196 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf96a5-ec1c-4b42-9a26-57086195f2fb service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:55:49.285689 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6bcf96a5-ec1c-4b42-9a26-57086195f2fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:55:49.296417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf96a5-ec1c-4b42-9a26-57086195f2fb service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:55:49.300058 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7254e-b979-4f51-82e9-6c98cae474cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:55:49.300796 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7254e-b979-4f51-82e9-6c98cae474cf service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:55:49.301080 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7254e-b979-4f51-82e9-6c98cae474cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:55:49.301384 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7254e-b979-4f51-82e9-6c98cae474cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:55:49.303149 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-bba7254e-b979-4f51-82e9-6c98cae474cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:55:49.312543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7254e-b979-4f51-82e9-6c98cae474cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:55:49.313960 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7254e-b979-4f51-82e9-6c98cae474cf service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:55:49.321959 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1454/2874] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:55:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:55:50.560674 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=6 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:55:52.465390 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa169f0-fd12-4771-b79a-7084f68e6b1e service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:55:52.474850 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa169f0-fd12-4771-b79a-7084f68e6b1e service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:55:52.478605 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ea04c-6d52-4f62-bf05-24e6c8013320 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:55:52.479239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ea04c-6d52-4f62-bf05-24e6c8013320 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:55:52.479524 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ea04c-6d52-4f62-bf05-24e6c8013320 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:55:52.479801 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ea04c-6d52-4f62-bf05-24e6c8013320 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:55:52.481610 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-358ea04c-6d52-4f62-bf05-24e6c8013320 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:55:52.492487 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ea04c-6d52-4f62-bf05-24e6c8013320 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:55:52.493964 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ea04c-6d52-4f62-bf05-24e6c8013320 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:55:52.508377 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1421/2875] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:55:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:55:52.585282 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7254e-b979-4f51-82e9-6c98cae474cf service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:55:52.594535 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7254e-b979-4f51-82e9-6c98cae474cf service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:55:52.598274 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e26bd3-f1f1-4ac6-88db-dfff703424c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:55:52.598911 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e26bd3-f1f1-4ac6-88db-dfff703424c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:55:52.599193 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e26bd3-f1f1-4ac6-88db-dfff703424c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:55:52.599540 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e26bd3-f1f1-4ac6-88db-dfff703424c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:55:52.601213 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-36e26bd3-f1f1-4ac6-88db-dfff703424c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:55:52.616324 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e26bd3-f1f1-4ac6-88db-dfff703424c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:55:52.617780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e26bd3-f1f1-4ac6-88db-dfff703424c7 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:55:52.628808 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1455/2876] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:55:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:56:02.499665 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=6 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:56:02.623845 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=75 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:33.337655 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ea04c-6d52-4f62-bf05-24e6c8013320 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:33.339765 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-358ea04c-6d52-4f62-bf05-24e6c8013320 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:33.356904 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ea04c-6d52-4f62-bf05-24e6c8013320 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:33.363194 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527712a-8c3f-4a6f-b492-4c58b42614bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:33.364098 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527712a-8c3f-4a6f-b492-4c58b42614bf service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:33.364377 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527712a-8c3f-4a6f-b492-4c58b42614bf service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:33.364839 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527712a-8c3f-4a6f-b492-4c58b42614bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:33.366630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8527712a-8c3f-4a6f-b492-4c58b42614bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:33.432621 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527712a-8c3f-4a6f-b492-4c58b42614bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:33.434211 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527712a-8c3f-4a6f-b492-4c58b42614bf service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:33.444088 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1422/2877] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:34.369328 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e26bd3-f1f1-4ac6-88db-dfff703424c7 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:34.371003 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-36e26bd3-f1f1-4ac6-88db-dfff703424c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:34.385364 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e26bd3-f1f1-4ac6-88db-dfff703424c7 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:34.393242 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43776e6-081d-4613-b7ca-a2022564a2f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:34.393887 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43776e6-081d-4613-b7ca-a2022564a2f2 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:34.394188 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43776e6-081d-4613-b7ca-a2022564a2f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:34.394454 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43776e6-081d-4613-b7ca-a2022564a2f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:34.396404 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c43776e6-081d-4613-b7ca-a2022564a2f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:34.410072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43776e6-081d-4613-b7ca-a2022564a2f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:34.411696 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43776e6-081d-4613-b7ca-a2022564a2f2 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:34.424567 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1456/2878] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:35.951156 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527712a-8c3f-4a6f-b492-4c58b42614bf service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:35.961293 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527712a-8c3f-4a6f-b492-4c58b42614bf service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:35.964950 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29881777-dc07-4b08-bff0-8f0259ab6d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:35.965571 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29881777-dc07-4b08-bff0-8f0259ab6d18 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:35.965858 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29881777-dc07-4b08-bff0-8f0259ab6d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:35.966137 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29881777-dc07-4b08-bff0-8f0259ab6d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:35.967886 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-29881777-dc07-4b08-bff0-8f0259ab6d18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:36.031839 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29881777-dc07-4b08-bff0-8f0259ab6d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:36.033249 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29881777-dc07-4b08-bff0-8f0259ab6d18 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:36.043053 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1423/2879] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:41.863061 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43776e6-081d-4613-b7ca-a2022564a2f2 service nova] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:41.864855 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c43776e6-081d-4613-b7ca-a2022564a2f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:41.924657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29881777-dc07-4b08-bff0-8f0259ab6d18 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:41.926346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-29881777-dc07-4b08-bff0-8f0259ab6d18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:41.951745 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29881777-dc07-4b08-bff0-8f0259ab6d18 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:41.954555 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843d02b-8f49-4d35-a881-2ea6713c192b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:41.955552 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843d02b-8f49-4d35-a881-2ea6713c192b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:41.955945 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843d02b-8f49-4d35-a881-2ea6713c192b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:41.956300 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843d02b-8f49-4d35-a881-2ea6713c192b admin admin] PATH_INFO: `/v3/users/8453bd18330b40af9efac8d72d749141` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:41.957897 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843d02b-8f49-4d35-a881-2ea6713c192b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8453bd18330b40af9efac8d72d749141)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:41.959907 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843d02b-8f49-4d35-a881-2ea6713c192b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:41.980699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43776e6-081d-4613-b7ca-a2022564a2f2 service nova] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:41.986830 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0224b7a-6622-4f98-959c-42340f87efc6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48709a771ab64ed38018873313f37c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:41.987503 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0224b7a-6622-4f98-959c-42340f87efc6 service placement] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:41.988318 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0224b7a-6622-4f98-959c-42340f87efc6 service placement] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:41.988655 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0224b7a-6622-4f98-959c-42340f87efc6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:41.990906 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c0224b7a-6622-4f98-959c-42340f87efc6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:42.009007 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0224b7a-6622-4f98-959c-42340f87efc6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:42.010626 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0224b7a-6622-4f98-959c-42340f87efc6 service placement] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:42.022994 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5843d02b-8f49-4d35-a881-2ea6713c192b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8453bd18330b40af9efac8d72d749141'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:42.023678 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5843d02b-8f49-4d35-a881-2ea6713c192b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8453bd18330b40af9efac8d72d749141'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:42.024685 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1457/2880] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:42.038654 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5843d02b-8f49-4d35-a881-2ea6713c192b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8453bd18330b40af9efac8d72d749141'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:42.039386 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5843d02b-8f49-4d35-a881-2ea6713c192b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8453bd18330b40af9efac8d72d749141'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:42.047906 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5843d02b-8f49-4d35-a881-2ea6713c192b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8453bd18330b40af9efac8d72d749141'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:42.066708 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1424/2881] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:57:41 2022] DELETE /identity/v3/users/8453bd18330b40af9efac8d72d749141 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:57:42.238119 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0224b7a-6622-4f98-959c-42340f87efc6 service placement] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:42.248917 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0224b7a-6622-4f98-959c-42340f87efc6 service placement] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:42.310348 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388db49-f779-4c0a-b5af-1ca99298d8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:42.311247 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388db49-f779-4c0a-b5af-1ca99298d8cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:42.311531 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388db49-f779-4c0a-b5af-1ca99298d8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:42.311809 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388db49-f779-4c0a-b5af-1ca99298d8cb admin admin] PATH_INFO: `/v3/projects/8819274ed13f4f3f848fb7be9e295815` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:42.313064 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388db49-f779-4c0a-b5af-1ca99298d8cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8819274ed13f4f3f848fb7be9e295815)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:42.314990 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388db49-f779-4c0a-b5af-1ca99298d8cb admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:42.360129 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0388db49-f779-4c0a-b5af-1ca99298d8cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8819274ed13f4f3f848fb7be9e295815', 'request_id': 'req-0388db49-f779-4c0a-b5af-1ca99298d8cb'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:42.367420 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0388db49-f779-4c0a-b5af-1ca99298d8cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8819274ed13f4f3f848fb7be9e295815', 'request_id': 'req-0388db49-f779-4c0a-b5af-1ca99298d8cb'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:42.373519 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0388db49-f779-4c0a-b5af-1ca99298d8cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8819274ed13f4f3f848fb7be9e295815', 'request_id': 'req-0388db49-f779-4c0a-b5af-1ca99298d8cb'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:42.383598 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0388db49-f779-4c0a-b5af-1ca99298d8cb admin admin] The token cache is being invalidate because project 8819274ed13f4f3f848fb7be9e295815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:57:42.383881 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0388db49-f779-4c0a-b5af-1ca99298d8cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:42.384542 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0388db49-f779-4c0a-b5af-1ca99298d8cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:42.386052 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1458/2882] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:57:42 2022] DELETE /identity/v3/projects/8819274ed13f4f3f848fb7be9e295815 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:42.390176 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843d02b-8f49-4d35-a881-2ea6713c192b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:42.391641 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5843d02b-8f49-4d35-a881-2ea6713c192b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:42.401080 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:42.405553 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843d02b-8f49-4d35-a881-2ea6713c192b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:42.463725 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4c966-48d9-4a98-9be6-9a3b60c9f52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:42.464543 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4c966-48d9-4a98-9be6-9a3b60c9f52d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:42.464835 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4c966-48d9-4a98-9be6-9a3b60c9f52d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:42.465119 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4c966-48d9-4a98-9be6-9a3b60c9f52d admin admin] PATH_INFO: `/v3/users/a1218fe3d1e34356a9e498c4d7a61cd3` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:42.466297 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4c966-48d9-4a98-9be6-9a3b60c9f52d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1218fe3d1e34356a9e498c4d7a61cd3)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:42.468231 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4c966-48d9-4a98-9be6-9a3b60c9f52d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:42.514259 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e4f4c966-48d9-4a98-9be6-9a3b60c9f52d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1218fe3d1e34356a9e498c4d7a61cd3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:42.514905 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e4f4c966-48d9-4a98-9be6-9a3b60c9f52d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1218fe3d1e34356a9e498c4d7a61cd3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:42.522130 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e4f4c966-48d9-4a98-9be6-9a3b60c9f52d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1218fe3d1e34356a9e498c4d7a61cd3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:42.522764 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e4f4c966-48d9-4a98-9be6-9a3b60c9f52d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1218fe3d1e34356a9e498c4d7a61cd3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:42.530037 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e4f4c966-48d9-4a98-9be6-9a3b60c9f52d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1218fe3d1e34356a9e498c4d7a61cd3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:42.548551 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1425/2883] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 10:57:42 2022] DELETE /identity/v3/users/a1218fe3d1e34356a9e498c4d7a61cd3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:42.722859 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388db49-f779-4c0a-b5af-1ca99298d8cb admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:42.724391 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0388db49-f779-4c0a-b5af-1ca99298d8cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:42.737459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388db49-f779-4c0a-b5af-1ca99298d8cb admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:42.741500 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:42.795490 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257545d-cf4f-4409-ac04-122aed061865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:42.796337 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257545d-cf4f-4409-ac04-122aed061865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:42.796654 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257545d-cf4f-4409-ac04-122aed061865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:42.796958 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257545d-cf4f-4409-ac04-122aed061865 admin admin] PATH_INFO: `/v3/projects/f5483969c5c14c4bb1c6a49e90ecfc57` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:42.798119 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257545d-cf4f-4409-ac04-122aed061865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5483969c5c14c4bb1c6a49e90ecfc57)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:42.800046 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257545d-cf4f-4409-ac04-122aed061865 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:42.845879 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1257545d-cf4f-4409-ac04-122aed061865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5483969c5c14c4bb1c6a49e90ecfc57', 'request_id': 'req-1257545d-cf4f-4409-ac04-122aed061865'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:42.853196 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1257545d-cf4f-4409-ac04-122aed061865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5483969c5c14c4bb1c6a49e90ecfc57', 'request_id': 'req-1257545d-cf4f-4409-ac04-122aed061865'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:42.859419 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1257545d-cf4f-4409-ac04-122aed061865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5483969c5c14c4bb1c6a49e90ecfc57', 'request_id': 'req-1257545d-cf4f-4409-ac04-122aed061865'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:42.869572 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1257545d-cf4f-4409-ac04-122aed061865 admin admin] The token cache is being invalidate because project f5483969c5c14c4bb1c6a49e90ecfc57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:57:42.870142 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1257545d-cf4f-4409-ac04-122aed061865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:42.870453 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1257545d-cf4f-4409-ac04-122aed061865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:57:42.871959 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1459/2884] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 10:57:42 2022] DELETE /identity/v3/projects/f5483969c5c14c4bb1c6a49e90ecfc57 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:42.877034 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907ae3e-fec6-49ec-8c9e-f8b19ffa752b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:42.877332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907ae3e-fec6-49ec-8c9e-f8b19ffa752b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:42.877616 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907ae3e-fec6-49ec-8c9e-f8b19ffa752b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:42.896103 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-2907ae3e-fec6-49ec-8c9e-f8b19ffa752b None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:42.897332 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2907ae3e-fec6-49ec-8c9e-f8b19ffa752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:42.955699 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1426/2885] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:57:42.963802 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fca12-6ebc-433a-8218-5df605724d9d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:42.964087 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fca12-6ebc-433a-8218-5df605724d9d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:42.964362 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fca12-6ebc-433a-8218-5df605724d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:42.983253 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-6e9fca12-6ebc-433a-8218-5df605724d9d None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:42.984387 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6e9fca12-6ebc-433a-8218-5df605724d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:42.992440 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1460/2886] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:42.996488 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907ae3e-fec6-49ec-8c9e-f8b19ffa752b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:43.006313 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907ae3e-fec6-49ec-8c9e-f8b19ffa752b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:43.010857 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35f113-40c8-402f-ace6-8e907ed6d185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:43.011503 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35f113-40c8-402f-ace6-8e907ed6d185 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:43.011799 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35f113-40c8-402f-ace6-8e907ed6d185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:43.012083 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35f113-40c8-402f-ace6-8e907ed6d185 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:43.012850 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35f113-40c8-402f-ace6-8e907ed6d185 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:57:43.013354 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35f113-40c8-402f-ace6-8e907ed6d185 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:43.014974 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35f113-40c8-402f-ace6-8e907ed6d185 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:43.027091 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1427/2887] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 30 10:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:57:43.031159 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fca12-6ebc-433a-8218-5df605724d9d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:43.040958 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fca12-6ebc-433a-8218-5df605724d9d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:43.045538 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32ea34-8f7b-46d0-9582-1d2ecd41a9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:43.046171 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32ea34-8f7b-46d0-9582-1d2ecd41a9d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:43.046452 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32ea34-8f7b-46d0-9582-1d2ecd41a9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:43.046729 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32ea34-8f7b-46d0-9582-1d2ecd41a9d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:43.047419 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32ea34-8f7b-46d0-9582-1d2ecd41a9d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:43.049462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32ea34-8f7b-46d0-9582-1d2ecd41a9d8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:43.077637 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1461/2888] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:57:43 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:57:43.078773 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35f113-40c8-402f-ace6-8e907ed6d185 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:43.088733 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35f113-40c8-402f-ace6-8e907ed6d185 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:43.096883 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:43.146316 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759d5fc-24e2-4124-bc41-416fb4e9f9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:43.146978 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759d5fc-24e2-4124-bc41-416fb4e9f9dd admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:43.147268 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759d5fc-24e2-4124-bc41-416fb4e9f9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:43.147576 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759d5fc-24e2-4124-bc41-416fb4e9f9dd admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:43.148266 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759d5fc-24e2-4124-bc41-416fb4e9f9dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:43.150239 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759d5fc-24e2-4124-bc41-416fb4e9f9dd admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:43.172950 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1428/2889] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:57:43 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:57:43.176806 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32ea34-8f7b-46d0-9582-1d2ecd41a9d8 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:43.189446 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32ea34-8f7b-46d0-9582-1d2ecd41a9d8 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:43.194038 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0794e9-4cc3-4cf7-8d01-e36fe899e39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:43.194690 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0794e9-4cc3-4cf7-8d01-e36fe899e39f admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:43.194975 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0794e9-4cc3-4cf7-8d01-e36fe899e39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:43.195252 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0794e9-4cc3-4cf7-8d01-e36fe899e39f admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:43.195964 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0794e9-4cc3-4cf7-8d01-e36fe899e39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:43.197584 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0794e9-4cc3-4cf7-8d01-e36fe899e39f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:43.209621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1462/2890] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:43.213524 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759d5fc-24e2-4124-bc41-416fb4e9f9dd admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:43.223630 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759d5fc-24e2-4124-bc41-416fb4e9f9dd admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:43.228297 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1f1eb-73d5-42b3-8355-c8e5db1681e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:43.228980 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1f1eb-73d5-42b3-8355-c8e5db1681e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:43.229263 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1f1eb-73d5-42b3-8355-c8e5db1681e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:43.229535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1f1eb-73d5-42b3-8355-c8e5db1681e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:43.230249 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1f1eb-73d5-42b3-8355-c8e5db1681e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:43.231848 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1f1eb-73d5-42b3-8355-c8e5db1681e1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:43.242044 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1429/2891] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:43.246072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0794e9-4cc3-4cf7-8d01-e36fe899e39f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:43.256665 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0794e9-4cc3-4cf7-8d01-e36fe899e39f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:43.262051 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a82c1-058e-4554-9b8d-97b74eb32c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:43.262928 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a82c1-058e-4554-9b8d-97b74eb32c1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:43.263208 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a82c1-058e-4554-9b8d-97b74eb32c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:43.263489 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a82c1-058e-4554-9b8d-97b74eb32c1f admin admin] PATH_INFO: `/v3/projects/5c0e9dab1a604c38a20588ca05dae79c/users/30cb785bf7de43e7827371820617997a/roles/c68f9f9f32ac40dba0d180dd3f5582bb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:43.278695 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a82c1-058e-4554-9b8d-97b74eb32c1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c0e9dab1a604c38a20588ca05dae79c, user_id=30cb785bf7de43e7827371820617997a, role_id=c68f9f9f32ac40dba0d180dd3f5582bb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:43.281374 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a82c1-058e-4554-9b8d-97b74eb32c1f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:43.294537 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1463/2892] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:43 2022] PUT /identity/v3/projects/5c0e9dab1a604c38a20588ca05dae79c/users/30cb785bf7de43e7827371820617997a/roles/c68f9f9f32ac40dba0d180dd3f5582bb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:57:43.299755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27265dcd-1aae-46a6-9a67-da48219b94ca None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:43.300054 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27265dcd-1aae-46a6-9a67-da48219b94ca None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:43.300337 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27265dcd-1aae-46a6-9a67-da48219b94ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:43.318155 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-27265dcd-1aae-46a6-9a67-da48219b94ca None None] MFA Rules not processed for user `224404a1bd69482b9e7c4f685daaf4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:43.319346 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-27265dcd-1aae-46a6-9a67-da48219b94ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:43.376371 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1430/2893] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:57:43.386087 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a82c1-058e-4554-9b8d-97b74eb32c1f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:43.387784 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-968a82c1-058e-4554-9b8d-97b74eb32c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:43.422955 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:43.445888 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a82c1-058e-4554-9b8d-97b74eb32c1f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:43.449490 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6ceda-34a6-4b54-a39f-0be3bcc089ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:43.450123 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6ceda-34a6-4b54-a39f-0be3bcc089ef service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:43.450404 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6ceda-34a6-4b54-a39f-0be3bcc089ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:43.450677 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6ceda-34a6-4b54-a39f-0be3bcc089ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:43.459985 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6ceda-34a6-4b54-a39f-0be3bcc089ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:43.461435 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6ceda-34a6-4b54-a39f-0be3bcc089ef service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:43.471307 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1464/2894] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:57:47.352289 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4954379-f61e-4a24-9489-860846ba603b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:47.352895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4954379-f61e-4a24-9489-860846ba603b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:47.352895 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4954379-f61e-4a24-9489-860846ba603b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:47.382505 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e4954379-f61e-4a24-9489-860846ba603b None None] MFA Rules not processed for user `30cb785bf7de43e7827371820617997a`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:47.383724 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e4954379-f61e-4a24-9489-860846ba603b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:47.455070 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1431/2895] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:57:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:57:47.459621 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6ceda-34a6-4b54-a39f-0be3bcc089ef service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:47.470493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6ceda-34a6-4b54-a39f-0be3bcc089ef service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:47.475446 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36005234-2b83-43c9-8c8b-d8ae5ebdfb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:47.476108 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36005234-2b83-43c9-8c8b-d8ae5ebdfb66 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:47.476398 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36005234-2b83-43c9-8c8b-d8ae5ebdfb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:47.476724 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36005234-2b83-43c9-8c8b-d8ae5ebdfb66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:47.477419 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36005234-2b83-43c9-8c8b-d8ae5ebdfb66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:47.479374 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36005234-2b83-43c9-8c8b-d8ae5ebdfb66 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:47.508426 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1465/2896] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 30 10:57:47 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:57:47.512744 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4954379-f61e-4a24-9489-860846ba603b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:47.524591 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4954379-f61e-4a24-9489-860846ba603b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:47.542759 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:57:47.591501 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0f864-4cfd-4c1b-82eb-6da37d8da1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:47.592109 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0f864-4cfd-4c1b-82eb-6da37d8da1d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:47.592400 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0f864-4cfd-4c1b-82eb-6da37d8da1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:47.592732 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0f864-4cfd-4c1b-82eb-6da37d8da1d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:47.593471 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0f864-4cfd-4c1b-82eb-6da37d8da1d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:47.595496 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0f864-4cfd-4c1b-82eb-6da37d8da1d4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:47.616372 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1432/2897] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 30 10:57:47 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:57:47.620403 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36005234-2b83-43c9-8c8b-d8ae5ebdfb66 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:47.632126 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36005234-2b83-43c9-8c8b-d8ae5ebdfb66 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:47.637069 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1284b-2977-4fe2-b881-8ed77c667fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:47.637752 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1284b-2977-4fe2-b881-8ed77c667fff admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:47.638036 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1284b-2977-4fe2-b881-8ed77c667fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:47.638317 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1284b-2977-4fe2-b881-8ed77c667fff admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:47.639047 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1284b-2977-4fe2-b881-8ed77c667fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:47.641305 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1284b-2977-4fe2-b881-8ed77c667fff admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:47.653328 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1466/2898] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:47.657657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0f864-4cfd-4c1b-82eb-6da37d8da1d4 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:47.668201 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0f864-4cfd-4c1b-82eb-6da37d8da1d4 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:47.673042 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e89537-b3d2-4a97-afed-6b14898e0cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:47.674109 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e89537-b3d2-4a97-afed-6b14898e0cf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:47.674400 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e89537-b3d2-4a97-afed-6b14898e0cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:47.674684 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e89537-b3d2-4a97-afed-6b14898e0cf2 admin admin] PATH_INFO: `/v3/projects/df4e92b32bf047eb8de38dacf7a21b96/users/08e000e3f08344f1b108be84febdcfc0/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:47.691326 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e89537-b3d2-4a97-afed-6b14898e0cf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df4e92b32bf047eb8de38dacf7a21b96, user_id=08e000e3f08344f1b108be84febdcfc0, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:47.694079 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e89537-b3d2-4a97-afed-6b14898e0cf2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:47.708330 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1433/2899] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:47 2022] PUT /identity/v3/projects/df4e92b32bf047eb8de38dacf7a21b96/users/08e000e3f08344f1b108be84febdcfc0/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:57:47.712408 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1284b-2977-4fe2-b881-8ed77c667fff admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:47.723077 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1284b-2977-4fe2-b881-8ed77c667fff admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:47.792189 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c517658-735e-41cf-9381-5ec4f4788155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:47.792874 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c517658-735e-41cf-9381-5ec4f4788155 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:47.793163 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c517658-735e-41cf-9381-5ec4f4788155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:47.793507 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c517658-735e-41cf-9381-5ec4f4788155 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:47.794538 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c517658-735e-41cf-9381-5ec4f4788155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:47.796147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c517658-735e-41cf-9381-5ec4f4788155 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:47.807331 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1467/2900] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 30 10:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:57:47.811416 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e89537-b3d2-4a97-afed-6b14898e0cf2 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:47.822391 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e89537-b3d2-4a97-afed-6b14898e0cf2 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:47.827192 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe807b-316a-45b3-b8ca-3d8758b3089a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:47.828665 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe807b-316a-45b3-b8ca-3d8758b3089a admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:47.828952 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe807b-316a-45b3-b8ca-3d8758b3089a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:47.829230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe807b-316a-45b3-b8ca-3d8758b3089a admin admin] PATH_INFO: `/v3/projects/df4e92b32bf047eb8de38dacf7a21b96/users/08e000e3f08344f1b108be84febdcfc0/roles/ab64ea6d0475430195af26a049485569` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:47.831209 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe807b-316a-45b3-b8ca-3d8758b3089a admin admin] RBAC: Authorizing `identity:create_grant(project_id=df4e92b32bf047eb8de38dacf7a21b96, user_id=08e000e3f08344f1b108be84febdcfc0, role_id=ab64ea6d0475430195af26a049485569)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:47.833932 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe807b-316a-45b3-b8ca-3d8758b3089a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:47.844942 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1434/2901] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 30 10:57:47 2022] PUT /identity/v3/projects/df4e92b32bf047eb8de38dacf7a21b96/users/08e000e3f08344f1b108be84febdcfc0/roles/ab64ea6d0475430195af26a049485569 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:57:52.371833 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b3a47-8ab1-499a-a729-4c44b646f643 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:52.372334 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b3a47-8ab1-499a-a729-4c44b646f643 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:52.372459 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b3a47-8ab1-499a-a729-4c44b646f643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:52.403096 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-852b3a47-8ab1-499a-a729-4c44b646f643 None None] MFA Rules not processed for user `08e000e3f08344f1b108be84febdcfc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:57:52.404361 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-852b3a47-8ab1-499a-a729-4c44b646f643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:52.475395 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1468/2902] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:57:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:57:52.492328 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe807b-316a-45b3-b8ca-3d8758b3089a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:57:52.494335 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7abe807b-316a-45b3-b8ca-3d8758b3089a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:57:52.575594 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe807b-316a-45b3-b8ca-3d8758b3089a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:57:52.581350 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b2612-cd86-4c56-839d-b73a472885d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:57:52.582005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b2612-cd86-4c56-839d-b73a472885d7 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:57:52.582294 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b2612-cd86-4c56-839d-b73a472885d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:57:52.582576 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b2612-cd86-4c56-839d-b73a472885d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:57:52.642118 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b2612-cd86-4c56-839d-b73a472885d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:57:52.643755 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b2612-cd86-4c56-839d-b73a472885d7 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:57:52.653113 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1435/2903] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:57:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:58:02.472469 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=88,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:02.648817 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=91,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:16.149250 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6c7df-bb69-42c8-a50b-5d4b4c024acd None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:16.149754 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6c7df-bb69-42c8-a50b-5d4b4c024acd None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:16.149875 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6c7df-bb69-42c8-a50b-5d4b4c024acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:16.167375 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-72e6c7df-bb69-42c8-a50b-5d4b4c024acd None None] MFA Rules not processed for user `30cb785bf7de43e7827371820617997a`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:58:16.168593 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-72e6c7df-bb69-42c8-a50b-5d4b4c024acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:16.176056 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1469/2904] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 10:58:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:58:16.486072 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b2612-cd86-4c56-839d-b73a472885d7 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:16.487503 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fa1b2612-cd86-4c56-839d-b73a472885d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:16.543886 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b2612-cd86-4c56-839d-b73a472885d7 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:16.547442 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bee781-4cd2-4325-a191-eadb0e5184ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:16.548070 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bee781-4cd2-4325-a191-eadb0e5184ea service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:16.548352 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bee781-4cd2-4325-a191-eadb0e5184ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:16.548657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bee781-4cd2-4325-a191-eadb0e5184ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:16.550425 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-01bee781-4cd2-4325-a191-eadb0e5184ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:16.559646 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bee781-4cd2-4325-a191-eadb0e5184ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:16.561217 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bee781-4cd2-4325-a191-eadb0e5184ea service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:16.569286 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1436/2905] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:58:18.007215 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6c7df-bb69-42c8-a50b-5d4b4c024acd None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:18.008799 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-72e6c7df-bb69-42c8-a50b-5d4b4c024acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:18.082243 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6c7df-bb69-42c8-a50b-5d4b4c024acd None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:18.087154 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341f966-dc19-4ad5-b6b3-b7fff7fe0e79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48709a771ab64ed38018873313f37c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:18.087790 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341f966-dc19-4ad5-b6b3-b7fff7fe0e79 service placement] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:18.088072 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341f966-dc19-4ad5-b6b3-b7fff7fe0e79 service placement] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:18.088347 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341f966-dc19-4ad5-b6b3-b7fff7fe0e79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:18.090133 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1341f966-dc19-4ad5-b6b3-b7fff7fe0e79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:18.102076 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341f966-dc19-4ad5-b6b3-b7fff7fe0e79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:18.103640 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341f966-dc19-4ad5-b6b3-b7fff7fe0e79 service placement] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:18.113410 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1470/2906] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:58:26.565657 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=26 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:28.109258 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=35 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:31.534746 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bee781-4cd2-4325-a191-eadb0e5184ea service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:31.536230 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-01bee781-4cd2-4325-a191-eadb0e5184ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:31.553501 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bee781-4cd2-4325-a191-eadb0e5184ea service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:31.559000 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00baebd-7f65-45dd-8a97-93e561cef104 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:31.559644 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00baebd-7f65-45dd-8a97-93e561cef104 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:31.559932 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00baebd-7f65-45dd-8a97-93e561cef104 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:31.560213 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00baebd-7f65-45dd-8a97-93e561cef104 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:31.562576 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c00baebd-7f65-45dd-8a97-93e561cef104 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:31.575076 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00baebd-7f65-45dd-8a97-93e561cef104 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:31.576704 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00baebd-7f65-45dd-8a97-93e561cef104 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:31.588659 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1437/2907] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:58:34.493472 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341f966-dc19-4ad5-b6b3-b7fff7fe0e79 service placement] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:34.502820 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341f966-dc19-4ad5-b6b3-b7fff7fe0e79 service placement] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:34.506379 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b187fc-79cb-47b4-8644-fe3b783615be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:34.507004 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b187fc-79cb-47b4-8644-fe3b783615be service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:34.507285 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b187fc-79cb-47b4-8644-fe3b783615be service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:34.507560 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b187fc-79cb-47b4-8644-fe3b783615be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:34.517279 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b187fc-79cb-47b4-8644-fe3b783615be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:34.518699 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b187fc-79cb-47b4-8644-fe3b783615be service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:34.528107 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1471/2908] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:58:36.278017 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00baebd-7f65-45dd-8a97-93e561cef104 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:58:36.290111 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00baebd-7f65-45dd-8a97-93e561cef104 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:58:36.295579 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b45559-afb6-4a47-b089-1d24211a02b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:58:36.296535 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b45559-afb6-4a47-b089-1d24211a02b1 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:58:36.296880 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b45559-afb6-4a47-b089-1d24211a02b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:58:36.297223 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b45559-afb6-4a47-b089-1d24211a02b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:58:36.299084 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-05b45559-afb6-4a47-b089-1d24211a02b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:58:36.312006 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b45559-afb6-4a47-b089-1d24211a02b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:58:36.313619 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b45559-afb6-4a47-b089-1d24211a02b1 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:58:36.324359 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1438/2909] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:58:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:58:44.523941 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=6 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:58:46.319827 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=12 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:59:21.749669 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b187fc-79cb-47b4-8644-fe3b783615be service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:59:21.751146 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f3b187fc-79cb-47b4-8644-fe3b783615be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:21.766260 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b187fc-79cb-47b4-8644-fe3b783615be service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:59:21.771114 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c049bf2-d19e-4bfc-a3a0-5fd35e6975ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48709a771ab64ed38018873313f37c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:59:21.771780 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c049bf2-d19e-4bfc-a3a0-5fd35e6975ec service placement] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:59:21.772050 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c049bf2-d19e-4bfc-a3a0-5fd35e6975ec service placement] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:59:21.772329 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c049bf2-d19e-4bfc-a3a0-5fd35e6975ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:59:21.774106 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4c049bf2-d19e-4bfc-a3a0-5fd35e6975ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:59:21.786944 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c049bf2-d19e-4bfc-a3a0-5fd35e6975ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:59:21.788543 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c049bf2-d19e-4bfc-a3a0-5fd35e6975ec service placement] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:59:21.799187 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1472/2910] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 10:59:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:59:31.794514 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=6 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:00:51.869944 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b45559-afb6-4a47-b089-1d24211a02b1 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:00:51.879850 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b45559-afb6-4a47-b089-1d24211a02b1 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:00:51.883465 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07484b69-ec5e-48a6-ac22-279aab8da883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:00:51.884091 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07484b69-ec5e-48a6-ac22-279aab8da883 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:51.884377 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07484b69-ec5e-48a6-ac22-279aab8da883 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:51.884692 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07484b69-ec5e-48a6-ac22-279aab8da883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:51.886431 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-07484b69-ec5e-48a6-ac22-279aab8da883 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:00:51.900210 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07484b69-ec5e-48a6-ac22-279aab8da883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:00:51.901688 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07484b69-ec5e-48a6-ac22-279aab8da883 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:00:51.912929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1439/2911] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 11:00:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 11:00:53.090367 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c049bf2-d19e-4bfc-a3a0-5fd35e6975ec service placement] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:00:53.100421 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c049bf2-d19e-4bfc-a3a0-5fd35e6975ec service placement] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:00:53.103942 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d93f4a-8442-475c-b9bf-e670cde1b572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:00:53.104604 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d93f4a-8442-475c-b9bf-e670cde1b572 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:53.104897 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d93f4a-8442-475c-b9bf-e670cde1b572 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:53.105178 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d93f4a-8442-475c-b9bf-e670cde1b572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:53.106945 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-62d93f4a-8442-475c-b9bf-e670cde1b572 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:00:53.120210 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d93f4a-8442-475c-b9bf-e670cde1b572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:00:53.121662 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d93f4a-8442-475c-b9bf-e670cde1b572 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:00:53.132448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1473/2912] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 11:00:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 11:00:55.427940 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a5d12-d5c0-413a-936e-3ad6b130327f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:55.428411 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a5d12-d5c0-413a-936e-3ad6b130327f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:55.428566 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a5d12-d5c0-413a-936e-3ad6b130327f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:55.446489 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-2a9a5d12-d5c0-413a-936e-3ad6b130327f None None] MFA Rules not processed for user `30cb785bf7de43e7827371820617997a`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 11:00:55.447677 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2a9a5d12-d5c0-413a-936e-3ad6b130327f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:00:55.454547 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1440/2913] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 11:00:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 11:00:57.777298 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d93f4a-8442-475c-b9bf-e670cde1b572 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:00:57.786932 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d93f4a-8442-475c-b9bf-e670cde1b572 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:00:57.790672 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a778e45-7f8b-46aa-816d-e53437c396b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:00:57.791316 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a778e45-7f8b-46aa-816d-e53437c396b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:00:57.791594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a778e45-7f8b-46aa-816d-e53437c396b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:00:57.791868 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a778e45-7f8b-46aa-816d-e53437c396b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:00:57.793721 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7a778e45-7f8b-46aa-816d-e53437c396b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:00:57.804849 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a778e45-7f8b-46aa-816d-e53437c396b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:00:57.806596 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a778e45-7f8b-46aa-816d-e53437c396b8 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:00:57.815996 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1474/2914] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 11:00:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 11:01:05.441247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=9 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:01:07.811460 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=12 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:03:14.781123 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a5d12-d5c0-413a-936e-3ad6b130327f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:03:14.782544 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2a9a5d12-d5c0-413a-936e-3ad6b130327f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:03:14.865779 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a5d12-d5c0-413a-936e-3ad6b130327f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:03:14.869564 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972b9a7-0246-4628-ad9b-6d3701ba09ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb7ea0cfb9c423799848b912724cd75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:03:14.870192 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972b9a7-0246-4628-ad9b-6d3701ba09ff service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:03:14.870475 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972b9a7-0246-4628-ad9b-6d3701ba09ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:03:14.870749 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972b9a7-0246-4628-ad9b-6d3701ba09ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:03:14.893815 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972b9a7-0246-4628-ad9b-6d3701ba09ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:03:14.895262 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972b9a7-0246-4628-ad9b-6d3701ba09ff service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:03:14.904497 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1441/2915] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 11:03:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 11:03:24.839062 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdbb98-55b9-44a3-b0ac-4f58268b3cfb None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:03:24.839601 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdbb98-55b9-44a3-b0ac-4f58268b3cfb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:03:24.839601 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdbb98-55b9-44a3-b0ac-4f58268b3cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:03:24.857309 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-92fdbb98-55b9-44a3-b0ac-4f58268b3cfb None None] MFA Rules not processed for user `30cb785bf7de43e7827371820617997a`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 11:03:24.858497 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-92fdbb98-55b9-44a3-b0ac-4f58268b3cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:03:24.865232 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1475/2916] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 30 11:03:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 11:03:24.899948 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=45 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:03:25.180929 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972b9a7-0246-4628-ad9b-6d3701ba09ff service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:03:25.199961 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972b9a7-0246-4628-ad9b-6d3701ba09ff service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:03:25.203552 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5095a-9740-4239-a61c-4762d04b0d9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:03:25.204184 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5095a-9740-4239-a61c-4762d04b0d9b service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:03:25.204467 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5095a-9740-4239-a61c-4762d04b0d9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:03:25.204779 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5095a-9740-4239-a61c-4762d04b0d9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:03:25.212062 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5095a-9740-4239-a61c-4762d04b0d9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:03:25.213522 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5095a-9740-4239-a61c-4762d04b0d9b service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:03:25.222005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1442/2917] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 11:03:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 11:03:27.673418 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fdbb98-55b9-44a3-b0ac-4f58268b3cfb None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:03:27.692267 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fdbb98-55b9-44a3-b0ac-4f58268b3cfb None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:03:27.697147 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981fc56-c550-448b-828f-315ba28c066c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48709a771ab64ed38018873313f37c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:03:27.697799 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981fc56-c550-448b-828f-315ba28c066c service placement] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:03:27.698078 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981fc56-c550-448b-828f-315ba28c066c service placement] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:03:27.698351 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981fc56-c550-448b-828f-315ba28c066c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:03:27.707429 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981fc56-c550-448b-828f-315ba28c066c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:03:27.709018 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981fc56-c550-448b-828f-315ba28c066c service placement] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:03:27.718932 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1476/2918] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 11:03:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 11:03:32.937173 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5095a-9740-4239-a61c-4762d04b0d9b service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:03:32.965688 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5095a-9740-4239-a61c-4762d04b0d9b service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:03:32.971898 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e3a49-e669-43ba-918f-f55ba095e073 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:03:32.972737 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e3a49-e669-43ba-918f-f55ba095e073 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:03:32.972998 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e3a49-e669-43ba-918f-f55ba095e073 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:03:32.973271 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e3a49-e669-43ba-918f-f55ba095e073 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:03:32.975061 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c45e3a49-e669-43ba-918f-f55ba095e073 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:03:32.988949 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e3a49-e669-43ba-918f-f55ba095e073 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:03:32.990926 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e3a49-e669-43ba-918f-f55ba095e073 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:03:33.004762 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1443/2919] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 11:03:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 11:03:37.714462 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=12 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:03:42.865137 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981fc56-c550-448b-828f-315ba28c066c service placement] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:03:42.878555 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981fc56-c550-448b-828f-315ba28c066c service placement] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:03:42.884423 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e40fa8-8704-490f-9fc6-be66e2f77916 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:03:42.885095 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e40fa8-8704-490f-9fc6-be66e2f77916 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:03:42.885376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e40fa8-8704-490f-9fc6-be66e2f77916 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:03:42.885679 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e40fa8-8704-490f-9fc6-be66e2f77916 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:03:42.895594 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e40fa8-8704-490f-9fc6-be66e2f77916 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:03:42.897204 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e40fa8-8704-490f-9fc6-be66e2f77916 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:03:42.908758 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1477/2920] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 11:03:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 11:03:43.000075 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=19 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:03:46.342057 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e3a49-e669-43ba-918f-f55ba095e073 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:03:46.351193 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e3a49-e669-43ba-918f-f55ba095e073 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:03:46.354692 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da252d9d-35f7-482d-ae66-0f9ccfd304c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:03:46.355318 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da252d9d-35f7-482d-ae66-0f9ccfd304c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:03:46.355617 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da252d9d-35f7-482d-ae66-0f9ccfd304c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:03:46.355870 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da252d9d-35f7-482d-ae66-0f9ccfd304c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:03:46.364804 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da252d9d-35f7-482d-ae66-0f9ccfd304c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:03:46.366234 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da252d9d-35f7-482d-ae66-0f9ccfd304c8 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:03:46.376212 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1444/2921] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 11:03:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 11:03:47.906297 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e40fa8-8704-490f-9fc6-be66e2f77916 service nova] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:03:47.917695 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e40fa8-8704-490f-9fc6-be66e2f77916 service nova] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:03:47.923886 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188fac1-c605-4ab6-9645-e2d65dc50ee6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bfd036d747241d9bc314b60bf8648b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:03:47.924555 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188fac1-c605-4ab6-9645-e2d65dc50ee6 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:03:47.924847 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188fac1-c605-4ab6-9645-e2d65dc50ee6 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:03:47.925127 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188fac1-c605-4ab6-9645-e2d65dc50ee6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:03:47.934591 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188fac1-c605-4ab6-9645-e2d65dc50ee6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:03:47.936198 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188fac1-c605-4ab6-9645-e2d65dc50ee6 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:03:47.946925 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1478/2922] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 11:03:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 11:03:56.371603 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=6 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:03:57.942448 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=12 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:04:26.756599 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da252d9d-35f7-482d-ae66-0f9ccfd304c8 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:04:26.778427 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da252d9d-35f7-482d-ae66-0f9ccfd304c8 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:04:26.783328 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d92c08-5872-4657-8484-b667d8f5cbc0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48709a771ab64ed38018873313f37c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:04:26.783952 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d92c08-5872-4657-8484-b667d8f5cbc0 service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:04:26.784232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d92c08-5872-4657-8484-b667d8f5cbc0 service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:04:26.784521 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d92c08-5872-4657-8484-b667d8f5cbc0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:04:26.801100 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d92c08-5872-4657-8484-b667d8f5cbc0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:04:26.802692 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d92c08-5872-4657-8484-b667d8f5cbc0 service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:04:26.813134 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1445/2923] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 11:04:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 11:04:36.808323 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=10 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:05:50.787963 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188fac1-c605-4ab6-9645-e2d65dc50ee6 service nova] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:05:50.798201 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188fac1-c605-4ab6-9645-e2d65dc50ee6 service nova] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:05:50.801810 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d08b9-f3b9-4288-a96f-da372601a6fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8cb52425ba42d9ae3576e6fb18dc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:05:50.802440 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d08b9-f3b9-4288-a96f-da372601a6fe service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:05:50.802722 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d08b9-f3b9-4288-a96f-da372601a6fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:05:50.802997 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d08b9-f3b9-4288-a96f-da372601a6fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:05:50.871549 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d08b9-f3b9-4288-a96f-da372601a6fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:05:50.872955 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d08b9-f3b9-4288-a96f-da372601a6fe service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:05:50.891312 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1479/2924] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 11:05:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 11:05:53.931152 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d92c08-5872-4657-8484-b667d8f5cbc0 service placement] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:05:53.943281 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d92c08-5872-4657-8484-b667d8f5cbc0 service placement] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:05:53.948389 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384f254-6434-4d54-8c82-3fe50557074a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48709a771ab64ed38018873313f37c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:05:53.949188 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384f254-6434-4d54-8c82-3fe50557074a service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:05:53.949585 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384f254-6434-4d54-8c82-3fe50557074a service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:05:53.949873 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384f254-6434-4d54-8c82-3fe50557074a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:05:53.951680 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c384f254-6434-4d54-8c82-3fe50557074a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:05:53.985129 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c384f254-6434-4d54-8c82-3fe50557074a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:05:53.987396 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c384f254-6434-4d54-8c82-3fe50557074a service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:05:54.003206 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1446/2925] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 11:05:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 11:05:57.002601 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d08b9-f3b9-4288-a96f-da372601a6fe service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:05:57.015013 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d08b9-f3b9-4288-a96f-da372601a6fe service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:05:57.020077 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2e544-0ba8-47ce-adb5-93a690516a5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48709a771ab64ed38018873313f37c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:05:57.020768 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2e544-0ba8-47ce-adb5-93a690516a5a service placement] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:05:57.021056 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2e544-0ba8-47ce-adb5-93a690516a5a service placement] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:05:57.021335 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2e544-0ba8-47ce-adb5-93a690516a5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:05:57.023255 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-aee2e544-0ba8-47ce-adb5-93a690516a5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:05:57.035457 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2e544-0ba8-47ce-adb5-93a690516a5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:05:57.037087 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2e544-0ba8-47ce-adb5-93a690516a5a service placement] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:05:57.047649 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1480/2926] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 11:05:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 11:05:57.069251 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384f254-6434-4d54-8c82-3fe50557074a service placement] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:05:57.095063 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384f254-6434-4d54-8c82-3fe50557074a service placement] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:05:57.099787 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13683d-b2e5-46f2-a118-55392c9cf1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:05:57.100686 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13683d-b2e5-46f2-a118-55392c9cf1b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:05:57.100972 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13683d-b2e5-46f2-a118-55392c9cf1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:05:57.101247 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13683d-b2e5-46f2-a118-55392c9cf1b9 admin admin] PATH_INFO: `/v3/users/30cb785bf7de43e7827371820617997a` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:05:57.102411 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13683d-b2e5-46f2-a118-55392c9cf1b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30cb785bf7de43e7827371820617997a)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:05:57.104323 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13683d-b2e5-46f2-a118-55392c9cf1b9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:05:57.151232 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fe13683d-b2e5-46f2-a118-55392c9cf1b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30cb785bf7de43e7827371820617997a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:05:57.151917 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fe13683d-b2e5-46f2-a118-55392c9cf1b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30cb785bf7de43e7827371820617997a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:05:57.158830 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fe13683d-b2e5-46f2-a118-55392c9cf1b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30cb785bf7de43e7827371820617997a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:05:57.159453 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fe13683d-b2e5-46f2-a118-55392c9cf1b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30cb785bf7de43e7827371820617997a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:05:57.166975 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fe13683d-b2e5-46f2-a118-55392c9cf1b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30cb785bf7de43e7827371820617997a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:05:57.184622 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1447/2927] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 11:05:57 2022] DELETE /identity/v3/users/30cb785bf7de43e7827371820617997a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 11:05:57.364957 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2e544-0ba8-47ce-adb5-93a690516a5a service placement] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:05:57.383304 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2e544-0ba8-47ce-adb5-93a690516a5a service placement] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:05:57.440184 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9893622-a4e6-4bf5-90bd-11aa2ac9b1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:05:57.441085 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9893622-a4e6-4bf5-90bd-11aa2ac9b1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:05:57.441376 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9893622-a4e6-4bf5-90bd-11aa2ac9b1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:05:57.441655 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9893622-a4e6-4bf5-90bd-11aa2ac9b1b4 admin admin] PATH_INFO: `/v3/projects/5c0e9dab1a604c38a20588ca05dae79c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:05:57.442817 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9893622-a4e6-4bf5-90bd-11aa2ac9b1b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c0e9dab1a604c38a20588ca05dae79c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:05:57.444766 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9893622-a4e6-4bf5-90bd-11aa2ac9b1b4 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:05:57.489061 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c9893622-a4e6-4bf5-90bd-11aa2ac9b1b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c0e9dab1a604c38a20588ca05dae79c', 'request_id': 'req-c9893622-a4e6-4bf5-90bd-11aa2ac9b1b4'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:05:57.497496 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c9893622-a4e6-4bf5-90bd-11aa2ac9b1b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c0e9dab1a604c38a20588ca05dae79c', 'request_id': 'req-c9893622-a4e6-4bf5-90bd-11aa2ac9b1b4'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:05:57.503493 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c9893622-a4e6-4bf5-90bd-11aa2ac9b1b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c0e9dab1a604c38a20588ca05dae79c', 'request_id': 'req-c9893622-a4e6-4bf5-90bd-11aa2ac9b1b4'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:05:57.507242 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:05:57.526977 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c9893622-a4e6-4bf5-90bd-11aa2ac9b1b4 admin admin] The token cache is being invalidate because project 5c0e9dab1a604c38a20588ca05dae79c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 11:05:57.527259 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c9893622-a4e6-4bf5-90bd-11aa2ac9b1b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:05:57.527878 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c9893622-a4e6-4bf5-90bd-11aa2ac9b1b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:05:57.529417 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1481/2928] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 11:05:57 2022] DELETE /identity/v3/projects/5c0e9dab1a604c38a20588ca05dae79c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 11:05:57.533470 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13683d-b2e5-46f2-a118-55392c9cf1b9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:05:57.534983 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fe13683d-b2e5-46f2-a118-55392c9cf1b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:05:57.548477 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13683d-b2e5-46f2-a118-55392c9cf1b9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:05:57.603956 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f0599-c7e7-40be-abb8-6024ecee1eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:05:57.605294 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f0599-c7e7-40be-abb8-6024ecee1eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:05:57.605578 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f0599-c7e7-40be-abb8-6024ecee1eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:05:57.605852 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f0599-c7e7-40be-abb8-6024ecee1eef admin admin] PATH_INFO: `/v3/users/08e000e3f08344f1b108be84febdcfc0` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:05:57.607024 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f0599-c7e7-40be-abb8-6024ecee1eef admin admin] RBAC: Authorizing `identity:delete_user(user_id=08e000e3f08344f1b108be84febdcfc0)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:05:57.609001 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f0599-c7e7-40be-abb8-6024ecee1eef admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:05:57.654052 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-909f0599-c7e7-40be-abb8-6024ecee1eef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08e000e3f08344f1b108be84febdcfc0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:05:57.654700 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-909f0599-c7e7-40be-abb8-6024ecee1eef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08e000e3f08344f1b108be84febdcfc0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:05:57.656736 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:05:57.664161 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-909f0599-c7e7-40be-abb8-6024ecee1eef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08e000e3f08344f1b108be84febdcfc0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:05:57.665053 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-909f0599-c7e7-40be-abb8-6024ecee1eef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08e000e3f08344f1b108be84febdcfc0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:05:57.673307 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-909f0599-c7e7-40be-abb8-6024ecee1eef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08e000e3f08344f1b108be84febdcfc0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:05:57.690997 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1448/2929] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 30 11:05:57 2022] DELETE /identity/v3/users/08e000e3f08344f1b108be84febdcfc0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 11:05:57.862371 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9893622-a4e6-4bf5-90bd-11aa2ac9b1b4 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:05:57.863790 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c9893622-a4e6-4bf5-90bd-11aa2ac9b1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:05:57.878713 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9893622-a4e6-4bf5-90bd-11aa2ac9b1b4 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:05:57.933942 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43f570-bd49-488a-a5da-8c71a76e52d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '224404a1bd69482b9e7c4f685daaf4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1140dfc0b9a4b21aa549fc69cc6961b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:05:57.934789 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43f570-bd49-488a-a5da-8c71a76e52d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:05:57.935071 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43f570-bd49-488a-a5da-8c71a76e52d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:05:57.935346 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43f570-bd49-488a-a5da-8c71a76e52d1 admin admin] PATH_INFO: `/v3/projects/df4e92b32bf047eb8de38dacf7a21b96` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:05:57.936491 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43f570-bd49-488a-a5da-8c71a76e52d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df4e92b32bf047eb8de38dacf7a21b96)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:05:57.938406 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43f570-bd49-488a-a5da-8c71a76e52d1 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:05:57.983283 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4c43f570-bd49-488a-a5da-8c71a76e52d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df4e92b32bf047eb8de38dacf7a21b96', 'request_id': 'req-4c43f570-bd49-488a-a5da-8c71a76e52d1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:05:57.990342 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4c43f570-bd49-488a-a5da-8c71a76e52d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df4e92b32bf047eb8de38dacf7a21b96', 'request_id': 'req-4c43f570-bd49-488a-a5da-8c71a76e52d1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:05:57.996821 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4c43f570-bd49-488a-a5da-8c71a76e52d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df4e92b32bf047eb8de38dacf7a21b96', 'request_id': 'req-4c43f570-bd49-488a-a5da-8c71a76e52d1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:05:58.006896 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4c43f570-bd49-488a-a5da-8c71a76e52d1 admin admin] The token cache is being invalidate because project df4e92b32bf047eb8de38dacf7a21b96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 11:05:58.007505 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4c43f570-bd49-488a-a5da-8c71a76e52d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:05:58.008003 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4c43f570-bd49-488a-a5da-8c71a76e52d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 11:05:58.009548 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1482/2930] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 30 11:05:57 2022] DELETE /identity/v3/projects/df4e92b32bf047eb8de38dacf7a21b96 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 11:06:07.687446 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=11,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:06:08.003995 dv-cinder-822822-2-iscsi devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:DELETE=8,keystone:SELECT=58,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 11:09:32.700435 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f0599-c7e7-40be-abb8-6024ecee1eef admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 11:09:32.701877 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-909f0599-c7e7-40be-abb8-6024ecee1eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:09:32.769436 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f0599-c7e7-40be-abb8-6024ecee1eef admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 11:09:32.826162 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd92ab-1fc9-46f5-aa61-72f770642702 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48709a771ab64ed38018873313f37c84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '423854cc8f524ecb8d740d1cb0053856', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 11:09:32.826801 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd92ab-1fc9-46f5-aa61-72f770642702 service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 11:09:32.827084 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd92ab-1fc9-46f5-aa61-72f770642702 service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 11:09:32.827365 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd92ab-1fc9-46f5-aa61-72f770642702 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 11:09:32.829163 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-59dd92ab-1fc9-46f5-aa61-72f770642702 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 11:09:32.840933 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd92ab-1fc9-46f5-aa61-72f770642702 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 11:09:32.842542 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd92ab-1fc9-46f5-aa61-72f770642702 service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 11:09:32.853005 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1449/2931] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 30 11:09:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 11:09:42.848204 dv-cinder-822822-2-iscsi devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=58 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}